2023-11-28T20:49:58.507 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T20:49:58.508 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --verbose --name vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --archive /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668 -- /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668/orig.config.yaml 2023-11-28T20:49:58.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T20:49:58.653 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668 branch: wip-vshankar-testing-20231127.102914 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7469668' kernel: flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102914 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102914 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 owner: scheduled_vshankar@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8377 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 sleep_before_teardown: 0 subset: 462/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102914 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQTm34avSRBeQYzUfmSZMdXUmkE8HnoHSm/YGFAppwwVK/ftCmt3y/I83mWEv2sZXpPgTyZ/aCd4/+TkWEO2H4= smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCoGig1lZEEJ7OszLWZUNAio0lU1kv3l+OZnqy0zr4tip9V19o/tgCsK6+Me7TGpdpJZGF6KGgh5GShwz8QnD4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_06:29:14 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T20:49:58.653 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa; will attempt to use it 2023-11-28T20:49:58.654 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks 2023-11-28T20:49:58.654 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T20:49:58.656 INFO:teuthology.task.internal:Checking packages... 2023-11-28T20:49:58.680 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '43dd94c190073cf16cff1e711dd7f5a7b1cbc883' 2023-11-28T20:49:58.680 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T20:49:58.680 INFO:teuthology.packaging:ref: None 2023-11-28T20:49:58.680 INFO:teuthology.packaging:tag: None 2023-11-28T20:49:58.680 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102914 2023-11-28T20:49:58.681 INFO:teuthology.packaging:sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T20:49:58.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102914 2023-11-28T20:49:58.824 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T20:49:58.824 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T20:49:58.829 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T20:49:58.829 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T20:49:58.837 INFO:teuthology.task.internal:Saving configuration 2023-11-28T20:49:58.853 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T20:49:58.860 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T20:49:58.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 20:44:29.506195', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHd4IR6WisaUNWa5LyIaaPM/Ci/JscfCYkane6qhg2ua'} 2023-11-28T20:49:58.903 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 20:44:29.504552', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMVXMv3sGTF5VsuZb02bNN0Uik8QKcSe25XT5YF4Sk9F'} 2023-11-28T20:49:58.903 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T20:49:58.910 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-28T20:49:58.910 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-28T20:49:58.910 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T20:49:58.979 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4f41114040>, signals=[15]) 2023-11-28T20:49:58.979 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T20:49:58.986 INFO:teuthology.task.internal:Opening connections... 2023-11-28T20:49:58.986 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-11-28T20:49:58.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:49:59.066 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2023-11-28T20:49:59.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:49:59.142 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T20:49:59.149 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-11-28T20:49:59.154 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-11-28T20:49:59.155 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-11-28T20:49:59.206 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T20:49:59.207 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2023-11-28T20:49:59.208 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-11-28T20:49:59.232 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-11-28T20:49:59.237 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-11-28T20:49:59.237 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-11-28T20:49:59.287 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T20:49:59.287 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-11-28T20:49:59.287 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="22.04" 2023-11-28T20:49:59.288 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T20:49:59.288 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=jammy 2023-11-28T20:49:59.288 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-11-28T20:49:59.289 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-11-28T20:49:59.289 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T20:49:59.289 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T20:49:59.289 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T20:49:59.289 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T20:49:59.289 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=jammy 2023-11-28T20:49:59.289 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-11-28T20:49:59.306 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T20:49:59.315 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T20:49:59.321 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T20:49:59.321 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-11-28T20:49:59.324 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2023-11-28T20:49:59.334 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T20:49:59.341 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T20:49:59.341 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-11-28T20:49:59.372 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2023-11-28T20:49:59.395 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T20:49:59.452 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T20:49:59.466 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-28T20:49:59.467 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, timeout 300 2023-11-28T20:49:59.467 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T20:49:59.467 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T20:49:59.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:49:59.472 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:49:59.472 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T20:49:59.472 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-11-28T20:49:59.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T20:49:59.473 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:49:59.473 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T20:49:59.474 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2023-11-28T20:49:59.519 INFO:teuthology.orchestra.run.smithi006.stdout:5.15.0-56-generic 2023-11-28T20:49:59.519 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:49:59.520 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T20:49:59.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:49:59.523 INFO:teuthology.orchestra.run.smithi031.stdout:5.15.0-56-generic 2023-11-28T20:49:59.524 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:49:59.524 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T20:49:59.524 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:49:59.735 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-11-28T20:49:59.735 DEBUG:teuthology.orchestra.run.smithi006:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T20:49:59.747 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-11-28T20:49:59.747 DEBUG:teuthology.orchestra.run.smithi031:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T20:49:59.749 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T20:49:59.764 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T20:49:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T20:49:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T20:49:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T20:49:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 2023-11-28T20:49:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:hint: git config --global init.defaultBranch 2023-11-28T20:49:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 2023-11-28T20:49:59.904 INFO:teuthology.orchestra.run.smithi031.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T20:49:59.905 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T20:49:59.905 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 2023-11-28T20:49:59.905 INFO:teuthology.orchestra.run.smithi031.stderr:hint: git branch -m 2023-11-28T20:49:59.906 INFO:teuthology.orchestra.run.smithi031.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T20:49:59.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T20:49:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T20:49:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T20:49:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T20:49:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:hint: 2023-11-28T20:49:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:hint: git config --global init.defaultBranch 2023-11-28T20:49:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:hint: 2023-11-28T20:49:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T20:49:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T20:49:59.912 INFO:teuthology.orchestra.run.smithi006.stderr:hint: 2023-11-28T20:49:59.913 INFO:teuthology.orchestra.run.smithi006.stderr:hint: git branch -m 2023-11-28T20:49:59.913 INFO:teuthology.orchestra.run.smithi006.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T20:49:59.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T20:49:59.978 DEBUG:teuthology.orchestra.run.smithi031:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T20:49:59.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T20:50:00.037 DEBUG:teuthology.orchestra.run.smithi031:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T20:50:00.041 DEBUG:teuthology.orchestra.run.smithi006:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T20:52:36.926 INFO:teuthology.orchestra.run.smithi031.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T20:52:36.927 INFO:teuthology.orchestra.run.smithi031.stderr: * [new branch] main -> origin/main 2023-11-28T20:52:36.959 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T20:52:36.959 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T20:52:36.960 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T20:52:36.960 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T20:52:36.960 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T20:52:36.960 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T20:52:36.960 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T20:52:36.960 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T20:52:36.960 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T20:52:36.963 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T20:52:36.964 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T20:52:36.967 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T20:52:36.967 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T20:52:36.967 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T20:52:36.967 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T20:52:36.967 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T20:52:36.967 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T20:52:36.968 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T20:52:36.969 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T20:52:41.178 INFO:teuthology.orchestra.run.smithi031.stderr:Updating files: 48% (1588/3250) Updating files: 49% (1593/3250) Updating files: 50% (1625/3250) Updating files: 51% (1658/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 63% (2074/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 79% (2579/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 85% (2774/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T20:52:41.183 INFO:teuthology.orchestra.run.smithi031.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T20:52:41.206 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-28T20:52:41.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:52:41.437 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T20:52:41.437 DEBUG:teuthology.orchestra.run.smithi031:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T20:52:41.439 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi031.front.sepia.ceph.com to complete... 2023-11-28T20:52:47.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28 20:52:47 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T20:52:47.917 INFO:teuthology.orchestra.run.smithi031.stderr:FINISHED --2023-11-28 20:52:47-- 2023-11-28T20:52:47.917 INFO:teuthology.orchestra.run.smithi031.stderr:Total wall clock time: 6.5s 2023-11-28T20:52:47.918 INFO:teuthology.orchestra.run.smithi031.stderr:Downloaded: 1 files, 37M in 6.1s (6.10 MB/s) 2023-11-28T20:52:47.920 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-28T20:52:47.920 DEBUG:teuthology.orchestra.run.smithi031:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T20:52:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T20:52:48.405 INFO:teuthology.orchestra.run.smithi006.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T20:52:48.405 INFO:teuthology.orchestra.run.smithi006.stderr: * [new branch] main -> origin/main 2023-11-28T20:52:48.438 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T20:52:48.438 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T20:52:48.438 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T20:52:48.438 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T20:52:48.438 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T20:52:48.439 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T20:52:48.439 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T20:52:48.439 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T20:52:48.439 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T20:52:48.439 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T20:52:48.439 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T20:52:48.439 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T20:52:48.439 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T20:52:48.442 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T20:52:48.442 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T20:52:48.442 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T20:52:48.442 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T20:52:48.442 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T20:52:48.442 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T20:52:48.442 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T20:52:48.442 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T20:52:48.443 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T20:52:48.444 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T20:52:48.444 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T20:52:48.444 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T20:52:48.444 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T20:52:48.445 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T20:52:48.445 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T20:52:48.445 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T20:52:48.445 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T20:52:48.446 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T20:52:48.446 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T20:52:48.446 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T20:52:48.446 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T20:52:48.446 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T20:52:48.446 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T20:52:48.446 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T20:52:50.113 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T20:52:50.117 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T20:52:50.241 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T20:52:52.651 INFO:teuthology.orchestra.run.smithi006.stderr:Updating files: 48% (1589/3250) Updating files: 49% (1593/3250) Updating files: 50% (1625/3250) Updating files: 51% (1658/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 63% (2074/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 79% (2581/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 85% (2785/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T20:52:52.656 INFO:teuthology.orchestra.run.smithi006.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T20:52:52.678 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-28T20:52:52.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T20:52:52.918 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T20:53:01.417 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T20:53:01.419 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T20:53:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T20:53:01.420 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi006.front.sepia.ceph.com to complete... 2023-11-28T20:53:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28 20:53:05 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T20:53:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:FINISHED --2023-11-28 20:53:05-- 2023-11-28T20:53:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:Total wall clock time: 4.0s 2023-11-28T20:53:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:Downloaded: 1 files, 37M in 3.8s (9.71 MB/s) 2023-11-28T20:53:05.424 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-28T20:53:05.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T20:53:05.679 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T20:53:07.637 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T20:53:07.642 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T20:53:07.752 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T20:53:11.206 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T20:53:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T20:53:15.405 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2023-11-28T20:53:15.416 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T20:53:15.440 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2023-11-28T20:53:15.710 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T20:53:15.725 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T20:53:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T20:53:16.053 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T20:53:16.118 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T20:53:16.124 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T20:53:16.271 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T20:53:16.271 INFO:teuthology.orchestra.run.smithi031.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T20:53:16.271 INFO:teuthology.orchestra.run.smithi031.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T20:53:16.319 INFO:teuthology.orchestra.run.smithi031.stderr:done 2023-11-28T20:53:16.506 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T20:53:16.514 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T20:53:16.514 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T20:53:16.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T20:53:16.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T20:53:16.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T20:53:16.542 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T20:53:16.543 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T20:53:16.544 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T20:53:16.544 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T20:53:16.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T20:53:16.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T20:53:16.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T20:53:16.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T20:53:16.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T20:53:16.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T20:53:16.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T20:53:16.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T20:53:16.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T20:53:16.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T20:53:16.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T20:53:16.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T20:53:16.548 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T20:53:16.549 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T20:53:16.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T20:53:16.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T20:53:16.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T20:53:16.549 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T20:53:16.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T20:53:16.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T20:53:16.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T20:53:16.645 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T20:53:16.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T20:53:16.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T20:53:16.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T20:53:16.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T20:53:16.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T20:53:16.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T20:53:16.645 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T20:53:16.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T20:53:16.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T20:53:16.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T20:53:16.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T20:53:16.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T20:53:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T20:53:16.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T20:53:16.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T20:53:16.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T20:53:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T20:53:16.656 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T20:53:16.657 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T20:53:16.658 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T20:53:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T20:53:16.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T20:53:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T20:53:16.662 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T20:53:16.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T20:53:16.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T20:53:16.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T20:53:16.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T20:53:16.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T20:53:16.668 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T20:53:16.669 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T20:53:16.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T20:53:16.671 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T20:53:16.672 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T20:53:16.673 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T20:53:16.674 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T20:53:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T20:53:16.676 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T20:53:16.677 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T20:53:16.678 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T20:53:16.679 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T20:53:16.680 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T20:53:16.681 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T20:53:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T20:53:16.683 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T20:53:16.684 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T20:53:16.685 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T20:53:16.686 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T20:53:16.687 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T20:53:16.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T20:53:16.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T20:53:16.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T20:53:16.691 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T20:53:16.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T20:53:16.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T20:53:16.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T20:53:16.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T20:53:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T20:53:16.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T20:53:16.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T20:53:16.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T20:53:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T20:53:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T20:53:16.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T20:53:16.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T20:53:16.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T20:53:16.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T20:53:16.706 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T20:53:16.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T20:53:16.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T20:53:16.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T20:53:16.710 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T20:53:16.711 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T20:53:16.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T20:53:16.713 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T20:53:16.714 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T20:53:16.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T20:53:16.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T20:53:16.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T20:53:16.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T20:53:16.719 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T20:53:16.720 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T20:53:16.721 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T20:53:16.722 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T20:53:16.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T20:53:16.724 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T20:53:16.724 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T20:53:16.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T20:53:16.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T20:53:16.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T20:53:16.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T20:53:16.724 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T20:53:16.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T20:53:16.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T20:53:16.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T20:53:16.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T20:53:16.818 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T20:53:16.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T20:53:16.818 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T20:53:16.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T20:53:16.818 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T20:53:16.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T20:53:16.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T20:53:16.819 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T20:53:16.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T20:53:16.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T20:53:16.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T20:53:16.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T20:53:16.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T20:53:16.825 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T20:53:16.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T20:53:16.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T20:53:16.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T20:53:16.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T20:53:16.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T20:53:16.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T20:53:16.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T20:53:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T20:53:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T20:53:16.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T20:53:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T20:53:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T20:53:16.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T20:53:16.839 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T20:53:16.840 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T20:53:16.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T20:53:16.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T20:53:16.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T20:53:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T20:53:16.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T20:53:16.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T20:53:16.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T20:53:16.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T20:53:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T20:53:16.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T20:53:16.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T20:53:16.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T20:53:16.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T20:53:16.854 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T20:53:16.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T20:53:16.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T20:53:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T20:53:16.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T20:53:16.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T20:53:16.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T20:53:16.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T20:53:16.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T20:53:16.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T20:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T20:53:16.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T20:53:16.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T20:53:16.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T20:53:16.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T20:53:16.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T20:53:16.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T20:53:16.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T20:53:16.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T20:53:16.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T20:53:16.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T20:53:16.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T20:53:16.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T20:53:16.877 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T20:53:16.878 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T20:53:16.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T20:53:16.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T20:53:16.881 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T20:53:16.882 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T20:53:16.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T20:53:16.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T20:53:16.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T20:53:16.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T20:53:16.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T20:53:16.888 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T20:53:16.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T20:53:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T20:53:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T20:53:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T20:53:16.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T20:53:16.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T20:53:16.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T20:53:16.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T20:53:16.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T20:53:16.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T20:53:16.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T20:53:16.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T20:53:16.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T20:53:16.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T20:53:16.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T20:53:16.904 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T20:53:16.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T20:53:16.906 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T20:53:16.907 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T20:53:16.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T20:53:16.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T20:53:16.910 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T20:53:16.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T20:53:16.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T20:53:16.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T20:53:16.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T20:53:16.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T20:53:16.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T20:53:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T20:53:16.918 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T20:53:16.919 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T20:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T20:53:16.921 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T20:53:16.922 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T20:53:16.923 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T20:53:16.924 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T20:53:16.925 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T20:53:16.926 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T20:53:16.927 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T20:53:16.928 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T20:53:16.929 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T20:53:16.930 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T20:53:16.931 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T20:53:16.932 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T20:53:16.933 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T20:53:16.933 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T20:53:16.933 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T20:53:16.933 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T20:53:16.933 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T20:53:16.933 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T20:53:16.933 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T20:53:16.934 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T20:53:16.934 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T20:53:16.934 DEBUG:teuthology.orchestra.run.smithi031:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T20:53:16.941 INFO:teuthology.orchestra.run.smithi031.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T20:53:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T20:53:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T20:53:16.941 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T20:53:16.942 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T20:53:16.942 DEBUG:teuthology.orchestra.run.smithi031:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T20:53:16.987 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi031.front.sepia.ceph.com to complete... 2023-11-28T20:53:17.343 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2023-11-28T20:53:17.344 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T20:53:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2023-11-28T20:53:17.595 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T20:53:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T20:53:17.825 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T20:53:17.831 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T20:53:17.872 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T20:53:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T20:53:18.053 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T20:53:18.053 INFO:teuthology.orchestra.run.smithi031.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T20:53:18.053 INFO:teuthology.orchestra.run.smithi031.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T20:53:18.073 INFO:teuthology.orchestra.run.smithi031.stderr:done 2023-11-28T20:53:32.158 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub' 2023-11-28T20:53:32.166 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T20:53:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2023-11-28T20:53:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T20:53:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T20:53:32.890 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T20:53:32.899 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T20:53:32.963 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T20:53:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T20:53:33.111 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T20:53:33.111 INFO:teuthology.orchestra.run.smithi006.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T20:53:33.111 INFO:teuthology.orchestra.run.smithi006.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T20:53:33.158 INFO:teuthology.orchestra.run.smithi006.stderr:done 2023-11-28T20:53:33.346 DEBUG:teuthology.orchestra.run.smithi006:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T20:53:33.354 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T20:53:33.354 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T20:53:33.354 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T20:53:33.364 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T20:53:33.365 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T20:53:33.384 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T20:53:33.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T20:53:33.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T20:53:33.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T20:53:33.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T20:53:33.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T20:53:33.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T20:53:33.388 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T20:53:33.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T20:53:33.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T20:53:33.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T20:53:33.456 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T20:53:33.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T20:53:33.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T20:53:33.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T20:53:33.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T20:53:33.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T20:53:33.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T20:53:33.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T20:53:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T20:53:33.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T20:53:33.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T20:53:33.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T20:53:33.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T20:53:33.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T20:53:33.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T20:53:33.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T20:53:33.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T20:53:33.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T20:53:33.468 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T20:53:33.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T20:53:33.470 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T20:53:33.471 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T20:53:33.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T20:53:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T20:53:33.474 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T20:53:33.474 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T20:53:33.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T20:53:33.474 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T20:53:33.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T20:53:33.474 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T20:53:33.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T20:53:33.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T20:53:33.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T20:53:33.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T20:53:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T20:53:33.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T20:53:33.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T20:53:33.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T20:53:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T20:53:33.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T20:53:33.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T20:53:33.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T20:53:33.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T20:53:33.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T20:53:33.486 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T20:53:33.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T20:53:33.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T20:53:33.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T20:53:33.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T20:53:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T20:53:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T20:53:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T20:53:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T20:53:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T20:53:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T20:53:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T20:53:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T20:53:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T20:53:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T20:53:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T20:53:33.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T20:53:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T20:53:33.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T20:53:33.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T20:53:33.498 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T20:53:33.499 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T20:53:33.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T20:53:33.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T20:53:33.499 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T20:53:33.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T20:53:33.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T20:53:33.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T20:53:33.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T20:53:33.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T20:53:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T20:53:33.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T20:53:33.502 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T20:53:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T20:53:33.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T20:53:33.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T20:53:33.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T20:53:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T20:53:33.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T20:53:33.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T20:53:33.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T20:53:33.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T20:53:33.512 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T20:53:33.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T20:53:33.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T20:53:33.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T20:53:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T20:53:33.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T20:53:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T20:53:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T20:53:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T20:53:33.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T20:53:33.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T20:53:33.523 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T20:53:33.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T20:53:33.525 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T20:53:33.526 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T20:53:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T20:53:33.528 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T20:53:33.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T20:53:33.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T20:53:33.598 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T20:53:33.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T20:53:33.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T20:53:33.598 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T20:53:33.598 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T20:53:33.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T20:53:33.598 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T20:53:33.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T20:53:33.600 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T20:53:33.600 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T20:53:33.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T20:53:33.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T20:53:33.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T20:53:33.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T20:53:33.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T20:53:33.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T20:53:33.600 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T20:53:33.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T20:53:33.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T20:53:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T20:53:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T20:53:33.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T20:53:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T20:53:33.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T20:53:33.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T20:53:33.609 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T20:53:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T20:53:33.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T20:53:33.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T20:53:33.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T20:53:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T20:53:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T20:53:33.616 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T20:53:33.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T20:53:33.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T20:53:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T20:53:33.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T20:53:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T20:53:33.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T20:53:33.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T20:53:33.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T20:53:33.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T20:53:33.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T20:53:33.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T20:53:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T20:53:33.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T20:53:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T20:53:33.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T20:53:33.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T20:53:33.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T20:53:33.634 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T20:53:33.635 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T20:53:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T20:53:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T20:53:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T20:53:33.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T20:53:33.640 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T20:53:33.641 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T20:53:33.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T20:53:33.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T20:53:33.644 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T20:53:33.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T20:53:33.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T20:53:33.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T20:53:33.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T20:53:33.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T20:53:33.650 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T20:53:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T20:53:33.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T20:53:33.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T20:53:33.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T20:53:33.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T20:53:33.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T20:53:33.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T20:53:33.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T20:53:33.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T20:53:33.660 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T20:53:33.661 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T20:53:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T20:53:33.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T20:53:33.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T20:53:33.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T20:53:33.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T20:53:33.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T20:53:33.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T20:53:33.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T20:53:33.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T20:53:33.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T20:53:33.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T20:53:33.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T20:53:33.666 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T20:53:33.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T20:53:33.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T20:53:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T20:53:33.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T20:53:33.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T20:53:33.672 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T20:53:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T20:53:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T20:53:33.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T20:53:33.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T20:53:33.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T20:53:33.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T20:53:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T20:53:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T20:53:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T20:53:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T20:53:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T20:53:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T20:53:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T20:53:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T20:53:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T20:53:33.713 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T20:53:33.713 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T20:53:33.713 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T20:53:33.713 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T20:53:33.713 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T20:53:33.713 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T20:53:33.713 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T20:53:33.713 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T20:53:33.714 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T20:53:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T20:53:33.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T20:53:33.717 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T20:53:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T20:53:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T20:53:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T20:53:33.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T20:53:33.722 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T20:53:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T20:53:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T20:53:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T20:53:33.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T20:53:33.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T20:53:33.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T20:53:33.729 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T20:53:33.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T20:53:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T20:53:33.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T20:53:33.733 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T20:53:33.734 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T20:53:33.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T20:53:33.736 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T20:53:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T20:53:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T20:53:33.739 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T20:53:33.740 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T20:53:33.741 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T20:53:33.742 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T20:53:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T20:53:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T20:53:33.745 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T20:53:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T20:53:33.747 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T20:53:33.748 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T20:53:33.749 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T20:53:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T20:53:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T20:53:33.752 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T20:53:33.753 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T20:53:33.754 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T20:53:33.755 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T20:53:33.756 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T20:53:33.757 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T20:53:33.757 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T20:53:33.757 DEBUG:teuthology.orchestra.run.smithi006:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T20:53:33.764 INFO:teuthology.orchestra.run.smithi006.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T20:53:33.764 INFO:teuthology.orchestra.run.smithi006.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T20:53:33.764 INFO:teuthology.orchestra.run.smithi006.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T20:53:33.765 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T20:53:33.765 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T20:53:33.765 DEBUG:teuthology.orchestra.run.smithi006:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T20:53:33.807 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi006.front.sepia.ceph.com to complete... 2023-11-28T20:53:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub' 2023-11-28T20:53:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T20:53:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2023-11-28T20:53:34.606 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T20:53:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T20:53:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T20:53:34.903 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T20:53:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T20:53:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T20:53:35.056 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T20:53:35.056 INFO:teuthology.orchestra.run.smithi006.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T20:53:35.056 INFO:teuthology.orchestra.run.smithi006.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T20:53:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:done 2023-11-28T20:53:49.171 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-28T20:53:49.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-28T20:53:49.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:54:06.242 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-28T20:54:06.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-28T20:54:06.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:54:07.718 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-28T20:54:16.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-28T20:54:16.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:54:24.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-28T20:54:33.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-28T20:54:33.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:54:36.674 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-11-28T20:54:48.163 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-28T20:54:48.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-28T20:54:48.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:55:00.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-28T20:55:00.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T20:55:00.413 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-11-28T20:55:01.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-28T20:55:01.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g8247bbb5b470"... 2023-11-28T20:55:01.018 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2023-11-28T20:55:01.074 INFO:teuthology.orchestra.run.smithi031.stdout:6.6.0-g8247bbb5b470 2023-11-28T20:55:01.074 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T20:55:01.074 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T20:55:01.074 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T20:55:02.075 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-28T20:55:02.076 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T20:55:02.158 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2023-11-28T20:55:02.213 DEBUG:teuthology.parallel:result is None 2023-11-28T20:55:20.854 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-11-28T20:55:21.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-28T20:55:23.842 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g8247bbb5b470"... 2023-11-28T20:55:23.842 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-11-28T20:55:23.853 INFO:teuthology.orchestra.run.smithi006.stdout:6.6.0-g8247bbb5b470 2023-11-28T20:55:23.853 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T20:55:23.853 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T20:55:23.854 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T20:55:24.854 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-28T20:55:24.855 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-28T20:55:24.953 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2023-11-28T20:55:25.013 DEBUG:teuthology.parallel:result is None 2023-11-28T20:55:25.014 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T20:55:25.021 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T20:55:25.022 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T20:55:25.025 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T20:55:25.035 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T20:55:25.046 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T20:55:25.057 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T20:55:25.057 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T20:55:25.078 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T20:55:25.104 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T20:55:25.111 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T20:55:25.111 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T20:55:25.141 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T20:55:25.174 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T20:55:25.174 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T20:55:25.189 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T20:55:25.190 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T20:55:25.192 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T20:55:25.200 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T20:55:25.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T20:55:25.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T20:55:25.264 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T20:55:25.273 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T20:55:25.273 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T20:55:25.305 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T20:55:25.315 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T20:55:25.367 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T20:55:25.424 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T20:55:25.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T20:55:25.499 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T20:55:25.508 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T20:55:25.563 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T20:55:25.563 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T20:55:25.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-11-28T20:55:25.643 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2023-11-28T20:55:25.775 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T20:55:25.783 INFO:teuthology.task.internal:Starting timer... 2023-11-28T20:55:25.784 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T20:55:25.800 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T20:55:25.808 DEBUG:teuthology.task.selinux:Excluding smithi006: OS 'ubuntu' does not support SELinux 2023-11-28T20:55:25.808 DEBUG:teuthology.task.selinux:Excluding smithi031: OS 'ubuntu' does not support SELinux 2023-11-28T20:55:25.808 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T20:55:25.808 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T20:55:25.808 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T20:55:25.808 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T20:55:25.817 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-28T20:55:25.822 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-28T20:55:25.947 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T20:55:25.963 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T20:55:25.964 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi031.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T21:04:18.954 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi031.front.sepia.ceph.com')] 2023-11-28T21:04:18.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-28T21:04:18.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T21:04:19.035 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-11-28T21:04:19.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-11-28T21:04:19.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-28T21:04:19.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T21:04:19.239 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-11-28T21:04:19.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-28T21:04:19.385 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T21:04:19.399 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T21:04:19.399 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T21:04:19.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T21:04:19.403 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T21:04:19.403 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T21:04:19.441 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T21:04:19.441 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: Command line: ntpd -gq 2023-11-28T21:04:19.441 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: ---------------------------------------------------- 2023-11-28T21:04:19.441 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T21:04:19.441 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T21:04:19.442 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: corporation. Support and training for ntp-4 are 2023-11-28T21:04:19.442 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: available at https://www.nwtime.org/support 2023-11-28T21:04:19.442 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: ---------------------------------------------------- 2023-11-28T21:04:19.442 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: proto: precision = 0.042 usec (-24) 2023-11-28T21:04:19.442 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: basedate set to 2022-02-04 2023-11-28T21:04:19.442 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: gps base set to 2022-02-06 (week 2196) 2023-11-28T21:04:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T21:04:19.443 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T21:04:19.443 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T21:04:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T21:04:19.444 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T21:04:19.444 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T21:04:19.445 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T21:04:19.445 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: Listen normally on 3 ens1f0 172.21.15.6:123 2023-11-28T21:04:19.445 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: Listen normally on 4 lo [::1]:123 2023-11-28T21:04:19.445 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15e4%3]:123 2023-11-28T21:04:19.445 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:19 ntpd[27869]: Listening on routing socket on fd #22 for interface updates 2023-11-28T21:04:19.471 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T21:04:19.471 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: Command line: ntpd -gq 2023-11-28T21:04:19.471 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: ---------------------------------------------------- 2023-11-28T21:04:19.471 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T21:04:19.472 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T21:04:19.472 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: corporation. Support and training for ntp-4 are 2023-11-28T21:04:19.472 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: available at https://www.nwtime.org/support 2023-11-28T21:04:19.472 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: ---------------------------------------------------- 2023-11-28T21:04:19.472 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: proto: precision = 0.044 usec (-24) 2023-11-28T21:04:19.473 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: basedate set to 2022-02-04 2023-11-28T21:04:19.473 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: gps base set to 2022-02-06 (week 2196) 2023-11-28T21:04:19.473 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T21:04:19.473 INFO:teuthology.orchestra.run.smithi031.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T21:04:19.473 INFO:teuthology.orchestra.run.smithi031.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T21:04:19.474 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T21:04:19.474 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T21:04:19.474 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T21:04:19.474 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T21:04:19.475 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: Listen normally on 3 ens1f0 172.21.15.31:123 2023-11-28T21:04:19.475 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: Listen normally on 4 lo [::1]:123 2023-11-28T21:04:19.475 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:caba%4]:123 2023-11-28T21:04:19.475 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:19 ntpd[27873]: Listening on routing socket on fd #22 for interface updates 2023-11-28T21:04:20.442 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:20 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:20.442 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:20 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:20.442 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:20 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:20.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:20 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:20.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:20 ntpd[27869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:20.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:20 ntpd[27869]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:20.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:20 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:20.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:20 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:20.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:20 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:20.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:20 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:20.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:20 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:20.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:20 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:20.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:20 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:20.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:20 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:21 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:21 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:21 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:21 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:21 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:21 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:22.442 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:22.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:22.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:22.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:22.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:22.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:22.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:22.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:22.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:22.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:22.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:22.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:22 ntpd[27869]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:22.474 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:22.474 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:22 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:23 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:23 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:23.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:23 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:23.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:23 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:23.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:23 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:23.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:23 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:23.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:23 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:23.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:23 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:24 ntpd[27869]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:24.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:24 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:25.472 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:25 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:25.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:25 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:25.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:25 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:25.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:25 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:25.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:25 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:25.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:25 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:26.444 INFO:teuthology.orchestra.run.smithi006.stdout:28 Nov 21:04:26 ntpd[27869]: ntpd: time slew -0.000717 s 2023-11-28T21:04:26.444 INFO:teuthology.orchestra.run.smithi006.stdout:ntpd: time slew -0.000717s 2023-11-28T21:04:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T21:04:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:28 Nov 21:04:26 ntpd[27869]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T21:04:26.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:26.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:26.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:26.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:26.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T21:04:26.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T21:04:26.473 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T21:04:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T21:04:26.474 INFO:teuthology.orchestra.run.smithi031.stdout:28 Nov 21:04:26 ntpd[27873]: ntpd: time slew -0.001398 s 2023-11-28T21:04:26.475 INFO:teuthology.orchestra.run.smithi031.stdout:ntpd: time slew -0.001398s 2023-11-28T21:04:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T21:04:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:28 Nov 21:04:26 ntpd[27873]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T21:04:26.534 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T21:04:26.534 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2023-11-28T21:04:26.534 INFO:teuthology.orchestra.run.smithi006.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T21:04:26.534 INFO:teuthology.orchestra.run.smithi006.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T21:04:26.535 INFO:teuthology.orchestra.run.smithi006.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T21:04:26.535 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T21:04:26.564 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T21:04:26.565 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2023-11-28T21:04:26.565 INFO:teuthology.orchestra.run.smithi031.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T21:04:26.565 INFO:teuthology.orchestra.run.smithi031.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T21:04:26.565 INFO:teuthology.orchestra.run.smithi031.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T21:04:26.565 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T21:04:26.567 INFO:teuthology.run_tasks:Running task install... 2023-11-28T21:04:26.578 DEBUG:teuthology.task.install:project ceph 2023-11-28T21:04:26.579 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}} 2023-11-28T21:04:26.579 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'} 2023-11-28T21:04:26.579 INFO:teuthology.task.install:Using flavor: default 2023-11-28T21:04:26.585 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T21:04:26.585 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T21:04:26.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-key list | grep Ceph 2023-11-28T21:04:26.586 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-key list | grep Ceph 2023-11-28T21:04:26.695 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T21:04:26.717 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T21:04:26.750 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T21:04:26.750 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T21:04:26.751 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T21:04:26.751 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T21:04:26.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T21:04:26.772 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T21:04:26.772 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T21:04:26.773 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T21:04:26.773 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T21:04:26.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T21:04:26.919 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T21:04:26.919 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T21:04:26.970 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T21:04:26.970 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T21:04:27.033 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:04:27.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T21:04:27.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2023-11-28T21:04:27.139 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:04:27.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T21:04:27.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2023-11-28T21:04:27.246 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T21:04:27.251 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T21:04:27.267 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T21:04:27.350 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T21:04:27.350 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T21:04:27.353 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T21:04:27.359 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T21:04:27.378 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T21:04:27.389 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T21:04:27.402 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T21:04:27.426 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T21:04:27.459 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T21:04:27.462 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T21:04:27.495 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T21:04:27.513 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T21:04:27.532 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T21:04:27.568 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T21:04:27.658 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T21:04:27.875 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 27.9 kB in 1s (47.0 kB/s) 2023-11-28T21:04:27.987 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 27.9 kB in 1s (46.7 kB/s) 2023-11-28T21:04:28.825 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-11-28T21:04:28.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T21:04:28.918 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-11-28T21:04:28.942 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2023-11-28T21:04:28.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T21:04:29.034 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2023-11-28T21:04:29.088 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2023-11-28T21:04:29.089 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2023-11-28T21:04:29.203 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2023-11-28T21:04:29.203 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2023-11-28T21:04:29.246 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T21:04:29.246 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T21:04:29.246 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T21:04:29.246 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T21:04:29.246 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T21:04:29.248 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T21:04:29.248 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T21:04:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T21:04:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T21:04:29.251 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2023-11-28T21:04:29.251 INFO:teuthology.orchestra.run.smithi031.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T21:04:29.251 INFO:teuthology.orchestra.run.smithi031.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T21:04:29.251 INFO:teuthology.orchestra.run.smithi031.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T21:04:29.251 INFO:teuthology.orchestra.run.smithi031.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T21:04:29.251 INFO:teuthology.orchestra.run.smithi031.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T21:04:29.251 INFO:teuthology.orchestra.run.smithi031.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T21:04:29.251 INFO:teuthology.orchestra.run.smithi031.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T21:04:29.251 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2023-11-28T21:04:29.252 INFO:teuthology.orchestra.run.smithi031.stdout: btrfs-tools 2023-11-28T21:04:29.365 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T21:04:29.365 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T21:04:29.365 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T21:04:29.365 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T21:04:29.365 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T21:04:29.366 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T21:04:29.366 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T21:04:29.367 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T21:04:29.368 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T21:04:29.369 INFO:teuthology.orchestra.run.smithi006.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2023-11-28T21:04:29.370 INFO:teuthology.orchestra.run.smithi006.stdout: btrfs-tools 2023-11-28T21:04:29.403 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2023-11-28T21:04:29.403 INFO:teuthology.orchestra.run.smithi031.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T21:04:29.403 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T21:04:29.403 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T21:04:29.403 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T21:04:29.403 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T21:04:29.403 INFO:teuthology.orchestra.run.smithi031.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T21:04:29.403 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T21:04:29.405 INFO:teuthology.orchestra.run.smithi031.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T21:04:29.406 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T21:04:29.406 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T21:04:29.406 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T21:04:29.406 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T21:04:29.406 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T21:04:29.406 INFO:teuthology.orchestra.run.smithi031.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T21:04:29.406 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T21:04:29.406 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T21:04:29.406 INFO:teuthology.orchestra.run.smithi031.stdout: socat unzip xmlstarlet zip 2023-11-28T21:04:29.521 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2023-11-28T21:04:29.522 INFO:teuthology.orchestra.run.smithi006.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T21:04:29.522 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T21:04:29.522 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T21:04:29.522 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T21:04:29.522 INFO:teuthology.orchestra.run.smithi006.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T21:04:29.522 INFO:teuthology.orchestra.run.smithi006.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T21:04:29.522 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T21:04:29.522 INFO:teuthology.orchestra.run.smithi006.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T21:04:29.524 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T21:04:29.525 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T21:04:29.525 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T21:04:29.525 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T21:04:29.525 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T21:04:29.525 INFO:teuthology.orchestra.run.smithi006.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T21:04:29.525 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T21:04:29.525 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T21:04:29.525 INFO:teuthology.orchestra.run.smithi006.stdout: socat unzip xmlstarlet zip 2023-11-28T21:04:29.602 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T21:04:29.602 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 187 MB of archives. 2023-11-28T21:04:29.602 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T21:04:29.602 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T21:04:29.651 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T21:04:29.672 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T21:04:29.672 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 187 MB of archives. 2023-11-28T21:04:29.672 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T21:04:29.672 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T21:04:29.684 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T21:04:29.719 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T21:04:29.730 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T21:04:29.801 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T21:04:29.846 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T21:04:29.930 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T21:04:29.932 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T21:04:30.025 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T21:04:30.039 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T21:04:30.048 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T21:04:30.066 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T21:04:30.090 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T21:04:30.097 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T21:04:30.115 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T21:04:30.116 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T21:04:30.122 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T21:04:30.124 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T21:04:30.135 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T21:04:30.141 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T21:04:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T21:04:30.191 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T21:04:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T21:04:30.266 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T21:04:30.276 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T21:04:30.304 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T21:04:30.312 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T21:04:30.380 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T21:04:30.389 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T21:04:30.416 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T21:04:30.424 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T21:04:30.434 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T21:04:30.437 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T21:04:30.460 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T21:04:30.475 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T21:04:30.477 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T21:04:30.589 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T21:04:30.599 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T21:04:30.602 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T21:04:30.602 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T21:04:30.606 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T21:04:30.614 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T21:04:30.659 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T21:04:31.061 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T21:04:31.075 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T21:04:31.091 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T21:04:31.100 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T21:04:31.101 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T21:04:31.116 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T21:04:31.154 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T21:04:31.167 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T21:04:31.171 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T21:04:31.171 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T21:04:31.171 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T21:04:31.186 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T21:04:31.201 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T21:04:31.210 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T21:04:31.211 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T21:04:31.227 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T21:04:31.265 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T21:04:31.278 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T21:04:31.282 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T21:04:31.282 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T21:04:31.342 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T21:04:31.387 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T21:04:31.396 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T21:04:31.424 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T21:04:31.444 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T21:04:31.447 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T21:04:31.452 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T21:04:31.505 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T21:04:31.508 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T21:04:31.534 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T21:04:31.547 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T21:04:31.552 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T21:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T21:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T21:04:31.615 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T21:04:31.651 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T21:04:31.671 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T21:04:31.700 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T21:04:31.761 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T21:04:31.776 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T21:04:31.783 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T21:04:31.787 INFO:teuthology.orchestra.run.smithi031.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T21:04:31.825 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T21:04:31.834 INFO:teuthology.orchestra.run.smithi006.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T21:04:31.839 INFO:teuthology.orchestra.run.smithi006.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T21:04:31.871 INFO:teuthology.orchestra.run.smithi006.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T21:04:31.886 INFO:teuthology.orchestra.run.smithi006.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T21:04:31.893 INFO:teuthology.orchestra.run.smithi006.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T21:04:31.898 INFO:teuthology.orchestra.run.smithi006.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T21:04:31.912 INFO:teuthology.orchestra.run.smithi006.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T21:04:31.972 INFO:teuthology.orchestra.run.smithi031.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T21:04:32.054 INFO:teuthology.orchestra.run.smithi031.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T21:04:32.069 INFO:teuthology.orchestra.run.smithi031.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T21:04:32.081 INFO:teuthology.orchestra.run.smithi006.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T21:04:32.164 INFO:teuthology.orchestra.run.smithi006.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T21:04:32.178 INFO:teuthology.orchestra.run.smithi006.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T21:04:32.254 INFO:teuthology.orchestra.run.smithi031.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T21:04:32.305 INFO:teuthology.orchestra.run.smithi031.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T21:04:32.317 INFO:teuthology.orchestra.run.smithi031.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T21:04:32.353 INFO:teuthology.orchestra.run.smithi006.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T21:04:32.385 INFO:teuthology.orchestra.run.smithi006.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T21:04:32.402 INFO:teuthology.orchestra.run.smithi006.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T21:04:32.415 INFO:teuthology.orchestra.run.smithi006.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T21:04:32.476 INFO:teuthology.orchestra.run.smithi031.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T21:04:32.476 INFO:teuthology.orchestra.run.smithi031.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T21:04:32.481 INFO:teuthology.orchestra.run.smithi031.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T21:04:32.486 INFO:teuthology.orchestra.run.smithi031.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T21:04:32.500 INFO:teuthology.orchestra.run.smithi031.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T21:04:32.574 INFO:teuthology.orchestra.run.smithi006.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T21:04:32.574 INFO:teuthology.orchestra.run.smithi006.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T21:04:32.579 INFO:teuthology.orchestra.run.smithi006.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T21:04:32.584 INFO:teuthology.orchestra.run.smithi006.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T21:04:32.598 INFO:teuthology.orchestra.run.smithi006.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T21:04:32.684 INFO:teuthology.orchestra.run.smithi031.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T21:04:32.782 INFO:teuthology.orchestra.run.smithi006.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T21:04:32.946 INFO:teuthology.orchestra.run.smithi031.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T21:04:33.043 INFO:teuthology.orchestra.run.smithi006.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T21:04:33.080 INFO:teuthology.orchestra.run.smithi031.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T21:04:33.122 INFO:teuthology.orchestra.run.smithi031.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T21:04:33.178 INFO:teuthology.orchestra.run.smithi006.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T21:04:33.212 INFO:teuthology.orchestra.run.smithi031.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T21:04:33.219 INFO:teuthology.orchestra.run.smithi006.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T21:04:33.221 INFO:teuthology.orchestra.run.smithi031.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T21:04:33.234 INFO:teuthology.orchestra.run.smithi031.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T21:04:33.277 INFO:teuthology.orchestra.run.smithi031.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T21:04:33.309 INFO:teuthology.orchestra.run.smithi006.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T21:04:33.318 INFO:teuthology.orchestra.run.smithi006.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T21:04:33.331 INFO:teuthology.orchestra.run.smithi006.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T21:04:33.374 INFO:teuthology.orchestra.run.smithi006.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T21:04:33.538 INFO:teuthology.orchestra.run.smithi031.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T21:04:33.539 INFO:teuthology.orchestra.run.smithi031.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T21:04:33.540 INFO:teuthology.orchestra.run.smithi031.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T21:04:33.636 INFO:teuthology.orchestra.run.smithi006.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T21:04:33.637 INFO:teuthology.orchestra.run.smithi006.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T21:04:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T21:04:33.704 INFO:teuthology.orchestra.run.smithi031.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T21:04:33.803 INFO:teuthology.orchestra.run.smithi006.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T21:04:33.846 INFO:teuthology.orchestra.run.smithi006.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T21:04:33.846 INFO:teuthology.orchestra.run.smithi006.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T21:04:33.875 INFO:teuthology.orchestra.run.smithi006.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T21:04:33.974 INFO:teuthology.orchestra.run.smithi006.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T21:04:34.012 INFO:teuthology.orchestra.run.smithi006.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T21:04:34.019 INFO:teuthology.orchestra.run.smithi006.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T21:04:34.028 INFO:teuthology.orchestra.run.smithi031.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T21:04:34.046 INFO:teuthology.orchestra.run.smithi031.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T21:04:34.108 INFO:teuthology.orchestra.run.smithi006.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T21:04:34.142 INFO:teuthology.orchestra.run.smithi006.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T21:04:34.454 INFO:teuthology.orchestra.run.smithi031.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T21:04:34.462 INFO:teuthology.orchestra.run.smithi031.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T21:04:34.462 INFO:teuthology.orchestra.run.smithi031.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi006.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T21:04:34.504 INFO:teuthology.orchestra.run.smithi006.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi031.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T21:04:34.533 INFO:teuthology.orchestra.run.smithi031.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T21:04:34.534 INFO:teuthology.orchestra.run.smithi031.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T21:04:34.534 INFO:teuthology.orchestra.run.smithi031.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T21:04:34.536 INFO:teuthology.orchestra.run.smithi031.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T21:04:34.537 INFO:teuthology.orchestra.run.smithi031.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T21:04:34.545 INFO:teuthology.orchestra.run.smithi006.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T21:04:34.554 INFO:teuthology.orchestra.run.smithi006.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T21:04:34.555 INFO:teuthology.orchestra.run.smithi006.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi006.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi006.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T21:04:34.630 INFO:teuthology.orchestra.run.smithi006.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi006.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T21:04:34.632 INFO:teuthology.orchestra.run.smithi006.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T21:04:34.633 INFO:teuthology.orchestra.run.smithi006.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T21:04:34.701 INFO:teuthology.orchestra.run.smithi031.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T21:04:34.797 INFO:teuthology.orchestra.run.smithi006.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T21:04:34.817 INFO:teuthology.orchestra.run.smithi031.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T21:04:34.844 INFO:teuthology.orchestra.run.smithi031.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T21:04:34.854 INFO:teuthology.orchestra.run.smithi031.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T21:04:34.903 INFO:teuthology.orchestra.run.smithi031.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T21:04:35.009 INFO:teuthology.orchestra.run.smithi006.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T21:04:35.033 INFO:teuthology.orchestra.run.smithi031.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T21:04:35.225 INFO:teuthology.orchestra.run.smithi031.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T21:04:35.271 INFO:teuthology.orchestra.run.smithi031.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T21:04:35.299 INFO:teuthology.orchestra.run.smithi031.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T21:04:35.307 INFO:teuthology.orchestra.run.smithi031.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T21:04:35.337 INFO:teuthology.orchestra.run.smithi006.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T21:04:35.353 INFO:teuthology.orchestra.run.smithi031.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T21:04:35.378 INFO:teuthology.orchestra.run.smithi031.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T21:04:35.380 INFO:teuthology.orchestra.run.smithi031.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T21:04:35.384 INFO:teuthology.orchestra.run.smithi006.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T21:04:35.387 INFO:teuthology.orchestra.run.smithi031.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T21:04:35.391 INFO:teuthology.orchestra.run.smithi031.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T21:04:35.410 INFO:teuthology.orchestra.run.smithi006.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T21:04:35.419 INFO:teuthology.orchestra.run.smithi006.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T21:04:35.465 INFO:teuthology.orchestra.run.smithi006.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T21:04:35.490 INFO:teuthology.orchestra.run.smithi006.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T21:04:35.493 INFO:teuthology.orchestra.run.smithi006.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T21:04:35.499 INFO:teuthology.orchestra.run.smithi006.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T21:04:35.502 INFO:teuthology.orchestra.run.smithi006.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T21:04:35.587 INFO:teuthology.orchestra.run.smithi031.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T21:04:35.698 INFO:teuthology.orchestra.run.smithi006.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T21:04:35.840 INFO:teuthology.orchestra.run.smithi031.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T21:04:35.951 INFO:teuthology.orchestra.run.smithi006.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T21:04:36.114 INFO:teuthology.orchestra.run.smithi031.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T21:04:36.116 INFO:teuthology.orchestra.run.smithi031.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T21:04:36.133 INFO:teuthology.orchestra.run.smithi031.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T21:04:36.139 INFO:teuthology.orchestra.run.smithi031.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T21:04:36.169 INFO:teuthology.orchestra.run.smithi031.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T21:04:36.180 INFO:teuthology.orchestra.run.smithi031.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T21:04:36.195 INFO:teuthology.orchestra.run.smithi031.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T21:04:36.219 INFO:teuthology.orchestra.run.smithi006.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T21:04:36.221 INFO:teuthology.orchestra.run.smithi006.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T21:04:36.237 INFO:teuthology.orchestra.run.smithi006.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T21:04:36.242 INFO:teuthology.orchestra.run.smithi006.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T21:04:36.283 INFO:teuthology.orchestra.run.smithi006.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T21:04:36.284 INFO:teuthology.orchestra.run.smithi031.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T21:04:36.285 INFO:teuthology.orchestra.run.smithi031.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T21:04:36.287 INFO:teuthology.orchestra.run.smithi031.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T21:04:36.297 INFO:teuthology.orchestra.run.smithi006.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T21:04:36.387 INFO:teuthology.orchestra.run.smithi006.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T21:04:36.389 INFO:teuthology.orchestra.run.smithi006.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T21:04:36.390 INFO:teuthology.orchestra.run.smithi006.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T21:04:36.468 INFO:teuthology.orchestra.run.smithi031.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T21:04:36.570 INFO:teuthology.orchestra.run.smithi006.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T21:04:36.740 INFO:teuthology.orchestra.run.smithi031.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T21:04:36.756 INFO:teuthology.orchestra.run.smithi006.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T21:04:36.757 INFO:teuthology.orchestra.run.smithi006.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T21:04:36.759 INFO:teuthology.orchestra.run.smithi006.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T21:04:36.760 INFO:teuthology.orchestra.run.smithi006.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T21:04:36.760 INFO:teuthology.orchestra.run.smithi006.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T21:04:36.761 INFO:teuthology.orchestra.run.smithi006.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T21:04:36.843 INFO:teuthology.orchestra.run.smithi006.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T21:04:37.342 INFO:teuthology.orchestra.run.smithi006.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T21:04:38.014 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 187 MB in 8s (24.0 MB/s) 2023-11-28T21:04:38.134 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T21:04:38.204 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T21:04:38.208 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T21:04:38.249 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi031.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T21:04:38.463 INFO:teuthology.orchestra.run.smithi031.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T21:04:38.501 INFO:teuthology.orchestra.run.smithi031.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T21:04:38.577 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T21:04:38.591 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T21:04:38.608 INFO:teuthology.orchestra.run.smithi031.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T21:04:38.635 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T21:04:38.645 INFO:teuthology.orchestra.run.smithi031.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T21:04:38.646 INFO:teuthology.orchestra.run.smithi031.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T21:04:38.750 INFO:teuthology.orchestra.run.smithi031.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T21:04:38.946 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T21:04:38.961 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T21:04:39.005 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T21:04:39.183 INFO:teuthology.orchestra.run.smithi031.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T21:04:39.183 INFO:teuthology.orchestra.run.smithi031.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T21:04:39.366 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T21:04:39.381 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T21:04:39.450 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T21:04:39.720 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T21:04:39.737 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T21:04:39.778 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T21:04:40.240 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T21:04:40.255 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T21:04:40.298 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T21:04:40.718 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T21:04:40.734 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T21:04:40.777 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:04:41.171 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T21:04:41.187 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T21:04:41.229 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:04:41.566 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T21:04:41.581 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T21:04:41.584 INFO:teuthology.orchestra.run.smithi031.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T21:04:41.586 INFO:teuthology.orchestra.run.smithi031.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T21:04:41.588 INFO:teuthology.orchestra.run.smithi031.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T21:04:41.588 INFO:teuthology.orchestra.run.smithi031.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T21:04:41.588 INFO:teuthology.orchestra.run.smithi031.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T21:04:41.589 INFO:teuthology.orchestra.run.smithi031.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T21:04:41.624 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:04:41.921 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T21:04:41.936 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T21:04:41.979 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T21:04:42.164 INFO:teuthology.orchestra.run.smithi031.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T21:04:42.307 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librados2. 2023-11-28T21:04:42.322 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:42.365 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:42.784 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librbd1. 2023-11-28T21:04:42.800 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:42.828 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 187 MB in 13s (14.7 MB/s) 2023-11-28T21:04:42.842 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:42.966 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T21:04:43.038 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T21:04:43.041 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T21:04:43.082 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T21:04:43.246 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T21:04:43.261 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:43.296 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:43.410 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T21:04:43.424 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T21:04:43.468 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T21:04:43.540 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rados. 2023-11-28T21:04:43.555 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:43.598 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:43.829 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T21:04:43.843 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T21:04:43.887 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T21:04:43.959 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T21:04:43.974 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:04:44.017 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:44.223 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T21:04:44.238 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T21:04:44.270 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T21:04:44.285 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:44.320 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:44.323 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T21:04:44.597 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T21:04:44.613 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:04:44.635 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T21:04:44.650 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T21:04:44.655 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:44.693 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T21:04:45.000 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T21:04:45.016 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T21:04:45.058 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T21:04:45.063 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T21:04:45.078 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T21:04:45.121 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T21:04:45.328 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T21:04:45.343 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:45.386 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T21:04:45.548 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T21:04:45.591 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:04:45.756 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T21:04:45.771 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T21:04:45.814 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T21:04:45.960 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T21:04:45.975 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T21:04:46.019 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:04:46.310 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T21:04:46.325 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T21:04:46.366 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T21:04:46.414 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T21:04:46.429 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T21:04:46.472 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:04:46.686 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T21:04:46.702 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T21:04:46.744 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T21:04:46.825 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T21:04:46.840 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T21:04:46.883 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T21:04:47.073 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua5.1. 2023-11-28T21:04:47.088 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T21:04:47.133 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T21:04:47.361 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librados2. 2023-11-28T21:04:47.376 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:47.411 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:47.450 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-any. 2023-11-28T21:04:47.466 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T21:04:47.500 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T21:04:47.744 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package zip. 2023-11-28T21:04:47.760 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T21:04:47.803 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T21:04:47.838 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librbd1. 2023-11-28T21:04:47.854 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:47.897 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:48.114 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package unzip. 2023-11-28T21:04:48.130 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T21:04:48.172 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T21:04:48.316 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T21:04:48.330 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:48.374 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:48.576 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package luarocks. 2023-11-28T21:04:48.591 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T21:04:48.634 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T21:04:48.677 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rados. 2023-11-28T21:04:48.692 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:48.726 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:48.987 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T21:04:49.003 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:04:49.008 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librgw2. 2023-11-28T21:04:49.024 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:49.054 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:49.058 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:49.306 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T21:04:49.322 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:49.365 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:49.511 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T21:04:49.527 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:49.569 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:49.684 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T21:04:49.699 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:04:49.759 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:49.905 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T21:04:49.921 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T21:04:49.989 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T21:04:50.112 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T21:04:50.126 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T21:04:50.170 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T21:04:50.283 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T21:04:50.299 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:50.333 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:50.414 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T21:04:50.429 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:50.464 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:50.745 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-common. 2023-11-28T21:04:50.758 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T21:04:50.760 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:50.774 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T21:04:50.803 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:50.817 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T21:04:51.136 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T21:04:51.151 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T21:04:51.194 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T21:04:51.513 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T21:04:51.529 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T21:04:51.572 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T21:04:51.858 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-base. 2023-11-28T21:04:51.874 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:51.926 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:51.933 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua5.1. 2023-11-28T21:04:51.949 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T21:04:51.991 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T21:04:52.604 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T21:04:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-any. 2023-11-28T21:04:52.619 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T21:04:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T21:04:52.669 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T21:04:52.670 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T21:04:52.921 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package zip. 2023-11-28T21:04:52.936 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T21:04:52.957 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T21:04:52.971 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T21:04:52.972 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T21:04:53.015 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T21:04:53.233 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package unzip. 2023-11-28T21:04:53.248 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T21:04:53.282 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T21:04:53.343 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T21:04:53.358 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T21:04:53.410 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T21:04:53.694 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package luarocks. 2023-11-28T21:04:53.710 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T21:04:53.752 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T21:04:53.762 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T21:04:53.778 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T21:04:53.821 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T21:04:54.123 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T21:04:54.135 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librgw2. 2023-11-28T21:04:54.139 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T21:04:54.149 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:54.182 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T21:04:54.193 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:54.484 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T21:04:54.500 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T21:04:54.543 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T21:04:54.670 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T21:04:54.685 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:54.720 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:54.854 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-portend. 2023-11-28T21:04:54.869 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T21:04:54.912 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T21:04:55.023 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T21:04:55.038 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T21:04:55.081 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T21:04:55.215 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T21:04:55.231 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T21:04:55.273 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T21:04:55.401 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T21:04:55.416 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:55.459 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:55.559 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T21:04:55.575 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T21:04:55.609 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T21:04:55.895 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-common. 2023-11-28T21:04:55.911 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:55.946 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T21:04:55.953 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:55.962 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T21:04:56.004 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T21:04:56.357 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T21:04:56.373 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T21:04:56.416 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T21:04:56.727 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T21:04:56.742 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T21:04:56.785 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T21:04:57.025 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-base. 2023-11-28T21:04:57.041 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:04:57.093 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:04:57.122 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-mako. 2023-11-28T21:04:57.137 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T21:04:57.180 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T21:04:57.516 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T21:04:57.532 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T21:04:57.574 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T21:04:57.762 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T21:04:57.777 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T21:04:57.820 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T21:04:57.860 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T21:04:57.876 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T21:04:57.950 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T21:04:58.157 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T21:04:58.173 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T21:04:58.215 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T21:04:58.238 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webob. 2023-11-28T21:04:58.254 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T21:04:58.296 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T21:04:58.526 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T21:04:58.542 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T21:04:58.584 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T21:04:58.649 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T21:04:58.665 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T21:04:58.710 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T21:04:58.870 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T21:04:58.886 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T21:04:58.928 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T21:04:59.044 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T21:04:59.059 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T21:04:59.102 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T21:04:59.231 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T21:04:59.247 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T21:04:59.281 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T21:04:59.405 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-paste. 2023-11-28T21:04:59.421 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T21:04:59.463 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T21:04:59.559 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T21:04:59.575 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T21:04:59.609 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T21:04:59.791 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T21:04:59.807 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T21:04:59.849 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T21:04:59.911 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-portend. 2023-11-28T21:04:59.927 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T21:04:59.969 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T21:05:00.152 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T21:05:00.167 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T21:05:00.210 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T21:05:00.281 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T21:05:00.297 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T21:05:00.339 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T21:05:00.538 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T21:05:00.554 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T21:05:00.597 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T21:05:00.659 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T21:05:00.674 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T21:05:00.708 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T21:05:00.883 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T21:05:00.898 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T21:05:00.941 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T21:05:01.062 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T21:05:01.077 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T21:05:01.120 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T21:05:01.271 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T21:05:01.287 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T21:05:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T21:05:01.432 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T21:05:01.447 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T21:05:01.498 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T21:05:01.784 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T21:05:01.800 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T21:05:01.834 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T21:05:01.932 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-idna. 2023-11-28T21:05:01.948 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T21:05:01.990 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T21:05:02.153 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-mako. 2023-11-28T21:05:02.169 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T21:05:02.211 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T21:05:02.301 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T21:05:02.317 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T21:05:02.359 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T21:05:03.223 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T21:05:03.239 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T21:05:03.281 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T21:05:03.371 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests. 2023-11-28T21:05:03.387 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T21:05:03.421 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T21:05:03.584 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T21:05:03.600 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T21:05:03.642 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T21:05:03.707 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T21:05:03.723 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T21:05:03.757 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T21:05:03.903 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webob. 2023-11-28T21:05:03.919 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T21:05:03.953 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T21:05:04.043 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T21:05:04.059 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:04.102 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:04.281 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T21:05:04.297 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T21:05:04.342 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T21:05:04.523 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T21:05:04.539 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:04.581 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:04.684 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T21:05:04.700 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T21:05:04.742 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T21:05:04.892 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T21:05:04.908 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T21:05:04.951 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T21:05:05.046 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-paste. 2023-11-28T21:05:05.061 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T21:05:05.111 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T21:05:05.270 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T21:05:05.286 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T21:05:05.337 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T21:05:05.448 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T21:05:05.464 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T21:05:05.506 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T21:05:05.657 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T21:05:05.672 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:05.715 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:05.834 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T21:05:05.850 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T21:05:05.892 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T21:05:06.126 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T21:05:06.142 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:06.178 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T21:05:06.184 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:06.194 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T21:05:06.236 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T21:05:06.489 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T21:05:06.504 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T21:05:06.538 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T21:05:06.893 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T21:05:06.909 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T21:05:06.943 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T21:05:07.055 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T21:05:07.071 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:07.113 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:07.254 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-idna. 2023-11-28T21:05:07.269 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T21:05:07.312 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T21:05:07.632 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T21:05:07.647 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T21:05:07.690 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T21:05:08.043 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests. 2023-11-28T21:05:08.059 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T21:05:08.101 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T21:05:08.412 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T21:05:08.416 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph. 2023-11-28T21:05:08.428 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T21:05:08.432 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:08.470 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T21:05:08.474 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:08.815 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T21:05:08.827 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T21:05:08.831 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:08.842 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:08.873 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:08.885 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T21:05:09.245 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:09.269 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T21:05:09.285 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:09.288 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:09.327 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:09.599 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephadm. 2023-11-28T21:05:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:09.647 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T21:05:09.648 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:09.662 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T21:05:09.713 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T21:05:09.968 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T21:05:09.985 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T21:05:10.016 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T21:05:10.026 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T21:05:10.032 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T21:05:10.075 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T21:05:10.320 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T21:05:10.336 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T21:05:10.371 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T21:05:10.395 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T21:05:10.411 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:10.454 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:10.821 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T21:05:10.837 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:10.880 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:11.275 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-babel. 2023-11-28T21:05:11.290 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T21:05:11.333 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T21:05:11.653 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T21:05:11.667 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T21:05:11.700 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T21:05:11.711 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T21:05:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:11.774 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:12.031 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T21:05:12.046 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:12.089 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:12.418 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T21:05:12.434 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T21:05:12.475 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T21:05:12.778 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-routes. 2023-11-28T21:05:12.794 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T21:05:12.836 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T21:05:13.053 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph. 2023-11-28T21:05:13.068 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:13.110 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:13.223 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T21:05:13.239 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:13.282 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:13.413 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T21:05:13.429 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:13.471 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:13.693 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T21:05:13.708 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T21:05:13.743 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T21:05:13.791 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T21:05:13.807 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:13.849 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:14.246 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T21:05:14.252 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephadm. 2023-11-28T21:05:14.262 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T21:05:14.268 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:14.296 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T21:05:14.310 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:14.638 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T21:05:14.649 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T21:05:14.653 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T21:05:14.665 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T21:05:14.695 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T21:05:14.793 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T21:05:15.024 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T21:05:15.040 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T21:05:15.082 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T21:05:15.112 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T21:05:15.128 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T21:05:15.171 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T21:05:15.838 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T21:05:15.853 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:15.896 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:16.061 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-babel. 2023-11-28T21:05:16.076 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T21:05:16.111 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T21:05:16.439 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T21:05:16.454 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T21:05:16.497 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T21:05:16.833 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T21:05:16.849 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:16.849 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T21:05:16.865 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T21:05:16.891 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:16.908 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T21:05:17.211 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T21:05:17.234 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T21:05:17.235 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T21:05:17.235 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T21:05:17.269 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T21:05:17.274 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T21:05:17.614 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-routes. 2023-11-28T21:05:17.630 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T21:05:17.672 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T21:05:17.772 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T21:05:17.788 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T21:05:17.830 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T21:05:18.017 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T21:05:18.032 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:18.075 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:18.125 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T21:05:18.141 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T21:05:18.183 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T21:05:18.494 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T21:05:18.509 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T21:05:18.544 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T21:05:18.545 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T21:05:18.561 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T21:05:18.603 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T21:05:18.949 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T21:05:18.964 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T21:05:19.007 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T21:05:19.083 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T21:05:19.099 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T21:05:19.133 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T21:05:19.343 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T21:05:19.359 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T21:05:19.401 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T21:05:19.487 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T21:05:19.502 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T21:05:19.638 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T21:05:19.696 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T21:05:19.712 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T21:05:19.754 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T21:05:19.958 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T21:05:19.974 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T21:05:20.033 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T21:05:20.401 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T21:05:20.416 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:20.451 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:20.779 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T21:05:20.794 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T21:05:20.800 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T21:05:20.815 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:20.837 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T21:05:20.859 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:21.175 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T21:05:21.191 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T21:05:21.225 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T21:05:21.469 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package jq. 2023-11-28T21:05:21.486 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T21:05:21.527 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T21:05:21.780 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package socat. 2023-11-28T21:05:21.796 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T21:05:21.838 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T21:05:21.862 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T21:05:21.878 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T21:05:21.920 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T21:05:22.150 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T21:05:22.166 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T21:05:22.206 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T21:05:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T21:05:22.222 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T21:05:22.264 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T21:05:22.627 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T21:05:22.643 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T21:05:22.654 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-test. 2023-11-28T21:05:22.669 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:22.676 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T21:05:22.720 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:22.963 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T21:05:22.979 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T21:05:23.012 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T21:05:23.567 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T21:05:23.584 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T21:05:23.625 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T21:05:23.978 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T21:05:23.993 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T21:05:24.036 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T21:05:24.306 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T21:05:24.321 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T21:05:24.355 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T21:05:24.549 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T21:05:24.566 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:24.608 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:24.659 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T21:05:24.676 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T21:05:24.717 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T21:05:24.987 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T21:05:25.002 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:25.045 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:25.356 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T21:05:25.372 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T21:05:25.414 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T21:05:25.447 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T21:05:25.462 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:25.506 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:25.700 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T21:05:25.716 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:25.758 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:25.775 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T21:05:25.790 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T21:05:25.825 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T21:05:25.994 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T21:05:26.010 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:26.052 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:26.195 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T21:05:26.210 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T21:05:26.253 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T21:05:26.288 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T21:05:26.304 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:26.346 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:26.522 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package jq. 2023-11-28T21:05:26.538 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T21:05:26.581 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T21:05:26.699 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T21:05:26.715 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T21:05:26.766 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T21:05:26.842 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package socat. 2023-11-28T21:05:26.858 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T21:05:26.900 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T21:05:27.111 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T21:05:27.128 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T21:05:27.170 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T21:05:27.179 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T21:05:27.195 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T21:05:27.228 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T21:05:27.590 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T21:05:27.606 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T21:05:27.607 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-test. 2023-11-28T21:05:27.622 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:27.648 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T21:05:27.665 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:28.012 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package pkg-config. 2023-11-28T21:05:28.028 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T21:05:28.061 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T21:05:28.323 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T21:05:28.339 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T21:05:28.381 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T21:05:28.809 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T21:05:28.825 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T21:05:28.867 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T21:05:29.195 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T21:05:29.212 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T21:05:29.253 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T21:05:29.548 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T21:05:29.553 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T21:05:29.563 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T21:05:29.569 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:29.597 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T21:05:29.603 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T21:05:29.925 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T21:05:29.974 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T21:05:29.975 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T21:05:29.989 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:30.023 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:30.310 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T21:05:30.311 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-py. 2023-11-28T21:05:30.326 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T21:05:30.328 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T21:05:30.368 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T21:05:30.369 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T21:05:30.629 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T21:05:30.645 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:30.687 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:30.706 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T21:05:30.722 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T21:05:30.764 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T21:05:30.940 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T21:05:30.956 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T21:05:30.998 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:31.244 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T21:05:31.259 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T21:05:31.267 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T21:05:31.284 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:31.302 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T21:05:31.325 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:31.596 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-toml. 2023-11-28T21:05:31.612 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T21:05:31.612 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T21:05:31.627 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T21:05:31.669 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T21:05:31.684 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T21:05:31.915 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T21:05:31.931 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T21:05:31.974 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T21:05:32.016 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T21:05:32.032 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T21:05:32.074 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T21:05:32.335 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T21:05:32.351 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T21:05:32.394 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T21:05:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T21:05:32.495 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T21:05:32.536 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T21:05:32.688 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T21:05:32.704 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T21:05:32.746 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T21:05:32.967 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pkg-config. 2023-11-28T21:05:32.983 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T21:05:33.017 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T21:05:33.228 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T21:05:33.244 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T21:05:33.286 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T21:05:33.458 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package radosgw. 2023-11-28T21:05:33.473 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:33.697 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T21:05:33.714 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T21:05:33.747 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T21:05:34.050 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T21:05:34.067 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T21:05:34.086 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T21:05:34.101 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:34.108 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T21:05:34.135 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:34.429 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T21:05:34.445 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T21:05:34.456 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T21:05:34.486 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T21:05:34.732 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T21:05:34.823 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T21:05:34.839 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T21:05:34.841 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T21:05:34.881 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T21:05:35.087 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T21:05:35.226 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-py. 2023-11-28T21:05:35.243 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T21:05:35.284 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T21:05:35.525 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T21:05:35.612 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T21:05:35.629 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T21:05:35.670 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T21:05:36.149 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T21:05:36.165 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T21:05:36.175 INFO:teuthology.orchestra.run.smithi006.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T21:05:36.199 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T21:05:36.217 INFO:teuthology.orchestra.run.smithi006.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T21:05:36.260 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:36.495 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-toml. 2023-11-28T21:05:36.509 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T21:05:36.544 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T21:05:36.822 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T21:05:36.837 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T21:05:36.847 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user cephadm....done 2023-11-28T21:05:36.880 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T21:05:37.049 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T21:05:37.209 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T21:05:37.225 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T21:05:37.258 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T21:05:37.367 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T21:05:37.528 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T21:05:37.543 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T21:05:37.586 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T21:05:37.643 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T21:05:37.803 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T21:05:38.096 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T21:05:38.306 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package radosgw. 2023-11-28T21:05:38.321 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:38.364 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:38.372 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T21:05:38.498 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T21:05:38.825 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T21:05:38.968 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T21:05:38.983 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T21:05:39.026 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:39.219 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T21:05:39.338 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T21:05:39.503 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T21:05:39.631 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T21:05:39.757 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T21:05:39.821 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T21:05:40.031 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T21:05:40.122 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T21:05:40.445 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T21:05:40.490 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T21:05:40.767 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T21:05:41.043 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T21:05:41.094 INFO:teuthology.orchestra.run.smithi031.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T21:05:41.108 INFO:teuthology.orchestra.run.smithi031.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T21:05:41.176 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:41.360 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:41.670 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T21:05:41.796 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T21:05:41.872 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user cephadm....done 2023-11-28T21:05:41.921 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T21:05:42.032 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T21:05:42.198 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T21:05:42.326 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T21:05:42.357 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T21:05:42.601 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T21:05:42.650 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T21:05:42.728 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T21:05:43.012 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T21:05:43.037 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T21:05:43.064 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T21:05:43.153 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T21:05:43.279 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T21:05:43.304 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T21:05:43.397 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T21:05:43.713 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T21:05:43.749 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T21:05:43.839 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T21:05:44.124 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T21:05:44.143 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T21:05:44.425 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T21:05:44.444 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T21:05:44.712 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T21:05:44.735 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T21:05:44.911 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T21:05:44.996 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T21:05:45.240 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T21:05:45.507 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T21:05:45.663 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T21:05:45.784 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T21:05:45.939 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T21:05:46.060 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:46.065 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T21:05:46.191 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T21:05:46.336 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T21:05:46.437 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T21:05:46.534 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T21:05:46.537 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T21:05:46.822 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T21:05:46.942 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T21:05:46.944 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T21:05:47.207 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T21:05:47.244 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T21:05:47.591 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T21:05:47.622 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T21:05:47.671 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T21:05:47.686 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T21:05:47.829 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T21:05:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T21:05:48.305 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T21:05:48.322 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T21:05:48.598 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T21:05:48.699 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T21:05:48.875 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T21:05:49.050 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T21:05:49.218 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T21:05:49.335 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T21:05:49.343 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T21:05:49.460 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:49.778 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T21:05:50.062 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T21:05:50.171 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T21:05:50.330 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T21:05:50.456 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T21:05:50.582 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T21:05:50.916 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T21:05:51.372 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T21:05:51.452 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T21:05:51.652 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T21:05:51.703 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:05:51.838 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T21:05:52.020 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T21:05:52.147 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T21:05:52.273 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T21:05:52.305 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T21:05:52.407 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T21:05:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T21:05:52.751 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T21:05:52.991 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T21:05:53.060 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T21:05:53.258 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T21:05:57.396 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:05:57.397 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T21:05:57.397 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T21:05:57.397 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T21:05:57.397 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:05:57.397 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T21:05:57.398 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T21:05:57.398 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T21:05:57.398 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T21:05:57.398 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T21:05:57.398 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T21:05:57.398 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:05:57.399 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:05:57.399 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T21:05:57.400 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T21:05:57.400 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T21:05:57.400 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T21:05:57.400 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T21:05:57.400 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T21:05:57.400 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T21:05:57.400 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T21:05:57.400 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T21:05:57.400 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T21:05:57.401 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T21:05:57.401 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T21:05:57.401 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T21:05:57.401 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T21:05:57.401 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T21:05:57.401 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T21:05:57.401 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T21:05:57.437 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T21:05:57.480 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T21:05:57.738 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T21:05:57.898 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T21:05:57.989 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T21:05:58.167 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T21:05:58.265 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T21:05:58.351 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T21:05:58.566 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T21:05:58.653 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:05:58.778 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T21:05:58.834 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T21:05:59.113 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T21:05:59.118 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T21:05:59.244 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T21:05:59.442 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T21:05:59.537 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T21:05:59.638 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T21:05:59.731 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T21:05:59.964 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T21:05:59.968 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T21:06:00.265 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T21:06:00.269 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T21:06:00.550 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T21:06:00.570 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T21:06:00.676 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T21:06:00.802 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T21:06:00.855 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T21:06:00.890 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T21:06:01.162 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T21:06:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T21:06:01.288 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T21:06:01.609 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T21:06:01.706 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T21:06:01.970 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T21:06:01.982 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T21:06:02.128 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:02.142 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T21:06:02.279 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:02.418 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T21:06:02.433 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T21:06:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T21:06:02.825 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:02.878 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T21:06:02.976 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:03.130 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T21:06:03.196 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T21:06:03.462 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:03.489 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T21:06:03.613 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:03.692 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T21:06:03.764 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:03.982 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T21:06:03.982 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T21:06:04.002 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T21:06:04.277 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T21:06:04.546 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T21:06:04.649 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:04.775 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:04.934 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:04.947 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T21:06:05.085 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:05.249 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T21:06:05.261 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T21:06:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T21:06:05.752 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:05.878 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:06.004 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T21:06:06.318 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:06.444 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:06.570 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T21:06:06.631 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:06.757 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:06.896 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:06.942 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:07.022 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:07.101 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:07.149 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:07.252 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:07.354 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T21:06:07.354 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T21:06:07.403 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:07.949 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:08.040 INFO:teuthology.orchestra.run.smithi006.stdout:Adding group ceph....done 2023-11-28T21:06:08.050 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:08.210 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:08.336 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:08.433 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user ceph....done 2023-11-28T21:06:08.445 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T21:06:08.644 INFO:teuthology.orchestra.run.smithi006.stdout:Setting system user ceph properties....done 2023-11-28T21:06:08.663 INFO:teuthology.orchestra.run.smithi006.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T21:06:08.814 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T21:06:09.231 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T21:06:09.790 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:09.916 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:09.963 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:10.042 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:10.177 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:10.178 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T21:06:10.178 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T21:06:10.302 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:10.412 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:10.806 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:10.915 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:11.040 INFO:teuthology.orchestra.run.smithi031.stdout:Adding group ceph....done 2023-11-28T21:06:11.416 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user ceph....done 2023-11-28T21:06:11.444 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T21:06:11.444 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T21:06:11.577 INFO:teuthology.orchestra.run.smithi031.stdout:Setting system user ceph properties....done 2023-11-28T21:06:11.595 INFO:teuthology.orchestra.run.smithi031.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T21:06:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T21:06:12.050 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T21:06:12.475 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T21:06:12.829 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:13.062 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T21:06:13.062 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T21:06:13.177 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:13.441 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T21:06:13.441 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T21:06:13.680 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:13.806 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:14.080 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:14.300 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T21:06:14.300 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T21:06:14.337 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T21:06:14.338 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T21:06:14.964 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:15.004 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:15.261 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T21:06:15.261 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T21:06:15.371 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T21:06:15.949 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:16.055 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:16.075 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:16.226 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:16.294 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T21:06:16.294 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T21:06:16.444 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T21:06:16.444 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T21:06:16.957 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:17.094 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:17.178 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T21:06:17.178 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T21:06:17.262 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:17.413 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:17.606 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:17.783 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:17.966 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T21:06:18.086 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T21:06:18.125 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T21:06:18.125 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T21:06:18.255 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T21:06:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:18.902 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:19.028 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:19.245 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T21:06:19.246 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T21:06:19.757 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T21:06:19.896 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:20.072 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:20.198 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:20.366 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T21:06:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T21:06:20.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T21:06:20.595 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2023-11-28T21:06:20.743 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T21:06:20.766 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2023-11-28T21:06:20.767 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2023-11-28T21:06:20.844 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T21:06:20.924 INFO:teuthology.orchestra.run.smithi006.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T21:06:20.924 INFO:teuthology.orchestra.run.smithi006.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T21:06:20.925 INFO:teuthology.orchestra.run.smithi006.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T21:06:20.925 INFO:teuthology.orchestra.run.smithi006.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T21:06:20.925 INFO:teuthology.orchestra.run.smithi006.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T21:06:20.925 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T21:06:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T21:06:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T21:06:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T21:06:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T21:06:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T21:06:20.926 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T21:06:20.926 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2023-11-28T21:06:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T21:06:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T21:06:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T21:06:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T21:06:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T21:06:20.927 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2023-11-28T21:06:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T21:06:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T21:06:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: libengine-pkcs11-openssl 2023-11-28T21:06:20.977 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2023-11-28T21:06:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T21:06:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T21:06:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T21:06:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T21:06:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T21:06:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T21:06:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T21:06:20.979 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2023-11-28T21:06:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: libssl3 2023-11-28T21:06:20.988 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T21:06:21.057 INFO:teuthology.orchestra.run.smithi006.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T21:06:21.057 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 54.6 MB of archives. 2023-11-28T21:06:21.057 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T21:06:21.057 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T21:06:21.166 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T21:06:21.221 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T21:06:21.229 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T21:06:21.230 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T21:06:21.231 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T21:06:21.232 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T21:06:21.233 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T21:06:21.234 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T21:06:21.235 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T21:06:21.235 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T21:06:21.240 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T21:06:21.253 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T21:06:21.471 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T21:06:21.473 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T21:06:21.474 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T21:06:21.477 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T21:06:21.477 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T21:06:21.481 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T21:06:21.483 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T21:06:21.490 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T21:06:21.490 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T21:06:21.513 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T21:06:21.513 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T21:06:21.523 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T21:06:21.544 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T21:06:21.547 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T21:06:21.547 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T21:06:21.548 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T21:06:21.549 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T21:06:21.560 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T21:06:21.562 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T21:06:21.709 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T21:06:21.709 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T21:06:21.709 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T21:06:21.709 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T21:06:21.710 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T21:06:21.710 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T21:06:21.723 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T21:06:21.724 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T21:06:22.080 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T21:06:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:Preconfiguring packages ... 2023-11-28T21:06:22.274 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 54.6 MB in 1s (74.1 MB/s) 2023-11-28T21:06:22.414 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package flex. 2023-11-28T21:06:22.488 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-11-28T21:06:22.491 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T21:06:22.529 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T21:06:22.792 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T21:06:22.797 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T21:06:22.877 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-11-28T21:06:23.054 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2023-11-28T21:06:23.055 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2023-11-28T21:06:23.091 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T21:06:23.216 INFO:teuthology.orchestra.run.smithi031.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T21:06:23.217 INFO:teuthology.orchestra.run.smithi031.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T21:06:23.217 INFO:teuthology.orchestra.run.smithi031.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T21:06:23.217 INFO:teuthology.orchestra.run.smithi031.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T21:06:23.217 INFO:teuthology.orchestra.run.smithi031.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T21:06:23.217 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T21:06:23.217 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T21:06:23.217 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T21:06:23.217 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T21:06:23.217 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T21:06:23.218 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T21:06:23.218 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T21:06:23.218 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2023-11-28T21:06:23.218 INFO:teuthology.orchestra.run.smithi031.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T21:06:23.218 INFO:teuthology.orchestra.run.smithi031.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T21:06:23.221 INFO:teuthology.orchestra.run.smithi031.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T21:06:23.221 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T21:06:23.221 INFO:teuthology.orchestra.run.smithi031.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T21:06:23.221 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2023-11-28T21:06:23.222 INFO:teuthology.orchestra.run.smithi031.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T21:06:23.222 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T21:06:23.222 INFO:teuthology.orchestra.run.smithi031.stdout: libengine-pkcs11-openssl 2023-11-28T21:06:23.268 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T21:06:23.270 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2023-11-28T21:06:23.271 INFO:teuthology.orchestra.run.smithi031.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T21:06:23.271 INFO:teuthology.orchestra.run.smithi031.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T21:06:23.271 INFO:teuthology.orchestra.run.smithi031.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T21:06:23.271 INFO:teuthology.orchestra.run.smithi031.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T21:06:23.272 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T21:06:23.272 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T21:06:23.272 INFO:teuthology.orchestra.run.smithi031.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T21:06:23.272 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2023-11-28T21:06:23.273 INFO:teuthology.orchestra.run.smithi031.stdout: libssl3 2023-11-28T21:06:23.336 INFO:teuthology.orchestra.run.smithi031.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T21:06:23.336 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 54.6 MB of archives. 2023-11-28T21:06:23.336 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T21:06:23.336 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T21:06:23.480 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T21:06:23.565 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T21:06:23.580 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T21:06:23.581 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T21:06:23.585 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T21:06:23.587 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T21:06:23.588 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T21:06:23.591 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T21:06:23.594 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T21:06:23.594 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T21:06:23.601 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T21:06:23.620 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T21:06:23.686 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T21:06:24.096 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T21:06:24.098 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T21:06:24.098 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T21:06:24.101 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T21:06:24.101 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T21:06:24.107 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T21:06:24.109 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T21:06:24.124 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T21:06:24.124 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T21:06:24.176 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T21:06:24.182 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T21:06:24.199 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T21:06:24.305 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T21:06:24.308 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T21:06:24.309 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T21:06:24.310 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T21:06:24.310 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T21:06:24.321 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package bison. 2023-11-28T21:06:24.321 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T21:06:24.323 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T21:06:24.397 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-11-28T21:06:24.401 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T21:06:24.440 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T21:06:24.629 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T21:06:24.630 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T21:06:24.630 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T21:06:24.630 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T21:06:24.630 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T21:06:24.630 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T21:06:24.652 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T21:06:24.653 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T21:06:25.050 INFO:teuthology.orchestra.run.smithi031.stdout:Preconfiguring packages ... 2023-11-28T21:06:25.066 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T21:06:25.080 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T21:06:25.132 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T21:06:25.212 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 54.6 MB in 1s (39.8 MB/s) 2023-11-28T21:06:25.352 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package flex. 2023-11-28T21:06:25.427 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-11-28T21:06:25.431 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T21:06:25.477 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T21:06:25.502 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package dump. 2023-11-28T21:06:25.517 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T21:06:25.561 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T21:06:25.831 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package indent. 2023-11-28T21:06:25.846 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:25.890 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T21:06:26.063 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T21:06:26.141 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T21:06:26.157 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T21:06:26.200 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T21:06:26.232 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T21:06:26.528 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T21:06:26.544 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T21:06:26.587 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T21:06:26.615 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T21:06:26.848 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T21:06:26.864 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T21:06:26.906 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T21:06:27.190 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package bison. 2023-11-28T21:06:27.234 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T21:06:27.250 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T21:06:27.268 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-11-28T21:06:27.272 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T21:06:27.292 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T21:06:27.318 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T21:06:27.562 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T21:06:27.578 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T21:06:27.620 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T21:06:27.727 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T21:06:27.742 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T21:06:27.785 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T21:06:27.847 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T21:06:27.863 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T21:06:27.906 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T21:06:28.088 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package dump. 2023-11-28T21:06:28.103 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T21:06:28.138 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T21:06:28.250 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T21:06:28.266 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T21:06:28.308 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T21:06:28.458 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package indent. 2023-11-28T21:06:28.473 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:28.516 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T21:06:28.785 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T21:06:28.801 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T21:06:28.844 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T21:06:29.172 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T21:06:29.188 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T21:06:29.230 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T21:06:29.474 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T21:06:29.490 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T21:06:29.591 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T21:06:29.745 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T21:06:29.762 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T21:06:29.804 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T21:06:29.936 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T21:06:29.952 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T21:06:29.994 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T21:06:30.031 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T21:06:30.048 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T21:06:30.090 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T21:06:30.246 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T21:06:30.262 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T21:06:30.304 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T21:06:30.451 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T21:06:30.467 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T21:06:30.509 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T21:06:30.557 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T21:06:30.573 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T21:06:30.615 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T21:06:30.853 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T21:06:30.869 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T21:06:30.911 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T21:06:30.960 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T21:06:30.976 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T21:06:31.018 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T21:06:31.223 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T21:06:31.238 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T21:06:31.272 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T21:06:31.609 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T21:06:31.624 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:31.667 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:32.037 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T21:06:32.053 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:32.095 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T21:06:32.362 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T21:06:32.379 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T21:06:32.381 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T21:06:32.396 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:32.412 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T21:06:32.431 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T21:06:32.641 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T21:06:32.657 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T21:06:32.690 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T21:06:32.700 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T21:06:32.706 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T21:06:32.748 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T21:06:33.084 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T21:06:33.100 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T21:06:33.142 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T21:06:33.228 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T21:06:33.243 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T21:06:33.279 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T21:06:33.495 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T21:06:33.511 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T21:06:33.553 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T21:06:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package modemmanager. 2023-11-28T21:06:33.630 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T21:06:33.673 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T21:06:33.855 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T21:06:33.872 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T21:06:33.914 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T21:06:34.250 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T21:06:34.266 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:34.287 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package network-manager. 2023-11-28T21:06:34.303 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T21:06:34.308 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:34.354 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T21:06:34.677 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T21:06:34.693 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:34.735 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T21:06:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T21:06:35.029 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:35.046 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ppp. 2023-11-28T21:06:35.062 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T21:06:35.063 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T21:06:35.290 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T21:06:35.306 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T21:06:35.348 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T21:06:35.434 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T21:06:35.783 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T21:06:35.798 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T21:06:35.833 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T21:06:35.877 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T21:06:35.893 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T21:06:35.935 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T21:06:36.086 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T21:06:36.101 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T21:06:36.144 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T21:06:36.229 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package modemmanager. 2023-11-28T21:06:36.249 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T21:06:36.279 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T21:06:36.497 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T21:06:36.512 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T21:06:36.556 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T21:06:36.843 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T21:06:36.858 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:36.893 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:36.919 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager. 2023-11-28T21:06:36.935 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T21:06:36.985 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T21:06:37.481 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T21:06:37.496 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T21:06:37.558 INFO:teuthology.orchestra.run.smithi006.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T21:06:37.566 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ppp. 2023-11-28T21:06:37.583 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T21:06:37.588 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-common (238) ... 2023-11-28T21:06:37.939 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T21:06:38.055 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T21:06:38.071 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:38.116 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:38.330 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T21:06:38.345 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T21:06:38.388 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T21:06:38.606 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T21:06:38.622 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T21:06:38.656 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T21:06:38.918 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T21:06:38.934 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T21:06:38.976 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T21:06:39.279 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T21:06:39.296 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:39.325 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql. 2023-11-28T21:06:39.340 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T21:06:39.363 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:39.375 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql (14+238) ... 2023-11-28T21:06:39.585 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T21:06:39.602 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T21:06:39.643 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T21:06:39.892 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T21:06:39.908 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T21:06:39.969 INFO:teuthology.orchestra.run.smithi031.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T21:06:40.000 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-common (238) ... 2023-11-28T21:06:40.090 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T21:06:40.105 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T21:06:40.148 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T21:06:40.442 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T21:06:40.457 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T21:06:40.474 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T21:06:40.491 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:06:40.492 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T21:06:40.552 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:40.744 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package tcl. 2023-11-28T21:06:40.760 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T21:06:40.807 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T21:06:41.189 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T21:06:41.206 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T21:06:41.247 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T21:06:41.602 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T21:06:41.618 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T21:06:41.660 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T21:06:41.727 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql. 2023-11-28T21:06:41.743 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T21:06:41.777 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql (14+238) ... 2023-11-28T21:06:42.022 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T21:06:42.038 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T21:06:42.062 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T21:06:42.078 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T21:06:42.089 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T21:06:42.121 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T21:06:42.348 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T21:06:42.364 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T21:06:42.376 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T21:06:42.406 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T21:06:42.570 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T21:06:42.704 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T21:06:42.725 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T21:06:42.742 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T21:06:42.783 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T21:06:42.855 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:42.989 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T21:06:43.086 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl. 2023-11-28T21:06:43.102 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T21:06:43.115 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T21:06:43.149 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T21:06:43.241 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:43.472 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T21:06:43.489 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T21:06:43.530 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T21:06:43.884 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T21:06:43.901 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T21:06:43.942 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T21:06:44.257 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T21:06:44.354 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T21:06:44.355 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T21:06:44.370 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T21:06:44.421 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T21:06:44.707 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T21:06:44.784 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T21:06:44.784 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T21:06:44.917 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T21:06:45.052 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T21:06:45.211 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:45.362 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T21:06:45.483 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T21:06:45.593 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T21:06:45.702 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T21:06:45.820 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T21:06:45.830 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T21:06:45.939 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:45.954 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T21:06:46.081 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T21:06:46.207 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T21:06:46.953 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T21:06:46.978 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T21:06:47.053 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T21:06:47.105 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T21:06:47.242 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T21:06:47.306 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T21:06:47.431 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T21:06:47.432 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T21:06:47.432 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T21:06:47.558 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T21:06:47.684 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T21:06:47.794 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T21:06:47.867 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T21:06:47.928 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T21:06:48.055 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T21:06:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T21:06:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T21:06:48.256 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T21:06:48.374 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T21:06:48.382 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T21:06:48.500 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T21:06:48.508 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T21:06:48.635 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T21:06:48.676 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T21:06:48.760 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T21:06:48.794 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T21:06:48.920 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T21:06:49.408 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:06:49.408 INFO:teuthology.orchestra.run.smithi006.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T21:06:49.408 INFO:teuthology.orchestra.run.smithi006.stdout:which means they are currently configured by ifupdown: 2023-11-28T21:06:49.409 INFO:teuthology.orchestra.run.smithi006.stdout:- ens1f0 2023-11-28T21:06:49.409 INFO:teuthology.orchestra.run.smithi006.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T21:06:49.409 INFO:teuthology.orchestra.run.smithi006.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T21:06:49.409 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:06:49.525 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T21:06:49.552 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T21:06:49.651 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T21:06:49.755 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T21:06:49.819 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T21:06:49.945 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T21:06:49.993 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T21:06:50.096 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T21:06:50.214 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T21:06:50.331 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T21:06:50.405 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T21:06:50.415 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T21:06:50.466 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T21:06:50.602 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T21:06:50.777 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T21:06:50.903 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T21:06:51.028 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T21:06:51.197 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T21:06:51.198 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T21:06:51.331 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T21:06:51.333 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T21:06:51.459 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T21:06:51.606 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-common (238) ... 2023-11-28T21:06:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:06:51.902 INFO:teuthology.orchestra.run.smithi031.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T21:06:51.902 INFO:teuthology.orchestra.run.smithi031.stdout:which means they are currently configured by ifupdown: 2023-11-28T21:06:51.902 INFO:teuthology.orchestra.run.smithi031.stdout:- ens1f0 2023-11-28T21:06:51.903 INFO:teuthology.orchestra.run.smithi031.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T21:06:51.903 INFO:teuthology.orchestra.run.smithi031.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T21:06:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:06:52.043 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T21:06:52.457 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T21:06:52.501 INFO:teuthology.orchestra.run.smithi006.stdout:Adding user postgres to group ssl-cert 2023-11-28T21:06:52.785 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:06:52.785 INFO:teuthology.orchestra.run.smithi006.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T21:06:52.897 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T21:06:53.065 INFO:teuthology.orchestra.run.smithi006.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T21:06:53.065 INFO:teuthology.orchestra.run.smithi006.stdout:Removing obsolete dictionary files: 2023-11-28T21:06:53.625 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T21:06:53.803 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T21:06:53.836 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T21:06:53.929 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T21:06:54.055 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-common (238) ... 2023-11-28T21:06:54.445 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:54.789 INFO:teuthology.orchestra.run.smithi006.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T21:06:54.805 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout:This user must also own the server process. 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout:The default text search configuration will be set to "english". 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout:Data page checksums are disabled. 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:06:54.854 INFO:teuthology.orchestra.run.smithi006.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T21:06:54.855 INFO:teuthology.orchestra.run.smithi006.stdout:creating subdirectories ... ok 2023-11-28T21:06:54.855 INFO:teuthology.orchestra.run.smithi006.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T21:06:54.881 INFO:teuthology.orchestra.run.smithi006.stdout:selecting default max_connections ... 100 2023-11-28T21:06:54.917 INFO:teuthology.orchestra.run.smithi006.stdout:selecting default shared_buffers ... 128MB 2023-11-28T21:06:54.932 INFO:teuthology.orchestra.run.smithi006.stdout:selecting default time zone ... Etc/UTC 2023-11-28T21:06:54.932 INFO:teuthology.orchestra.run.smithi006.stdout:creating configuration files ... ok 2023-11-28T21:06:54.963 INFO:teuthology.orchestra.run.smithi031.stdout:Adding user postgres to group ssl-cert 2023-11-28T21:06:55.110 INFO:teuthology.orchestra.run.smithi006.stdout:running bootstrap script ... ok 2023-11-28T21:06:55.229 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:06:55.230 INFO:teuthology.orchestra.run.smithi031.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T21:06:55.489 INFO:teuthology.orchestra.run.smithi031.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T21:06:55.489 INFO:teuthology.orchestra.run.smithi031.stdout:Removing obsolete dictionary files: 2023-11-28T21:06:55.749 INFO:teuthology.orchestra.run.smithi006.stdout:performing post-bootstrap initialization ... ok 2023-11-28T21:06:56.252 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T21:06:56.401 INFO:teuthology.orchestra.run.smithi006.stdout:syncing data to disk ... ok 2023-11-28T21:06:56.731 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T21:06:56.945 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T21:06:57.078 INFO:teuthology.orchestra.run.smithi031.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T21:06:57.101 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T21:06:57.163 INFO:teuthology.orchestra.run.smithi031.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T21:06:57.163 INFO:teuthology.orchestra.run.smithi031.stdout:This user must also own the server process. 2023-11-28T21:06:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:06:57.163 INFO:teuthology.orchestra.run.smithi031.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T21:06:57.163 INFO:teuthology.orchestra.run.smithi031.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T21:06:57.163 INFO:teuthology.orchestra.run.smithi031.stdout:The default text search configuration will be set to "english". 2023-11-28T21:06:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:06:57.163 INFO:teuthology.orchestra.run.smithi031.stdout:Data page checksums are disabled. 2023-11-28T21:06:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:06:57.164 INFO:teuthology.orchestra.run.smithi031.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T21:06:57.164 INFO:teuthology.orchestra.run.smithi031.stdout:creating subdirectories ... ok 2023-11-28T21:06:57.164 INFO:teuthology.orchestra.run.smithi031.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T21:06:57.190 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default max_connections ... 100 2023-11-28T21:06:57.226 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default shared_buffers ... 128MB 2023-11-28T21:06:57.240 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default time zone ... Etc/UTC 2023-11-28T21:06:57.241 INFO:teuthology.orchestra.run.smithi031.stdout:creating configuration files ... ok 2023-11-28T21:06:57.419 INFO:teuthology.orchestra.run.smithi031.stdout:running bootstrap script ... ok 2023-11-28T21:06:58.047 INFO:teuthology.orchestra.run.smithi031.stdout:performing post-bootstrap initialization ... ok 2023-11-28T21:06:58.637 INFO:teuthology.orchestra.run.smithi031.stdout:syncing data to disk ... ok 2023-11-28T21:06:59.178 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T21:07:00.144 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T21:07:00.253 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T21:07:00.379 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql (14+238) ... 2023-11-28T21:07:00.505 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T21:07:00.648 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T21:07:00.918 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T21:07:00.918 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T21:07:01.692 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T21:07:01.961 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T21:07:02.104 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T21:07:02.455 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T21:07:02.581 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T21:07:02.698 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql (14+238) ... 2023-11-28T21:07:02.799 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T21:07:02.900 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T21:07:03.161 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T21:07:03.161 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T21:07:03.233 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T21:07:03.341 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T21:07:03.894 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T21:07:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T21:07:03.899 DEBUG:teuthology.parallel:result is None 2023-11-28T21:07:04.214 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T21:07:04.364 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T21:07:05.850 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T21:07:05.950 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T21:07:06.496 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T21:07:06.500 DEBUG:teuthology.parallel:result is None 2023-11-28T21:07:06.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T21:07:06.641 DEBUG:teuthology.orchestra.run.smithi006:> dpkg-query -W -f '${Version}' ceph 2023-11-28T21:07:06.666 INFO:teuthology.orchestra.run.smithi006.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T21:07:06.667 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T21:07:06.667 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T21:07:06.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T21:07:06.807 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-query -W -f '${Version}' ceph 2023-11-28T21:07:06.830 INFO:teuthology.orchestra.run.smithi031.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T21:07:06.831 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T21:07:06.831 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T21:07:06.831 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T21:07:06.831 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:06.831 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T21:07:06.856 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:06.857 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T21:07:06.893 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T21:07:06.893 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:06.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T21:07:06.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T21:07:06.984 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:06.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T21:07:07.005 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T21:07:07.069 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T21:07:07.070 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:07.070 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T21:07:07.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T21:07:07.157 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:07.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T21:07:07.178 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T21:07:07.240 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T21:07:07.240 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:07.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T21:07:07.263 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T21:07:07.328 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:07.328 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T21:07:07.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T21:07:07.413 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T21:07:07.486 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T21:07:07.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2023-11-28T21:07:07.490 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2023-11-28T21:07:07.511 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T21:07:07.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T21:07:07.554 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T21:07:07.577 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T21:07:07.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T21:07:07.622 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T21:07:07.650 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T21:07:07.650 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T21:07:07.651 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T21:07:07.651 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:07.651 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T21:07:07.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:07.787 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:07.788 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T21:07:07.797 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:07.902 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T21:07:07.902 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T21:07:07.903 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668', 'branch': 'wip-vshankar-testing-20231127.102914', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7469668', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102914'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102914', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8377, 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'sleep_before_teardown': 0, 'subset': '462/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102914', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQTm34avSRBeQYzUfmSZMdXUmkE8HnoHSm/YGFAppwwVK/ftCmt3y/I83mWEv2sZXpPgTyZ/aCd4/+TkWEO2H4=', 'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCoGig1lZEEJ7OszLWZUNAio0lU1kv3l+OZnqy0zr4tip9V19o/tgCsK6+Me7TGpdpJZGF6KGgh5GShwz8QnD4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_06:29:14', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T21:07:07.903 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T21:07:07.907 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T21:07:07.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T21:07:07.962 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T21:07:07.985 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:07.985 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T21:07:08.031 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T21:07:08.032 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2023-11-28T21:07:08.088 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T21:07:08.088 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T21:07:08.088 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 903 Links: 1 2023-11-28T21:07:08.088 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T21:07:08.088 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-11-28 21:00:37.849530788 +0000 2023-11-28T21:07:08.088 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-11-28 21:00:37.469534181 +0000 2023-11-28T21:07:08.088 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-11-28 21:00:37.469534181 +0000 2023-11-28T21:07:08.089 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-11-28 21:00:37.469534181 +0000 2023-11-28T21:07:08.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T21:07:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-11-28T21:07:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-11-28T21:07:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.00063903 s, 801 kB/s 2023-11-28T21:07:08.153 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T21:07:08.207 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2023-11-28T21:07:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T21:07:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T21:07:08.260 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-11-28T21:07:08.260 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T21:07:08.261 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-11-28 21:00:38.513524857 +0000 2023-11-28T21:07:08.261 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-11-28 21:00:38.121528358 +0000 2023-11-28T21:07:08.261 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-11-28 21:00:38.121528358 +0000 2023-11-28T21:07:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-11-28 21:00:38.121528358 +0000 2023-11-28T21:07:08.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T21:07:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-11-28T21:07:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-11-28T21:07:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000367673 s, 1.4 MB/s 2023-11-28T21:07:08.325 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T21:07:08.378 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2023-11-28T21:07:08.428 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T21:07:08.428 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T21:07:08.428 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-11-28T21:07:08.428 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T21:07:08.428 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-11-28 21:00:39.169518998 +0000 2023-11-28T21:07:08.428 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-11-28 21:00:38.777522498 +0000 2023-11-28T21:07:08.429 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-11-28 21:00:38.777522498 +0000 2023-11-28T21:07:08.429 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-11-28 21:00:38.777522498 +0000 2023-11-28T21:07:08.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T21:07:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-11-28T21:07:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-11-28T21:07:08.491 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000364721 s, 1.4 MB/s 2023-11-28T21:07:08.493 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T21:07:08.546 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2023-11-28T21:07:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T21:07:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T21:07:08.596 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 953 Links: 1 2023-11-28T21:07:08.596 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T21:07:08.596 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-11-28 21:00:39.829513101 +0000 2023-11-28T21:07:08.596 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-11-28 21:00:39.437516603 +0000 2023-11-28T21:07:08.597 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-11-28 21:00:39.437516603 +0000 2023-11-28T21:07:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-11-28 21:00:39.437516603 +0000 2023-11-28T21:07:08.597 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T21:07:08.659 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-11-28T21:07:08.659 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-11-28T21:07:08.659 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000379338 s, 1.3 MB/s 2023-11-28T21:07:08.662 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T21:07:08.714 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:08.714 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:08.714 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T21:07:08.724 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T21:07:08.724 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2023-11-28T21:07:08.781 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T21:07:08.781 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T21:07:08.781 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 897 Links: 1 2023-11-28T21:07:08.781 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T21:07:08.781 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-28 21:00:34.621856552 +0000 2023-11-28T21:07:08.781 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-28 21:00:34.201860302 +0000 2023-11-28T21:07:08.781 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-28 21:00:34.201860302 +0000 2023-11-28T21:07:08.781 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-11-28 21:00:34.201860302 +0000 2023-11-28T21:07:08.782 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T21:07:08.844 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-28T21:07:08.844 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-28T21:07:08.844 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.00035588 s, 1.4 MB/s 2023-11-28T21:07:08.846 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T21:07:08.900 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2023-11-28T21:07:08.953 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T21:07:08.954 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T21:07:08.954 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 916 Links: 1 2023-11-28T21:07:08.954 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T21:07:08.954 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-28 21:00:35.289850584 +0000 2023-11-28T21:07:08.954 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-28 21:00:34.885854194 +0000 2023-11-28T21:07:08.955 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-28 21:00:34.885854194 +0000 2023-11-28T21:07:08.955 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-11-28 21:00:34.885854194 +0000 2023-11-28T21:07:08.955 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T21:07:09.020 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-28T21:07:09.020 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-28T21:07:09.020 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000410959 s, 1.2 MB/s 2023-11-28T21:07:09.023 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T21:07:09.075 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2023-11-28T21:07:09.130 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T21:07:09.130 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T21:07:09.130 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-11-28T21:07:09.130 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T21:07:09.130 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-28 21:00:35.969844512 +0000 2023-11-28T21:07:09.131 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-28 21:00:35.569848084 +0000 2023-11-28T21:07:09.131 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-28 21:00:35.569848084 +0000 2023-11-28T21:07:09.131 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-11-28 21:00:35.569848084 +0000 2023-11-28T21:07:09.131 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T21:07:09.192 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-28T21:07:09.192 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-28T21:07:09.193 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000397283 s, 1.3 MB/s 2023-11-28T21:07:09.194 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T21:07:09.247 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2023-11-28T21:07:09.297 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T21:07:09.298 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T21:07:09.298 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 950 Links: 1 2023-11-28T21:07:09.298 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T21:07:09.298 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-28 21:00:36.609838795 +0000 2023-11-28T21:07:09.298 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-28 21:00:36.225842224 +0000 2023-11-28T21:07:09.298 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-28 21:00:36.225842224 +0000 2023-11-28T21:07:09.298 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2023-11-28 21:00:36.225842224 +0000 2023-11-28T21:07:09.298 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T21:07:09.360 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-28T21:07:09.360 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-28T21:07:09.360 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000377315 s, 1.4 MB/s 2023-11-28T21:07:09.362 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T21:07:09.419 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:09.419 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T21:07:09.419 INFO:tasks.ceph:Generating config... 2023-11-28T21:07:09.421 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T21:07:09.421 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T21:07:09.421 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T21:07:09.421 INFO:tasks.ceph:[client] pid file = 2023-11-28T21:07:09.421 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T21:07:09.422 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T21:07:09.422 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T21:07:09.422 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T21:07:09.422 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T21:07:09.422 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T21:07:09.423 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T21:07:09.423 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T21:07:09.423 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T21:07:09.423 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T21:07:09.424 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T21:07:09.424 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T21:07:09.424 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T21:07:09.424 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T21:07:09.425 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T21:07:09.425 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T21:07:09.425 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T21:07:09.425 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T21:07:09.425 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-28T21:07:09.426 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-28T21:07:09.426 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-28T21:07:09.426 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T21:07:09.426 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T21:07:09.426 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-28T21:07:09.427 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-28T21:07:09.427 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T21:07:09.427 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T21:07:09.427 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-28T21:07:09.428 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T21:07:09.428 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T21:07:09.428 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T21:07:09.428 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T21:07:09.428 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T21:07:09.429 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T21:07:09.429 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T21:07:09.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T21:07:09.478 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T21:07:09.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T21:07:09.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T21:07:09.651 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.31'), ('mon.c', '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]')] 2023-11-28T21:07:09.652 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T21:07:09.652 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:09.653 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T21:07:09.708 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.31 --addv c '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:09.804 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:09.805 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 3f552c97-91e2-4211-95f6-2c2c108871dc 2023-11-28T21:07:09.805 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = pacific 2023-11-28T21:07:09.805 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2023-11-28T21:07:09.805 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 3f552c97-91e2-4211-95f6-2c2c108871dc 2023-11-28T21:07:09.806 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2023-11-28T21:07:09.803828+0000 2023-11-28T21:07:09.806 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-11-28T21:07:09.803828+0000 2023-11-28T21:07:09.806 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 16 (pacific) 2023-11-28T21:07:09.806 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2023-11-28T21:07:09.806 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2023-11-28T21:07:09.807 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.b 2023-11-28T21:07:09.807 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] mon.c 2023-11-28T21:07:09.807 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T21:07:09.808 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T21:07:09.817 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3f552c97-91e2-4211-95f6-2c2c108871dc... 2023-11-28T21:07:09.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T21:07:09.867 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T21:07:09.909 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-11-28T21:07:09.909 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2023-11-28T21:07:09.910 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2023-11-28T21:07:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2023-11-28T21:07:09.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.913 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2023-11-28T21:07:09.913 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.913 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2023-11-28T21:07:09.913 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2023-11-28T21:07:09.913 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2023-11-28T21:07:09.913 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2023-11-28T21:07:09.913 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 3f552c97-91e2-4211-95f6-2c2c108871dc 2023-11-28T21:07:09.913 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2023-11-28T21:07:09.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug trim objects = true 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.915 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2023-11-28T21:07:09.916 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2023-11-28T21:07:09.917 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-11-28T21:07:09.918 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2023-11-28T21:07:09.919 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2023-11-28T21:07:09.919 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-11-28T21:07:09.919 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2023-11-28T21:07:09.919 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2023-11-28T21:07:09.919 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-11-28T21:07:09.919 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.919 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.921 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-11-28T21:07:09.922 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = "" 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2023-11-28T21:07:09.923 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2023-11-28T21:07:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds balancer = 20 2023-11-28T21:07:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-11-28T21:07:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2023-11-28T21:07:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2023-11-28T21:07:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2023-11-28T21:07:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2023-11-28T21:07:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-11-28T21:07:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-11-28T21:07:09.924 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-11-28T21:07:09.925 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2023-11-28T21:07:09.925 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2023-11-28T21:07:09.925 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T21:07:09.925 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.926 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2023-11-28T21:07:09.927 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.928 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.6,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = 3f552c97-91e2-4211-95f6-2c2c108871dc 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2023-11-28T21:07:09.929 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2023-11-28T21:07:09.930 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2023-11-28T21:07:09.931 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2023-11-28T21:07:09.932 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.933 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2023-11-28T21:07:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-28T21:07:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-11-28T21:07:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2023-11-28T21:07:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-11-28T21:07:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2023-11-28T21:07:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2023-11-28T21:07:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-11-28T21:07:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2023-11-28T21:07:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2023-11-28T21:07:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-11-28T21:07:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T21:07:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T21:07:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T21:07:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2023-11-28T21:07:09.936 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-11-28T21:07:09.937 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-11-28T21:07:09.938 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-11-28T21:07:09.939 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-11-28T21:07:09.940 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T21:07:09.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T21:07:10.047 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T21:07:10.048 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:10.048 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T21:07:10.057 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:10.057 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T21:07:10.107 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2023-11-28T21:07:10.107 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:10.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T21:07:10.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T21:07:10.185 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:10.185 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:10.235 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2023-11-28T21:07:10.235 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:10.235 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T21:07:10.235 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T21:07:10.275 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:10.275 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:10.325 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T21:07:10.325 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T21:07:10.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T21:07:10.382 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T21:07:10.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T21:07:10.451 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T21:07:10.467 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T21:07:10.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T21:07:10.525 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T21:07:10.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T21:07:10.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T21:07:10.652 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T21:07:10.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T21:07:10.678 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T21:07:10.743 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T21:07:10.746 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T21:07:10.770 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T21:07:10.871 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T21:07:10.875 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T21:07:10.897 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T21:07:10.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T21:07:10.942 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T21:07:10.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-28T21:07:11.050 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-28T21:07:11.068 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T21:07:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T21:07:11.131 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-28T21:07:11.216 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-28T21:07:11.233 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T21:07:11.233 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T21:07:11.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T21:07:11.254 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:11.255 INFO:tasks.ceph:role: osd.0 2023-11-28T21:07:11.255 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2023-11-28T21:07:11.255 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T21:07:11.322 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T21:07:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T21:07:11.323 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T21:07:11.324 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T21:07:11.325 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T21:07:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-11-28T21:07:11.325 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T21:07:11.325 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T21:07:11.325 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T21:07:11.326 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T21:07:11.781 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-11-28T21:07:11.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-11-28T21:07:11.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T21:07:11.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T21:07:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T21:07:11.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:07:11.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T21:07:11.988 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:11.988 INFO:tasks.ceph:role: osd.1 2023-11-28T21:07:11.988 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2023-11-28T21:07:11.989 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T21:07:12.060 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T21:07:12.554 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-11-28T21:07:12.557 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-11-28T21:07:12.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T21:07:12.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T21:07:12.720 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T21:07:12.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:07:12.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T21:07:12.785 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:12.785 INFO:tasks.ceph:role: osd.2 2023-11-28T21:07:12.785 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2023-11-28T21:07:12.786 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T21:07:12.856 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T21:07:12.856 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T21:07:12.856 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T21:07:12.857 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T21:07:12.857 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T21:07:12.857 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-11-28T21:07:12.857 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T21:07:12.857 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T21:07:12.857 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T21:07:12.857 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T21:07:13.332 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-11-28T21:07:13.336 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-11-28T21:07:13.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T21:07:13.456 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T21:07:13.474 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T21:07:13.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:07:13.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T21:07:13.540 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:13.541 INFO:tasks.ceph:role: osd.3 2023-11-28T21:07:13.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2023-11-28T21:07:13.541 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T21:07:13.612 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T21:07:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T21:07:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T21:07:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T21:07:13.613 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T21:07:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-11-28T21:07:13.613 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T21:07:13.613 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T21:07:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T21:07:13.613 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T21:07:14.068 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-11-28T21:07:14.070 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-11-28T21:07:14.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T21:07:14.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T21:07:14.195 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T21:07:14.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:07:14.196 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:14.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:14.323+0000 7fa0c5994640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T21:07:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:14.327+0000 7fa0c5994640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T21:07:14.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:14.327+0000 7fa0c5994640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T21:07:14.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:14.327+0000 7fa0c5994640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T21:07:14.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:14.327+0000 7fa0c5994640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T21:07:14.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:14.331+0000 7fa0c5994640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T21:07:17.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T21:07:17.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:17.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:17.447+0000 7f6fefe2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T21:07:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:17.451+0000 7f6fefe2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T21:07:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:17.451+0000 7f6fefe2b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T21:07:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:17.451+0000 7f6fefe2b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T21:07:17.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:17.451+0000 7f6fefe2b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T21:07:17.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:17.451+0000 7f6fefe2b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T21:07:20.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T21:07:20.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:20.563+0000 7f70e4120640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T21:07:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:20.563+0000 7f70e4120640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T21:07:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:20.563+0000 7f70e4120640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T21:07:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:20.563+0000 7f70e4120640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T21:07:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:20.563+0000 7f70e4120640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T21:07:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:20.567+0000 7f70e4120640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T21:07:23.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T21:07:23.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:23.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:23.687+0000 7f3f5e9da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T21:07:23.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:23.687+0000 7f3f5e9da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T21:07:23.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:23.687+0000 7f3f5e9da640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T21:07:23.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:23.687+0000 7f3f5e9da640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T21:07:23.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:23.687+0000 7f3f5e9da640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T21:07:23.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:23.687+0000 7f3f5e9da640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T21:07:26.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T21:07:26.705 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T21:07:26.732 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:26.732 INFO:tasks.ceph:role: osd.4 2023-11-28T21:07:26.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-28T21:07:26.733 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T21:07:26.807 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T21:07:26.807 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T21:07:26.807 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T21:07:26.807 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T21:07:26.807 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T21:07:26.808 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-28T21:07:26.808 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T21:07:26.808 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T21:07:26.808 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T21:07:26.808 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T21:07:27.297 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-28T21:07:27.301 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-28T21:07:27.301 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T21:07:27.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T21:07:27.484 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T21:07:27.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:07:27.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T21:07:27.549 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:27.549 INFO:tasks.ceph:role: osd.5 2023-11-28T21:07:27.549 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-28T21:07:27.549 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T21:07:27.624 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T21:07:27.625 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T21:07:27.625 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T21:07:27.625 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T21:07:27.625 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T21:07:27.625 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-28T21:07:27.625 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T21:07:27.625 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T21:07:27.625 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T21:07:27.625 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T21:07:28.057 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-28T21:07:28.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-28T21:07:28.060 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T21:07:28.170 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T21:07:28.189 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T21:07:28.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:07:28.190 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T21:07:28.258 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:28.259 INFO:tasks.ceph:role: osd.6 2023-11-28T21:07:28.259 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-28T21:07:28.259 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T21:07:28.329 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T21:07:28.330 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T21:07:28.330 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T21:07:28.330 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T21:07:28.330 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T21:07:28.330 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-28T21:07:28.330 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T21:07:28.330 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T21:07:28.330 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T21:07:28.330 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T21:07:28.798 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-28T21:07:28.801 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-28T21:07:28.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T21:07:28.943 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T21:07:28.962 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T21:07:28.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:07:28.964 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T21:07:29.034 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T21:07:29.034 INFO:tasks.ceph:role: osd.7 2023-11-28T21:07:29.034 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-28T21:07:29.034 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T21:07:29.106 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T21:07:29.106 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T21:07:29.106 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T21:07:29.106 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T21:07:29.106 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T21:07:29.107 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-28T21:07:29.107 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T21:07:29.107 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T21:07:29.107 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T21:07:29.107 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T21:07:29.585 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-28T21:07:29.588 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-28T21:07:29.588 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T21:07:29.741 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T21:07:29.760 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T21:07:29.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:07:29.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:29.903 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:29.898+0000 7fc50092b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T21:07:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:29.902+0000 7fc50092b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T21:07:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:29.902+0000 7fc50092b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T21:07:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:29.902+0000 7fc50092b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T21:07:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:29.902+0000 7fc50092b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T21:07:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:29.906+0000 7fc50092b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T21:07:32.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T21:07:32.931 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:33.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:33.026+0000 7fbbc842b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T21:07:33.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:33.026+0000 7fbbc842b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T21:07:33.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:33.026+0000 7fbbc842b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T21:07:33.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:33.026+0000 7fbbc842b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T21:07:33.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:33.026+0000 7fbbc842b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T21:07:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:33.030+0000 7fbbc842b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T21:07:36.025 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T21:07:36.048 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:36.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:36.142+0000 7fb412e2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T21:07:36.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:36.146+0000 7fb412e2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T21:07:36.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:36.146+0000 7fb412e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T21:07:36.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:36.146+0000 7fb412e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T21:07:36.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:36.146+0000 7fb412e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T21:07:36.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:36.146+0000 7fb412e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T21:07:37.905 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:37.910 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:39.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T21:07:39.174 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:39.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:39.270+0000 7f9ca70e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T21:07:39.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:39.270+0000 7f9ca70e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T21:07:39.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:39.270+0000 7f9ca70e8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T21:07:39.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:39.270+0000 7f9ca70e8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T21:07:39.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:39.270+0000 7f9ca70e8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T21:07:39.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:39.270+0000 7f9ca70e8640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T21:07:42.288 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T21:07:42.312 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T21:07:42.312 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:42.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T21:07:42.337 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:42.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T21:07:42.401 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:42.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T21:07:42.465 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:42.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T21:07:42.529 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:42.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T21:07:42.593 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:42.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T21:07:42.660 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:42.661 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T21:07:42.724 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:42.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T21:07:42.748 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:42.748 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T21:07:42.813 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:42.813 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T21:07:42.878 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:42.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T21:07:42.941 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:42.941 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T21:07:43.005 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:43.005 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T21:07:43.073 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:43.073 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T21:07:43.137 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:43.137 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T21:07:43.147 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:43.147 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-28T21:07:43.200 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:43.201 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T21:07:43.210 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:43.210 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-28T21:07:43.260 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T21:07:43.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T21:07:43.264 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T21:07:43.307 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2023-11-28T21:07:43.307 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB+VmZlQwDFFhAAP2V9nSWUbZLGbTBQJysFUQ== 2023-11-28T21:07:43.307 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB+VmZlVE9MHxAA37WaKjiUn6hcCiQvJbuHmQ== 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB+VmZlQeLQJhAAjXPAqyH6lV7TCKDg//Q22Q== 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCCVmZlQs+AExAAU/55f/gJEQVjocRJcL1gew== 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCFVmZlY9gYGxAAr1N6CznypGXM7zMk2EQo0g== 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCIVmZl/YL1IRAAB/x/QnRfjUWQm42mJCWaRQ== 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCLVmZlGCIzKRAAB3GIxAXOdgqgPW4WV2DWng== 2023-11-28T21:07:43.308 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB+VmZlPObsGhAA+BppiDDh3jupibQjHG0csw== 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB+VmZlPntALBAAMvRKbEON2AIMTwj0rKHL0Q== 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB+VmZlcnr0MxAA2WZFTgv9mwH+yaasK6aj4A== 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCRVmZlPaLeNRAADLYJtMT2wxwEHw3x89EiZQ== 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCVVmZlUT7LARAAG9l3wOEPonIJ3pGvqz6MHg== 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCYVmZluk/XCBAABTTMopQEEIlciyFr26HkGw== 2023-11-28T21:07:43.309 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2023-11-28T21:07:43.310 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCbVmZlmjlHEBAAN2hh+IeKkfBZdi1DiYMMoA== 2023-11-28T21:07:43.310 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-11-28T21:07:43.310 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB+VmZlxLImOBAA8izHwHkD3t81GJWncBXtsA== 2023-11-28T21:07:43.310 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2023-11-28T21:07:43.310 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB/VmZl/Dj8AhAAvgUKWU0j1BpqP7zKR5+4ug== 2023-11-28T21:07:43.310 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2023-11-28T21:07:43.310 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB/VmZl5lXKBhAAYlZu0HRoIk+GZ+usj/2tIw== 2023-11-28T21:07:43.310 INFO:teuthology.orchestra.run.smithi006.stdout:[client.3] 2023-11-28T21:07:43.310 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB/VmZlDa7iDBAAyIMTn9IKSNvBxYjWJ2k10g== 2023-11-28T21:07:43.323 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB+VmZlQwDFFhAAP2V9nSWUbZLGbTBQJysFUQ== 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB+VmZlVE9MHxAA37WaKjiUn6hcCiQvJbuHmQ== 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB+VmZlQeLQJhAAjXPAqyH6lV7TCKDg//Q22Q== 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCCVmZlQs+AExAAU/55f/gJEQVjocRJcL1gew== 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCFVmZlY9gYGxAAr1N6CznypGXM7zMk2EQo0g== 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCIVmZl/YL1IRAAB/x/QnRfjUWQm42mJCWaRQ== 2023-11-28T21:07:43.324 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCLVmZlGCIzKRAAB3GIxAXOdgqgPW4WV2DWng== 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB+VmZlPObsGhAA+BppiDDh3jupibQjHG0csw== 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB+VmZlPntALBAAMvRKbEON2AIMTwj0rKHL0Q== 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB+VmZlcnr0MxAA2WZFTgv9mwH+yaasK6aj4A== 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCRVmZlPaLeNRAADLYJtMT2wxwEHw3x89EiZQ== 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCVVmZlUT7LARAAG9l3wOEPonIJ3pGvqz6MHg== 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2023-11-28T21:07:43.325 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCYVmZluk/XCBAABTTMopQEEIlciyFr26HkGw== 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCbVmZlmjlHEBAAN2hh+IeKkfBZdi1DiYMMoA== 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB+VmZlxLImOBAA8izHwHkD3t81GJWncBXtsA== 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout:[client.2] 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB/VmZl/Dj8AhAAvgUKWU0j1BpqP7zKR5+4ug== 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB/VmZl5lXKBhAAYlZu0HRoIk+GZ+usj/2tIw== 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout:[client.3] 2023-11-28T21:07:43.326 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB/VmZlDa7iDBAAyIMTn9IKSNvBxYjWJ2k10g== 2023-11-28T21:07:43.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T21:07:43.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T21:07:43.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T21:07:43.439 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T21:07:43.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T21:07:43.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T21:07:43.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:43.568 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:43.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:43.629 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:43.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:43.688 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:43.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:43.754 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:43.809 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T21:07:43.813 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T21:07:43.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T21:07:43.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T21:07:43.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T21:07:43.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T21:07:43.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:43.999 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:44.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:44.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:44.114 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:44.118 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:44.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:44.178 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T21:07:44.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T21:07:44.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T21:07:44.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T21:07:44.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T21:07:44.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T21:07:44.367 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T21:07:44.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T21:07:44.432 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T21:07:44.491 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T21:07:44.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T21:07:44.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T21:07:44.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T21:07:44.649 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T21:07:44.671 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T21:07:44.791 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T21:07:44.813 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T21:07:44.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T21:07:44.997 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T21:07:45.018 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:45.022 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T21:07:45.067 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T21:07:45.068 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T21:07:45.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T21:07:45.073 INFO:tasks.ceph.mon.a:Started 2023-11-28T21:07:45.074 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T21:07:45.074 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T21:07:45.114 INFO:tasks.ceph.mon.b:Started 2023-11-28T21:07:45.114 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T21:07:45.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T21:07:45.118 INFO:tasks.ceph.mon.c:Started 2023-11-28T21:07:45.118 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T21:07:45.118 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T21:07:45.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T21:07:45.122 INFO:tasks.ceph.mgr.y:Started 2023-11-28T21:07:45.122 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T21:07:45.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T21:07:45.125 INFO:tasks.ceph.mgr.x:Started 2023-11-28T21:07:45.125 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T21:07:45.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T21:07:45.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.263+0000 7f89f1f2a640 1 Processor -- start 2023-11-28T21:07:45.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.263+0000 7f89f1f2a640 1 -- start start 2023-11-28T21:07:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.263+0000 7f89f1f2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f89ec15fcf0 0x7f89ec0d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89f1f2a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89ec0b31c0 0x7f89ec1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89f1f2a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec0cea30 con 0x7f89ec0ceec0 2023-11-28T21:07:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89f1f2a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec0d3ef0 con 0x7f89ec0b31c0 2023-11-28T21:07:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89f1f2a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec0b2430 con 0x7f89ec15fcf0 2023-11-28T21:07:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89ebfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89ec0b31c0 0x7f89ec1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89ebfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89ec0b31c0 0x7f89ec1600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44616/0 (socket says 172.21.15.6:44616) 2023-11-28T21:07:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89ebfff640 1 -- 172.21.15.6:0/546391485 learned_addr learned my addr 172.21.15.6:0/546391485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:07:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89eb7fe640 1 --2- 172.21.15.6:0/546391485 >> v2:172.21.15.31:3300/0 conn(0x7f89ec15fcf0 0x7f89ec0d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89eaffd640 1 --1- 172.21.15.6:0/546391485 >> v1:172.21.15.6:6789/0 conn(0x7f89ec0ceec0 0x7f89ec0b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39984/0 (socket says 172.21.15.6:39984) 2023-11-28T21:07:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89ebfff640 1 -- 172.21.15.6:0/546391485 >> v2:172.21.15.6:3300/0 conn(0x7f89ec0b31c0 msgr2=0x7f89ec1600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T21:07:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89ebfff640 1 -- 172.21.15.6:0/546391485 >> v2:172.21.15.6:3300/0 conn(0x7f89ec0b31c0 msgr2=0x7f89ec1600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:07:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89ebfff640 1 --2- 172.21.15.6:0/546391485 >> v2:172.21.15.6:3300/0 conn(0x7f89ec0b31c0 0x7f89ec1600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:07:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89eb7fe640 1 -- 172.21.15.6:0/546391485 >> v2:172.21.15.31:3300/0 conn(0x7f89ec15fcf0 msgr2=0x7f89ec0d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T21:07:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89eb7fe640 1 -- 172.21.15.6:0/546391485 >> v2:172.21.15.31:3300/0 conn(0x7f89ec15fcf0 msgr2=0x7f89ec0d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T21:07:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89eb7fe640 1 --2- 172.21.15.6:0/546391485 >> v2:172.21.15.31:3300/0 conn(0x7f89ec15fcf0 0x7f89ec0d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T21:07:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89ebfff640 1 --2- 172.21.15.6:0/546391485 >> v2:172.21.15.6:3300/0 conn(0x7f89ec0b31c0 0x7f89ec1600d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:07:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.267+0000 7f89eb7fe640 1 --2- 172.21.15.6:0/546391485 >> v2:172.21.15.31:3300/0 conn(0x7f89ec15fcf0 0x7f89ec0d3860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T21:07:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853102499 0 0) 0x7f89ec0cea30 con 0x7f89ec0ceec0 2023-11-28T21:07:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d4003530 con 0x7f89ec0ceec0 2023-11-28T21:07:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 571980184 0 0) 0x7f89d4003530 con 0x7f89ec0ceec0 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 >> v2:172.21.15.31:3300/0 conn(0x7f89ec15fcf0 msgr2=0x7f89ec0d3860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 --2- 172.21.15.6:0/546391485 >> v2:172.21.15.31:3300/0 conn(0x7f89ec15fcf0 0x7f89ec0d3860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 >> v2:172.21.15.6:3300/0 conn(0x7f89ec0b31c0 msgr2=0x7f89ec1600d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 --2- 172.21.15.6:0/546391485 >> v2:172.21.15.6:3300/0 conn(0x7f89ec0b31c0 0x7f89ec1600d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec0d1c00 con 0x7f89ec0ceec0 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f89e0001680 con 0x7f89ec0ceec0 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 >> v1:172.21.15.6:6789/0 conn(0x7f89ec0ceec0 legacy=0x7f89ec0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89d40039d0 0x7f89d4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 0x7f89d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89d40051e0 0x7f89d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0d3ef0 con 0x7f89d40047d0 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0b2430 con 0x7f89d40039d0 2023-11-28T21:07:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d400c190 con 0x7f89d40051e0 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89eaffd640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 0x7f89d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89eb7fe640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89d40039d0 0x7f89d4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ebfff640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89d40051e0 0x7f89d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89eaffd640 1 -- 172.21.15.6:0/546391485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89d40051e0 msgr2=0x7f89d400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89eaffd640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89d40051e0 0x7f89d400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89eaffd640 1 -- 172.21.15.6:0/546391485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89d40039d0 msgr2=0x7f89d4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89eaffd640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89d40039d0 0x7f89d4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89eaffd640 1 -- 172.21.15.6:0/546391485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4003530 con 0x7f89d40047d0 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.431+0000 7f89ebfff640 1 -- 172.21.15.6:0/546391485 reap_dead start 2023-11-28T21:07:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89eaffd640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 0x7f89d4004c50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007f60 tx=0x7f89e001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6529f5e7b733b9e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e00070d0 con 0x7f89d40047d0 2023-11-28T21:07:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0007230 con 0x7f89d40047d0 2023-11-28T21:07:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89ea7fc640 1 -- 172.21.15.6:0/546391485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0007620 con 0x7f89d40047d0 2023-11-28T21:07:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89f1f2a640 1 -- 172.21.15.6:0/546391485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 msgr2=0x7f89d4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89f1f2a640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 0x7f89d4004c50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007f60 tx=0x7f89e001ca30 comp rx=0 tx=0).stop 2023-11-28T21:07:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89f1f2a640 1 -- 172.21.15.6:0/546391485 shutdown_connections 2023-11-28T21:07:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89f1f2a640 1 --2- 172.21.15.6:0/546391485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 0x7f89d4004c50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89f1f2a640 1 -- 172.21.15.6:0/546391485 >> 172.21.15.6:0/546391485 conn(0x7f89ec09c480 msgr2=0x7f89ec0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89f1f2a640 1 -- 172.21.15.6:0/546391485 shutdown_connections 2023-11-28T21:07:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.435+0000 7f89f1f2a640 1 -- 172.21.15.6:0/546391485 wait complete. 2023-11-28T21:07:45.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89f1f2a640 1 Processor -- start 2023-11-28T21:07:45.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89f1f2a640 1 -- start start 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89f1f2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 0x7f89ec0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89f1f2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ec15d6c0 0x7f89ec15db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89f1f2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ec0b8300 0x7f89ec0b8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89f1f2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec15e060 con 0x7f89d40047d0 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89f1f2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec1567c0 con 0x7f89ec0b8300 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89f1f2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec15e280 con 0x7f89ec15d6c0 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eaffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ec15d6c0 0x7f89ec15db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eaffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ec15d6c0 0x7f89ec15db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:48196/0 (socket says 172.21.15.6:48196) 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eaffd640 1 -- 172.21.15.6:0/1051350357 learned_addr learned my addr 172.21.15.6:0/1051350357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:07:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eb7fe640 1 --2- 172.21.15.6:0/1051350357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 0x7f89ec0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:45.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89ebfff640 1 --2- 172.21.15.6:0/1051350357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ec0b8300 0x7f89ec0b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eaffd640 1 -- 172.21.15.6:0/1051350357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ec0b8300 msgr2=0x7f89ec0b8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eaffd640 1 --2- 172.21.15.6:0/1051350357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ec0b8300 0x7f89ec0b8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eaffd640 1 -- 172.21.15.6:0/1051350357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 msgr2=0x7f89ec0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eaffd640 1 --2- 172.21.15.6:0/1051350357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 0x7f89ec0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eaffd640 1 -- 172.21.15.6:0/1051350357 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec0b35a0 con 0x7f89ec15d6c0 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89eaffd640 1 --2- 172.21.15.6:0/1051350357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ec15d6c0 0x7f89ec15db20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f89e0000c10 tx=0x7f89d4005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89d3fff640 1 -- 172.21.15.6:0/1051350357 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0001500 con 0x7f89ec15d6c0 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89d3fff640 1 -- 172.21.15.6:0/1051350357 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0001660 con 0x7f89ec15d6c0 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89f1f2a640 1 -- 172.21.15.6:0/1051350357 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec15e560 con 0x7f89ec15d6c0 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.439+0000 7f89d3fff640 1 -- 172.21.15.6:0/1051350357 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e00049f0 con 0x7f89ec15d6c0 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.443+0000 7f89f1f2a640 1 -- 172.21.15.6:0/1051350357 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec15eb20 con 0x7f89ec15d6c0 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.443+0000 7f89d3fff640 1 -- 172.21.15.6:0/1051350357 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f89e0004b50 con 0x7f89ec15d6c0 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.443+0000 7f89d3fff640 1 -- 172.21.15.6:0/1051350357 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f89e00b8430 con 0x7f89ec15d6c0 2023-11-28T21:07:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.443+0000 7f89f1f2a640 1 -- 172.21.15.6:0/1051350357 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec0a1160 con 0x7f89ec15d6c0 2023-11-28T21:07:45.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.455+0000 7f89d3fff640 1 -- 172.21.15.6:0/1051350357 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f89e00bd060 con 0x7f89ec15d6c0 2023-11-28T21:07:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.519+0000 7f89f1f2a640 1 -- 172.21.15.6:0/1051350357 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f89ec04e930 con 0x7f89ec15d6c0 2023-11-28T21:07:45.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.523+0000 7f89d3fff640 1 -- 172.21.15.6:0/1051350357 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f89e00c6020 con 0x7f89ec15d6c0 2023-11-28T21:07:45.530 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-11-28T21:07:45.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.527+0000 7f89f1f2a640 1 -- 172.21.15.6:0/1051350357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ec15d6c0 msgr2=0x7f89ec15db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:45.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.527+0000 7f89f1f2a640 1 --2- 172.21.15.6:0/1051350357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ec15d6c0 0x7f89ec15db20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f89e0000c10 tx=0x7f89d4005800 comp rx=0 tx=0).stop 2023-11-28T21:07:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.527+0000 7f89f1f2a640 1 -- 172.21.15.6:0/1051350357 shutdown_connections 2023-11-28T21:07:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.527+0000 7f89f1f2a640 1 --2- 172.21.15.6:0/1051350357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ec0b8300 0x7f89ec0b8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.527+0000 7f89f1f2a640 1 --2- 172.21.15.6:0/1051350357 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ec15d6c0 0x7f89ec15db20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.527+0000 7f89f1f2a640 1 --2- 172.21.15.6:0/1051350357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d40047d0 0x7f89ec0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.527+0000 7f89f1f2a640 1 -- 172.21.15.6:0/1051350357 >> 172.21.15.6:0/1051350357 conn(0x7f89ec09c480 msgr2=0x7f89ec1611d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.527+0000 7f89f1f2a640 1 -- 172.21.15.6:0/1051350357 shutdown_connections 2023-11-28T21:07:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:45.527+0000 7f89f1f2a640 1 -- 172.21.15.6:0/1051350357 wait complete. 2023-11-28T21:07:45.552 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T21:07:45.552 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T21:07:45.552 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:45.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T21:07:45.573 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:45.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T21:07:45.640 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:45.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T21:07:45.641 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:45.635+0000 7fbf22014180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T21:07:45.652 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:45.650+0000 7f5f4f049180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T21:07:45.707 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:07:45.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T21:07:45.775 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:45.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T21:07:45.797 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:45.797 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T21:07:45.860 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:45.860 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T21:07:45.924 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:07:45.924 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T21:07:45.988 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new c47bc900-8369-4b12-9aec-0a4c5621cdd7 0 2023-11-28T21:07:46.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c417aa640 1 Processor -- start 2023-11-28T21:07:46.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c417aa640 1 -- start start 2023-11-28T21:07:46.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c417aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c3c15fcf0 0x7f8c3c0d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c417aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c417aa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c0cea30 con 0x7f8c3c0cf320 2023-11-28T21:07:46.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c417aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0d3ef0 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c417aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0b2430 con 0x7f8c3c0ceec0 2023-11-28T21:07:46.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c33fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c3b7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8c3c0cf320 0x7f8c3c0b2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37232/0 (socket says 172.21.15.31:37232) 2023-11-28T21:07:46.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c3b7fe640 1 -- 172.21.15.31:0/315820104 learned_addr learned my addr 172.21.15.31:0/315820104 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-28T21:07:46.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c33fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37596/0 (socket says 172.21.15.31:37596) 2023-11-28T21:07:46.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c3affd640 1 --2- 172.21.15.31:0/315820104 >> v2:172.21.15.6:3300/0 conn(0x7f8c3c15fcf0 0x7f8c3c0d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c33fff640 1 -- 172.21.15.31:0/315820104 >> v2:172.21.15.6:3300/0 conn(0x7f8c3c15fcf0 msgr2=0x7f8c3c0d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:46.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c33fff640 1 --2- 172.21.15.31:0/315820104 >> v2:172.21.15.6:3300/0 conn(0x7f8c3c15fcf0 0x7f8c3c0d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c33fff640 1 -- 172.21.15.31:0/315820104 >> v1:172.21.15.31:6789/0 conn(0x7f8c3c0cf320 legacy=0x7f8c3c0b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c33fff640 1 -- 172.21.15.31:0/315820104 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c1610e0 con 0x7f8c3c0ceec0 2023-11-28T21:07:46.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.170+0000 7f8c3affd640 1 --2- 172.21.15.31:0/315820104 >> v2:172.21.15.6:3300/0 conn(0x7f8c3c15fcf0 0x7f8c3c0d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:07:46.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c33fff640 1 --2- 172.21.15.31:0/315820104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b2ab0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c240097c0 tx=0x7f8c2401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd7b842e3a6e2d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:46.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c3a7fc640 1 -- 172.21.15.31:0/315820104 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240ac620 con 0x7f8c3c0ceec0 2023-11-28T21:07:46.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c3a7fc640 1 -- 172.21.15.31:0/315820104 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c240ac780 con 0x7f8c3c0ceec0 2023-11-28T21:07:46.178 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c3a7fc640 1 -- 172.21.15.31:0/315820104 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240acb10 con 0x7f8c3c0ceec0 2023-11-28T21:07:46.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c417aa640 1 -- 172.21.15.31:0/315820104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c0ceec0 msgr2=0x7f8c3c0b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c417aa640 1 --2- 172.21.15.31:0/315820104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b2ab0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c240097c0 tx=0x7f8c2401c3c0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c417aa640 1 -- 172.21.15.31:0/315820104 shutdown_connections 2023-11-28T21:07:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c417aa640 1 --2- 172.21.15.31:0/315820104 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b2ab0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c417aa640 1 --2- 172.21.15.31:0/315820104 >> v2:172.21.15.6:3300/0 conn(0x7f8c3c15fcf0 0x7f8c3c0d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c417aa640 1 -- 172.21.15.31:0/315820104 >> 172.21.15.31:0/315820104 conn(0x7f8c3c09c480 msgr2=0x7f8c3c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c417aa640 1 -- 172.21.15.31:0/315820104 shutdown_connections 2023-11-28T21:07:46.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.174+0000 7f8c417aa640 1 -- 172.21.15.31:0/315820104 wait complete. 2023-11-28T21:07:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 Processor -- start 2023-11-28T21:07:46.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 -- start start 2023-11-28T21:07:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c15fcf0 0x7f8c3c155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3c09dc00 0x7f8c3c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0ccfd0 con 0x7f8c3c0ceec0 2023-11-28T21:07:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0ca7a0 con 0x7f8c3c09dc00 2023-11-28T21:07:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c155d60 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c33fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c15fcf0 0x7f8c3c155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c3b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3c09dc00 0x7f8c3c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c33fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c15fcf0 0x7f8c3c155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37608/0 (socket says 172.21.15.31:37608) 2023-11-28T21:07:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c33fff640 1 -- 172.21.15.31:0/4042714595 learned_addr learned my addr 172.21.15.31:0/4042714595 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:46.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c3affd640 1 --2- 172.21.15.31:0/4042714595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c33fff640 1 -- 172.21.15.31:0/4042714595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3c09dc00 msgr2=0x7f8c3c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c33fff640 1 --2- 172.21.15.31:0/4042714595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3c09dc00 0x7f8c3c0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c33fff640 1 -- 172.21.15.31:0/4042714595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3c0ceec0 msgr2=0x7f8c3c0b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c33fff640 1 --2- 172.21.15.31:0/4042714595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c33fff640 1 -- 172.21.15.31:0/4042714595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24009420 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c3b7fe640 1 --2- 172.21.15.31:0/4042714595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3c09dc00 0x7f8c3c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c33fff640 1 --2- 172.21.15.31:0/4042714595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c15fcf0 0x7f8c3c155820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c24019ff0 tx=0x7f8c24019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c337fe640 1 -- 172.21.15.31:0/4042714595 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240b5410 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c337fe640 1 -- 172.21.15.31:0/4042714595 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c240b5570 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 -- 172.21.15.31:0/4042714595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c0cca10 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c337fe640 1 -- 172.21.15.31:0/4042714595 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240b5920 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c417aa640 1 -- 172.21.15.31:0/4042714595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c0ca3c0 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c337fe640 1 -- 172.21.15.31:0/4042714595 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8c240b3040 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.178+0000 7f8c337fe640 1 -- 172.21.15.31:0/4042714595 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8c240bdd70 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.182+0000 7f8c417aa640 1 -- 172.21.15.31:0/4042714595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c0ca200 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.182+0000 7f8c337fe640 1 -- 172.21.15.31:0/4042714595 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8c240dcce0 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.223 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:46.218+0000 7f5f4f049180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T21:07:46.229 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:46.223+0000 7fbf22014180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T21:07:46.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.250+0000 7f8c417aa640 1 -- 172.21.15.31:0/4042714595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c47bc900-8369-4b12-9aec-0a4c5621cdd7", "id": 0} v 0) v1 -- 0x7f8c3c04e930 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.254+0000 7f8c337fe640 1 -- 172.21.15.31:0/4042714595 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c47bc900-8369-4b12-9aec-0a4c5621cdd7", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c240cb030 con 0x7f8c3c15fcf0 2023-11-28T21:07:46.260 INFO:teuthology.orchestra.run.smithi031.stdout:0 2023-11-28T21:07:46.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.258+0000 7f8c417aa640 1 -- 172.21.15.31:0/4042714595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c15fcf0 msgr2=0x7f8c3c155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.258+0000 7f8c417aa640 1 --2- 172.21.15.31:0/4042714595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c15fcf0 0x7f8c3c155820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c24019ff0 tx=0x7f8c24019160 comp rx=0 tx=0).stop 2023-11-28T21:07:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.258+0000 7f8c417aa640 1 -- 172.21.15.31:0/4042714595 shutdown_connections 2023-11-28T21:07:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.258+0000 7f8c417aa640 1 --2- 172.21.15.31:0/4042714595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c3c09dc00 0x7f8c3c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.258+0000 7f8c417aa640 1 --2- 172.21.15.31:0/4042714595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8c3c15fcf0 0x7f8c3c155820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.258+0000 7f8c417aa640 1 --2- 172.21.15.31:0/4042714595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c3c0ceec0 0x7f8c3c0b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.258+0000 7f8c417aa640 1 -- 172.21.15.31:0/4042714595 >> 172.21.15.31:0/4042714595 conn(0x7f8c3c09c480 msgr2=0x7f8c3c0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:46.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.258+0000 7f8c417aa640 1 -- 172.21.15.31:0/4042714595 shutdown_connections 2023-11-28T21:07:46.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.258+0000 7f8c417aa640 1 -- 172.21.15.31:0/4042714595 wait complete. 2023-11-28T21:07:46.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 63de0d41-a0b7-406f-bdda-6e8473682536 1 2023-11-28T21:07:46.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.418+0000 7ff733a5f640 1 Processor -- start 2023-11-28T21:07:46.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.418+0000 7ff733a5f640 1 -- start start 2023-11-28T21:07:46.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.418+0000 7ff733a5f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff72c0d3860 0x7ff72c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.418+0000 7ff733a5f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72c0cea30 con 0x7ff72c15fcf0 2023-11-28T21:07:46.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.418+0000 7ff733a5f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72c0b2430 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.418+0000 7ff733a5f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72c0d3ef0 con 0x7ff72c0d3860 2023-11-28T21:07:46.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.418+0000 7ff731ffc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff72c0b2ff0 0x7ff72c1600d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37238/0 (socket says 172.21.15.31:37238) 2023-11-28T21:07:46.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.418+0000 7ff731ffc640 1 -- 172.21.15.31:0/275154115 learned_addr learned my addr 172.21.15.31:0/275154115 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-28T21:07:46.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.418+0000 7ff730ffa640 1 --2- 172.21.15.31:0/275154115 >> v2:172.21.15.6:3300/0 conn(0x7ff72c0d3860 0x7ff72c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.422+0000 7ff723fff640 1 -- 172.21.15.31:0/275154115 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848469775 0 0) 0x7ff72c0cea30 con 0x7ff72c15fcf0 2023-11-28T21:07:46.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.422+0000 7ff730ffa640 1 -- 172.21.15.31:0/275154115 >> v1:172.21.15.31:6789/0 conn(0x7ff72c0b2ff0 legacy=0x7ff72c1600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.422+0000 7ff730ffa640 1 -- 172.21.15.31:0/275154115 >> v1:172.21.15.6:6789/0 conn(0x7ff72c15fcf0 legacy=0x7ff72c0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.422+0000 7ff730ffa640 1 -- 172.21.15.31:0/275154115 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c0d1c00 con 0x7ff72c0d3860 2023-11-28T21:07:46.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.422+0000 7ff730ffa640 1 --2- 172.21.15.31:0/275154115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c0d3860 0x7ff72c0b2ab0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009740 tx=0x7ff71c01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857eb07eeaf25630 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:46.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.422+0000 7ff723fff640 1 -- 172.21.15.31:0/275154115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0a4de0 con 0x7ff72c0d3860 2023-11-28T21:07:46.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.422+0000 7ff723fff640 1 -- 172.21.15.31:0/275154115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c0ac440 con 0x7ff72c0d3860 2023-11-28T21:07:46.427 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.422+0000 7ff723fff640 1 -- 172.21.15.31:0/275154115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0ac7d0 con 0x7ff72c0d3860 2023-11-28T21:07:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 -- 172.21.15.31:0/275154115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c0d3860 msgr2=0x7ff72c0b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 --2- 172.21.15.31:0/275154115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c0d3860 0x7ff72c0b2ab0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009740 tx=0x7ff71c01bf60 comp rx=0 tx=0).stop 2023-11-28T21:07:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 -- 172.21.15.31:0/275154115 shutdown_connections 2023-11-28T21:07:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 --2- 172.21.15.31:0/275154115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c0d3860 0x7ff72c0b2ab0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 -- 172.21.15.31:0/275154115 >> 172.21.15.31:0/275154115 conn(0x7ff72c09c480 msgr2=0x7ff72c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:46.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 -- 172.21.15.31:0/275154115 shutdown_connections 2023-11-28T21:07:46.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 -- 172.21.15.31:0/275154115 wait complete. 2023-11-28T21:07:46.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 Processor -- start 2023-11-28T21:07:46.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 -- start start 2023-11-28T21:07:46.431 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:46.426+0000 7f5f4f049180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T21:07:46.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff72c0b2ff0 0x7ff72c151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff72c0d3860 0x7ff72c158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c15fcf0 0x7ff72c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0cf5d0 con 0x7ff72c15fcf0 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0cbb30 con 0x7ff72c0d3860 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.426+0000 7ff733a5f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0cd010 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff730ffa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff72c0d3860 0x7ff72c158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff7317fb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff72c0b2ff0 0x7ff72c151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff730ffa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff72c0d3860 0x7ff72c158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35302/0 (socket says 172.21.15.31:35302) 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff7317fb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff72c0b2ff0 0x7ff72c151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37614/0 (socket says 172.21.15.31:37614) 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff730ffa640 1 -- 172.21.15.31:0/542022705 learned_addr learned my addr 172.21.15.31:0/542022705 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff731ffc640 1 --2- 172.21.15.31:0/542022705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c15fcf0 0x7ff72c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff7317fb640 1 -- 172.21.15.31:0/542022705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff72c0d3860 msgr2=0x7ff72c158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff7317fb640 1 --2- 172.21.15.31:0/542022705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff72c0d3860 0x7ff72c158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff7317fb640 1 -- 172.21.15.31:0/542022705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c15fcf0 msgr2=0x7ff72c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff7317fb640 1 --2- 172.21.15.31:0/542022705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c15fcf0 0x7ff72c15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff7317fb640 1 -- 172.21.15.31:0/542022705 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c009420 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff731ffc640 1 --2- 172.21.15.31:0/542022705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c15fcf0 0x7ff72c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:46.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff7317fb640 1 --2- 172.21.15.31:0/542022705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff72c0b2ff0 0x7ff72c151f30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff72800c3e0 tx=0x7ff72800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:46.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff721ffb640 1 -- 172.21.15.31:0/542022705 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280054e0 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff721ffb640 1 -- 172.21.15.31:0/542022705 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff728003600 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff721ffb640 1 -- 172.21.15.31:0/542022705 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280039f0 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff733a5f640 1 -- 172.21.15.31:0/542022705 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c158970 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff721ffb640 1 -- 172.21.15.31:0/542022705 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff728012400 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff733a5f640 1 -- 172.21.15.31:0/542022705 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c0cc6e0 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.430+0000 7ff721ffb640 1 -- 172.21.15.31:0/542022705 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff728012c90 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.434+0000 7ff733a5f640 1 -- 172.21.15.31:0/542022705 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c152470 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.434+0000 7ff721ffb640 1 -- 172.21.15.31:0/542022705 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff728017070 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.441 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:46.435+0000 7fbf22014180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T21:07:46.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.502+0000 7ff733a5f640 1 -- 172.21.15.31:0/542022705 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "63de0d41-a0b7-406f-bdda-6e8473682536", "id": 1} v 0) v1 -- 0x7ff72c0a1160 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff721ffb640 1 -- 172.21.15.31:0/542022705 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "63de0d41-a0b7-406f-bdda-6e8473682536", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff72801c440 con 0x7ff72c0b2ff0 2023-11-28T21:07:46.516 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-11-28T21:07:46.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff733a5f640 1 -- 172.21.15.31:0/542022705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff72c0b2ff0 msgr2=0x7ff72c151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff733a5f640 1 --2- 172.21.15.31:0/542022705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff72c0b2ff0 0x7ff72c151f30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff72800c3e0 tx=0x7ff72800c8a0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff733a5f640 1 -- 172.21.15.31:0/542022705 shutdown_connections 2023-11-28T21:07:46.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff733a5f640 1 --2- 172.21.15.31:0/542022705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff72c15fcf0 0x7ff72c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff733a5f640 1 --2- 172.21.15.31:0/542022705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff72c0d3860 0x7ff72c158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff733a5f640 1 --2- 172.21.15.31:0/542022705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff72c0b2ff0 0x7ff72c151f30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff733a5f640 1 -- 172.21.15.31:0/542022705 >> 172.21.15.31:0/542022705 conn(0x7ff72c09c480 msgr2=0x7ff72c0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:46.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff733a5f640 1 -- 172.21.15.31:0/542022705 shutdown_connections 2023-11-28T21:07:46.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.514+0000 7ff733a5f640 1 -- 172.21.15.31:0/542022705 wait complete. 2023-11-28T21:07:46.536 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 977a5b8e-90a6-4561-adf3-df6847a959ee 2 2023-11-28T21:07:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80b0c32640 1 Processor -- start 2023-11-28T21:07:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80b0c32640 1 -- start start 2023-11-28T21:07:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80b0c32640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f80ac0b31c0 0x7f80ac168360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80b0c32640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac0cea30 con 0x7f80ac15fcf0 2023-11-28T21:07:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80b0c32640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac0b2430 con 0x7f80ac0d3860 2023-11-28T21:07:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80b0c32640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ac0d3ef0 con 0x7f80ac0b31c0 2023-11-28T21:07:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80a3fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f80ac0d3860 0x7f80ac0b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37250/0 (socket says 172.21.15.31:37250) 2023-11-28T21:07:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80a3fff640 1 -- 172.21.15.31:0/3434675633 learned_addr learned my addr 172.21.15.31:0/3434675633 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-28T21:07:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80aad9d640 1 --2- 172.21.15.31:0/3434675633 >> v2:172.21.15.31:3300/0 conn(0x7f80ac0b31c0 0x7f80ac168360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80aad9d640 1 -- 172.21.15.31:0/3434675633 >> v1:172.21.15.31:6789/0 conn(0x7f80ac0d3860 legacy=0x7f80ac0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80aad9d640 1 -- 172.21.15.31:0/3434675633 >> v1:172.21.15.6:6789/0 conn(0x7f80ac15fcf0 legacy=0x7f80ac0ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.674+0000 7f80aad9d640 1 -- 172.21.15.31:0/3434675633 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac1610e0 con 0x7f80ac0b31c0 2023-11-28T21:07:46.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80aad9d640 1 --2- 172.21.15.31:0/3434675633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac0b31c0 0x7f80ac168360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009d90 tx=0x7f80a401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4597256cf5d8e67d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:46.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80a9d9b640 1 -- 172.21.15.31:0/3434675633 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40a5870 con 0x7f80ac0b31c0 2023-11-28T21:07:46.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80a9d9b640 1 -- 172.21.15.31:0/3434675633 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a40a59d0 con 0x7f80ac0b31c0 2023-11-28T21:07:46.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80a9d9b640 1 -- 172.21.15.31:0/3434675633 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40a5d60 con 0x7f80ac0b31c0 2023-11-28T21:07:46.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80b0c32640 1 -- 172.21.15.31:0/3434675633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac0b31c0 msgr2=0x7f80ac168360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80b0c32640 1 --2- 172.21.15.31:0/3434675633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac0b31c0 0x7f80ac168360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009d90 tx=0x7f80a401c8c0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80b0c32640 1 -- 172.21.15.31:0/3434675633 shutdown_connections 2023-11-28T21:07:46.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80b0c32640 1 --2- 172.21.15.31:0/3434675633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac0b31c0 0x7f80ac168360 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80b0c32640 1 -- 172.21.15.31:0/3434675633 >> 172.21.15.31:0/3434675633 conn(0x7f80ac09c480 msgr2=0x7f80ac0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:46.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80b0c32640 1 -- 172.21.15.31:0/3434675633 shutdown_connections 2023-11-28T21:07:46.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.678+0000 7f80b0c32640 1 -- 172.21.15.31:0/3434675633 wait complete. 2023-11-28T21:07:46.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80b0c32640 1 Processor -- start 2023-11-28T21:07:46.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80b0c32640 1 -- start start 2023-11-28T21:07:46.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80b0c32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ac0b31c0 0x7f80ac155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80b0c32640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac0d3860 0x7f80ac0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80b0c32640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac15fcf0 0x7f80ac0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80b0c32640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0cf5d0 con 0x7f80ac0b31c0 2023-11-28T21:07:46.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80b0c32640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0cc4f0 con 0x7f80ac15fcf0 2023-11-28T21:07:46.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80b0c32640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0cb870 con 0x7f80ac0d3860 2023-11-28T21:07:46.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80a3fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac0d3860 0x7f80ac0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80aad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac15fcf0 0x7f80ac0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80a3fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac0d3860 0x7f80ac0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37622/0 (socket says 172.21.15.31:37622) 2023-11-28T21:07:46.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80a3fff640 1 -- 172.21.15.31:0/4287958247 learned_addr learned my addr 172.21.15.31:0/4287958247 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:46.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80aa59c640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ac0b31c0 0x7f80ac155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80a3fff640 1 -- 172.21.15.31:0/4287958247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac15fcf0 msgr2=0x7f80ac0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80a3fff640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac15fcf0 0x7f80ac0b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80a3fff640 1 -- 172.21.15.31:0/4287958247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ac0b31c0 msgr2=0x7f80ac155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80a3fff640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ac0b31c0 0x7f80ac155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80a3fff640 1 -- 172.21.15.31:0/4287958247 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a4009a70 con 0x7f80ac0d3860 2023-11-28T21:07:46.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80aad9d640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac15fcf0 0x7f80ac0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:46.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80aa59c640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ac0b31c0 0x7f80ac155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:46.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.682+0000 7f80a3fff640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac0d3860 0x7f80ac0cc910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f809400c530 tx=0x7f809400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:46.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.686+0000 7f80a2ffd640 1 -- 172.21.15.31:0/4287958247 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094005cf0 con 0x7f80ac0d3860 2023-11-28T21:07:46.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.686+0000 7f80a2ffd640 1 -- 172.21.15.31:0/4287958247 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8094005e50 con 0x7f80ac0d3860 2023-11-28T21:07:46.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.686+0000 7f80a2ffd640 1 -- 172.21.15.31:0/4287958247 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094007270 con 0x7f80ac0d3860 2023-11-28T21:07:46.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.686+0000 7f80b0c32640 1 -- 172.21.15.31:0/4287958247 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac0cbb50 con 0x7f80ac0d3860 2023-11-28T21:07:46.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.686+0000 7f80b0c32640 1 -- 172.21.15.31:0/4287958247 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac0cc110 con 0x7f80ac0d3860 2023-11-28T21:07:46.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.686+0000 7f80a2ffd640 1 -- 172.21.15.31:0/4287958247 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f809401c440 con 0x7f80ac0d3860 2023-11-28T21:07:46.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.686+0000 7f80a2ffd640 1 -- 172.21.15.31:0/4287958247 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f809401cb10 con 0x7f80ac0d3860 2023-11-28T21:07:46.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.686+0000 7f80b0c32640 1 -- 172.21.15.31:0/4287958247 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac0cc630 con 0x7f80ac0d3860 2023-11-28T21:07:46.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.690+0000 7f80a2ffd640 1 -- 172.21.15.31:0/4287958247 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f80ac0cc630 con 0x7f80ac0d3860 2023-11-28T21:07:46.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.758+0000 7f80b0c32640 1 -- 172.21.15.31:0/4287958247 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "977a5b8e-90a6-4561-adf3-df6847a959ee", "id": 2} v 0) v1 -- 0x7f80ac0a1160 con 0x7f80ac0d3860 2023-11-28T21:07:46.767 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.762+0000 7f80a2ffd640 1 -- 172.21.15.31:0/4287958247 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "977a5b8e-90a6-4561-adf3-df6847a959ee", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8094021060 con 0x7f80ac0d3860 2023-11-28T21:07:46.768 INFO:teuthology.orchestra.run.smithi031.stdout:2 2023-11-28T21:07:46.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.766+0000 7f80b0c32640 1 -- 172.21.15.31:0/4287958247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac0d3860 msgr2=0x7f80ac0cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.766+0000 7f80b0c32640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac0d3860 0x7f80ac0cc910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f809400c530 tx=0x7f809400c9f0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.766+0000 7f80b0c32640 1 -- 172.21.15.31:0/4287958247 shutdown_connections 2023-11-28T21:07:46.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.766+0000 7f80b0c32640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80ac15fcf0 0x7f80ac0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.769 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.766+0000 7f80b0c32640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f80ac0d3860 0x7f80ac0cc910 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.766+0000 7f80b0c32640 1 --2- 172.21.15.31:0/4287958247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80ac0b31c0 0x7f80ac155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.766+0000 7f80b0c32640 1 -- 172.21.15.31:0/4287958247 >> 172.21.15.31:0/4287958247 conn(0x7f80ac09c480 msgr2=0x7f80ac06b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:46.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.766+0000 7f80b0c32640 1 -- 172.21.15.31:0/4287958247 shutdown_connections 2023-11-28T21:07:46.770 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.766+0000 7f80b0c32640 1 -- 172.21.15.31:0/4287958247 wait complete. 2023-11-28T21:07:46.795 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new b62e3c5a-1faf-4a5a-b403-29c316a80810 3 2023-11-28T21:07:46.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.930+0000 7fe9491b8640 1 Processor -- start 2023-11-28T21:07:46.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.930+0000 7fe9491b8640 1 -- start start 2023-11-28T21:07:46.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe9491b8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe9491b8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe9440ceec0 0x7fe9440b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe9491b8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9440cf320 0x7fe9440b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe9491b8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9440d3ef0 con 0x7fe9440ceec0 2023-11-28T21:07:46.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe9491b8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9440cea30 con 0x7fe9440cf320 2023-11-28T21:07:46.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe9491b8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b2430 con 0x7fe94415fcf0 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe942d9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe942d9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440d3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37636/0 (socket says 172.21.15.31:37636) 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe942d9d640 1 -- 172.21.15.31:0/2644043306 learned_addr learned my addr 172.21.15.31:0/2644043306 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe94359e640 1 --2- 172.21.15.31:0/2644043306 >> v2:172.21.15.31:3300/0 conn(0x7fe9440cf320 0x7fe9440b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe93bfff640 1 --2- 172.21.15.31:0/2644043306 >> v2:172.21.15.6:3300/0 conn(0x7fe9440ceec0 0x7fe9440b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe94359e640 1 -- 172.21.15.31:0/2644043306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 msgr2=0x7fe9440d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe94359e640 1 --2- 172.21.15.31:0/2644043306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe94359e640 1 -- 172.21.15.31:0/2644043306 >> v2:172.21.15.6:3300/0 conn(0x7fe9440ceec0 msgr2=0x7fe9440b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe94359e640 1 --2- 172.21.15.31:0/2644043306 >> v2:172.21.15.6:3300/0 conn(0x7fe9440ceec0 0x7fe9440b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe94359e640 1 -- 172.21.15.31:0/2644043306 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440b3530 con 0x7fe9440cf320 2023-11-28T21:07:46.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.934+0000 7fe942d9d640 1 --2- 172.21.15.31:0/2644043306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:46.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe94359e640 1 --2- 172.21.15.31:0/2644043306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440cf320 0x7fe9440b2ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9440b20a0 tx=0x7fe93c01c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8ca6a2ffedd1335 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:46.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe94259c640 1 -- 172.21.15.31:0/2644043306 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0a58d0 con 0x7fe9440cf320 2023-11-28T21:07:46.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe94259c640 1 -- 172.21.15.31:0/2644043306 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c0a5a30 con 0x7fe9440cf320 2023-11-28T21:07:46.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe94259c640 1 -- 172.21.15.31:0/2644043306 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0a5dc0 con 0x7fe9440cf320 2023-11-28T21:07:46.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 -- 172.21.15.31:0/2644043306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440cf320 msgr2=0x7fe9440b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 --2- 172.21.15.31:0/2644043306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440cf320 0x7fe9440b2ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9440b20a0 tx=0x7fe93c01c850 comp rx=0 tx=0).stop 2023-11-28T21:07:46.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 -- 172.21.15.31:0/2644043306 shutdown_connections 2023-11-28T21:07:46.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 --2- 172.21.15.31:0/2644043306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440cf320 0x7fe9440b2ff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 --2- 172.21.15.31:0/2644043306 >> v2:172.21.15.6:3300/0 conn(0x7fe9440ceec0 0x7fe9440b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 --2- 172.21.15.31:0/2644043306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 -- 172.21.15.31:0/2644043306 >> 172.21.15.31:0/2644043306 conn(0x7fe94409c480 msgr2=0x7fe9440d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:46.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 -- 172.21.15.31:0/2644043306 shutdown_connections 2023-11-28T21:07:46.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 -- 172.21.15.31:0/2644043306 wait complete. 2023-11-28T21:07:46.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 Processor -- start 2023-11-28T21:07:46.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.938+0000 7fe9491b8640 1 -- start start 2023-11-28T21:07:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe9491b8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440ceec0 0x7fe9440c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe9491b8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe9491b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9440cc470 0x7fe9440b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe9491b8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b86a0 con 0x7fe9440cc470 2023-11-28T21:07:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe9491b8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440cc920 con 0x7fe9440ceec0 2023-11-28T21:07:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe9491b8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440c9400 con 0x7fe94415fcf0 2023-11-28T21:07:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe942d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440ceec0 0x7fe9440c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93bfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe942d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440ceec0 0x7fe9440c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35320/0 (socket says 172.21.15.31:35320) 2023-11-28T21:07:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe942d9d640 1 -- 172.21.15.31:0/81745429 learned_addr learned my addr 172.21.15.31:0/81745429 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe94359e640 1 --2- 172.21.15.31:0/81745429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9440cc470 0x7fe9440b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93bfff640 1 -- 172.21.15.31:0/81745429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440ceec0 msgr2=0x7fe9440c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93bfff640 1 --2- 172.21.15.31:0/81745429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440ceec0 0x7fe9440c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93bfff640 1 -- 172.21.15.31:0/81745429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9440cc470 msgr2=0x7fe9440b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:46.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93bfff640 1 --2- 172.21.15.31:0/81745429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9440cc470 0x7fe9440b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93bfff640 1 -- 172.21.15.31:0/81745429 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9340094d0 con 0x7fe94415fcf0 2023-11-28T21:07:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93bfff640 1 --2- 172.21.15.31:0/81745429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440cbf30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00e7f0 tx=0x7fe92c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93b7fe640 1 -- 172.21.15.31:0/81745429 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c00c940 con 0x7fe94415fcf0 2023-11-28T21:07:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93b7fe640 1 -- 172.21.15.31:0/81745429 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c00caa0 con 0x7fe94415fcf0 2023-11-28T21:07:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93b7fe640 1 -- 172.21.15.31:0/81745429 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c00ce10 con 0x7fe94415fcf0 2023-11-28T21:07:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe9491b8640 1 -- 172.21.15.31:0/81745429 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c009a70 con 0x7fe94415fcf0 2023-11-28T21:07:46.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe9491b8640 1 -- 172.21.15.31:0/81745429 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9440b7a20 con 0x7fe94415fcf0 2023-11-28T21:07:46.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93b7fe640 1 -- 172.21.15.31:0/81745429 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe92c005ca0 con 0x7fe94415fcf0 2023-11-28T21:07:46.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe93b7fe640 1 -- 172.21.15.31:0/81745429 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe92c0068e0 con 0x7fe94415fcf0 2023-11-28T21:07:46.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.942+0000 7fe9491b8640 1 -- 172.21.15.31:0/81745429 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9440b87e0 con 0x7fe94415fcf0 2023-11-28T21:07:46.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:46.946+0000 7fe93b7fe640 1 -- 172.21.15.31:0/81745429 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe9440b87e0 con 0x7fe94415fcf0 2023-11-28T21:07:47.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.014+0000 7fe9491b8640 1 -- 172.21.15.31:0/81745429 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b62e3c5a-1faf-4a5a-b403-29c316a80810", "id": 3} v 0) v1 -- 0x7fe94404e930 con 0x7fe94415fcf0 2023-11-28T21:07:47.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe93b7fe640 1 -- 172.21.15.31:0/81745429 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b62e3c5a-1faf-4a5a-b403-29c316a80810", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe92c021060 con 0x7fe94415fcf0 2023-11-28T21:07:47.027 INFO:teuthology.orchestra.run.smithi031.stdout:3 2023-11-28T21:07:47.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe9491b8640 1 -- 172.21.15.31:0/81745429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 msgr2=0x7fe9440cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe9491b8640 1 --2- 172.21.15.31:0/81745429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440cbf30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00e7f0 tx=0x7fe92c00ecb0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe9491b8640 1 -- 172.21.15.31:0/81745429 shutdown_connections 2023-11-28T21:07:47.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe9491b8640 1 --2- 172.21.15.31:0/81745429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9440cc470 0x7fe9440b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe9491b8640 1 --2- 172.21.15.31:0/81745429 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe94415fcf0 0x7fe9440cbf30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe9491b8640 1 --2- 172.21.15.31:0/81745429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440ceec0 0x7fe9440c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe9491b8640 1 -- 172.21.15.31:0/81745429 >> 172.21.15.31:0/81745429 conn(0x7fe94409c480 msgr2=0x7fe94406c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:47.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe9491b8640 1 -- 172.21.15.31:0/81745429 shutdown_connections 2023-11-28T21:07:47.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.022+0000 7fe9491b8640 1 -- 172.21.15.31:0/81745429 wait complete. 2023-11-28T21:07:47.045 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new d92bcc50-f2bf-4e3e-87ee-6756d9d57257 4 2023-11-28T21:07:47.121 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:47.115+0000 7fbf22014180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T21:07:47.130 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:47.126+0000 7f5f4f049180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T21:07:47.185 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:47.179+0000 7fbf22014180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T21:07:47.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.182+0000 7fbcb379d640 1 Processor -- start 2023-11-28T21:07:47.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.182+0000 7fbcb379d640 1 -- start start 2023-11-28T21:07:47.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb379d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d340 0x7fbcac0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb379d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbcac0d1e30 0x7fbcac0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb379d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac0cf0d0 con 0x7fbcac15d720 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb379d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0b6a60 con 0x7fbcac0d1e30 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb379d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0b60c0 con 0x7fbcac15d340 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb1539640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d340 0x7fbcac0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb1539640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d340 0x7fbcac0ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37648/0 (socket says 172.21.15.31:37648) 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb1539640 1 -- 172.21.15.31:0/7936093 learned_addr learned my addr 172.21.15.31:0/7936093 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb1d3a640 1 --2- 172.21.15.31:0/7936093 >> v2:172.21.15.6:3300/0 conn(0x7fbcac0d1e30 0x7fbcac0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb1539640 1 -- 172.21.15.31:0/7936093 >> v2:172.21.15.6:3300/0 conn(0x7fbcac0d1e30 msgr2=0x7fbcac0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb1539640 1 --2- 172.21.15.31:0/7936093 >> v2:172.21.15.6:3300/0 conn(0x7fbcac0d1e30 0x7fbcac0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb1539640 1 -- 172.21.15.31:0/7936093 >> v1:172.21.15.6:6789/0 conn(0x7fbcac15d720 legacy=0x7fbcac0d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.186+0000 7fbcb1539640 1 -- 172.21.15.31:0/7936093 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0b63a0 con 0x7fbcac15d340 2023-11-28T21:07:47.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbcb1539640 1 --2- 172.21.15.31:0/7936093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d340 0x7fbcac0ce760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009870 tx=0x7fbca801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f38c2cd121e013 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:47.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbca3fff640 1 -- 172.21.15.31:0/7936093 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca80a6040 con 0x7fbcac15d340 2023-11-28T21:07:47.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbca3fff640 1 -- 172.21.15.31:0/7936093 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca80aa600 con 0x7fbcac15d340 2023-11-28T21:07:47.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbca3fff640 1 -- 172.21.15.31:0/7936093 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca80aa990 con 0x7fbcac15d340 2023-11-28T21:07:47.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbcb379d640 1 -- 172.21.15.31:0/7936093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d340 msgr2=0x7fbcac0ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbcb379d640 1 --2- 172.21.15.31:0/7936093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d340 0x7fbcac0ce760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009870 tx=0x7fbca801c480 comp rx=0 tx=0).stop 2023-11-28T21:07:47.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbcb379d640 1 -- 172.21.15.31:0/7936093 shutdown_connections 2023-11-28T21:07:47.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbcb379d640 1 --2- 172.21.15.31:0/7936093 >> v2:172.21.15.6:3300/0 conn(0x7fbcac0d1e30 0x7fbcac0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbcb379d640 1 --2- 172.21.15.31:0/7936093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d340 0x7fbcac0ce760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbcb379d640 1 -- 172.21.15.31:0/7936093 >> 172.21.15.31:0/7936093 conn(0x7fbcac09c480 msgr2=0x7fbcac0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:47.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbcb379d640 1 -- 172.21.15.31:0/7936093 shutdown_connections 2023-11-28T21:07:47.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.190+0000 7fbcb379d640 1 -- 172.21.15.31:0/7936093 wait complete. 2023-11-28T21:07:47.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb379d640 1 Processor -- start 2023-11-28T21:07:47.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb379d640 1 -- start start 2023-11-28T21:07:47.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb379d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcac0d1e30 0x7fbcac0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb379d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcac15d340 0x7fbcac06b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb379d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d720 0x7fbcac0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb379d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0c7bc0 con 0x7fbcac0d1e30 2023-11-28T21:07:47.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb379d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0c7f20 con 0x7fbcac15d340 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb379d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0c84e0 con 0x7fbcac15d720 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb1d3a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d720 0x7fbcac0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb0d38640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcac15d340 0x7fbcac06b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb0d38640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcac15d340 0x7fbcac06b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35334/0 (socket says 172.21.15.31:35334) 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb0d38640 1 -- 172.21.15.31:0/1137651456 learned_addr learned my addr 172.21.15.31:0/1137651456 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb1539640 1 --2- 172.21.15.31:0/1137651456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcac0d1e30 0x7fbcac0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb0d38640 1 -- 172.21.15.31:0/1137651456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d720 msgr2=0x7fbcac0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb0d38640 1 --2- 172.21.15.31:0/1137651456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d720 0x7fbcac0c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb0d38640 1 -- 172.21.15.31:0/1137651456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcac0d1e30 msgr2=0x7fbcac0c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb0d38640 1 --2- 172.21.15.31:0/1137651456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcac0d1e30 0x7fbcac0c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.200 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb0d38640 1 -- 172.21.15.31:0/1137651456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca80094d0 con 0x7fbcac15d340 2023-11-28T21:07:47.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.194+0000 7fbcb0d38640 1 --2- 172.21.15.31:0/1137651456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcac15d340 0x7fbcac06b920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00c3a0 tx=0x7fbc9c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:47.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.198+0000 7fbca1ffb640 1 -- 172.21.15.31:0/1137651456 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0052d0 con 0x7fbcac15d340 2023-11-28T21:07:47.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.198+0000 7fbca1ffb640 1 -- 172.21.15.31:0/1137651456 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c005430 con 0x7fbcac15d340 2023-11-28T21:07:47.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.198+0000 7fbca1ffb640 1 -- 172.21.15.31:0/1137651456 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c003820 con 0x7fbcac15d340 2023-11-28T21:07:47.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.198+0000 7fbcb379d640 1 -- 172.21.15.31:0/1137651456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac15fef0 con 0x7fbcac15d340 2023-11-28T21:07:47.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.198+0000 7fbca1ffb640 1 -- 172.21.15.31:0/1137651456 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbc9c003c80 con 0x7fbcac15d340 2023-11-28T21:07:47.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.198+0000 7fbcb379d640 1 -- 172.21.15.31:0/1137651456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac0c8170 con 0x7fbcac15d340 2023-11-28T21:07:47.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.198+0000 7fbca1ffb640 1 -- 172.21.15.31:0/1137651456 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fbc9c011aa0 con 0x7fbcac15d340 2023-11-28T21:07:47.202 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:47.198+0000 7f5f4f049180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T21:07:47.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.198+0000 7fbcb379d640 1 -- 172.21.15.31:0/1137651456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac0d16a0 con 0x7fbcac15d340 2023-11-28T21:07:47.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.202+0000 7fbca1ffb640 1 -- 172.21.15.31:0/1137651456 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fbc9c017070 con 0x7fbcac15d340 2023-11-28T21:07:47.249 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:47.243+0000 7fbf22014180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T21:07:47.266 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:47.262+0000 7f5f4f049180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T21:07:47.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.270+0000 7fbcb379d640 1 -- 172.21.15.31:0/1137651456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d92bcc50-f2bf-4e3e-87ee-6756d9d57257", "id": 4} v 0) v1 -- 0x7fbcac0a10f0 con 0x7fbcac15d340 2023-11-28T21:07:47.278 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbca1ffb640 1 -- 172.21.15.31:0/1137651456 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d92bcc50-f2bf-4e3e-87ee-6756d9d57257", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbc9c011590 con 0x7fbcac15d340 2023-11-28T21:07:47.279 INFO:teuthology.orchestra.run.smithi031.stdout:4 2023-11-28T21:07:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbcb379d640 1 -- 172.21.15.31:0/1137651456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcac15d340 msgr2=0x7fbcac06b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbcb379d640 1 --2- 172.21.15.31:0/1137651456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcac15d340 0x7fbcac06b920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00c3a0 tx=0x7fbc9c00c860 comp rx=0 tx=0).stop 2023-11-28T21:07:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbcb379d640 1 -- 172.21.15.31:0/1137651456 shutdown_connections 2023-11-28T21:07:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbcb379d640 1 --2- 172.21.15.31:0/1137651456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbcac15d720 0x7fbcac0c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbcb379d640 1 --2- 172.21.15.31:0/1137651456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcac15d340 0x7fbcac06b920 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbcb379d640 1 --2- 172.21.15.31:0/1137651456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcac0d1e30 0x7fbcac0c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbcb379d640 1 -- 172.21.15.31:0/1137651456 >> 172.21.15.31:0/1137651456 conn(0x7fbcac09c480 msgr2=0x7fbcac06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbcb379d640 1 -- 172.21.15.31:0/1137651456 shutdown_connections 2023-11-28T21:07:47.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.274+0000 7fbcb379d640 1 -- 172.21.15.31:0/1137651456 wait complete. 2023-11-28T21:07:47.298 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600 5 2023-11-28T21:07:47.343 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:47.335+0000 7fbf22014180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T21:07:47.364 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:47.358+0000 7f5f4f049180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T21:07:47.406 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:47.399+0000 7fbf22014180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T21:07:47.429 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:47.426+0000 7f5f4f049180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T21:07:47.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.438+0000 7fed3f0c8640 1 Processor -- start 2023-11-28T21:07:47.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.438+0000 7fed3f0c8640 1 -- start start 2023-11-28T21:07:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3f0c8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3f60 0x7fed380b6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3f0c8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed380d3a00 con 0x7fed380d1c00 2023-11-28T21:07:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3f0c8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed380ceed0 con 0x7fed380b3250 2023-11-28T21:07:47.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3f0c8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed380d3d50 con 0x7fed380b3f60 2023-11-28T21:07:47.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3e0c6640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fed380b3250 0x7fed380d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37260/0 (socket says 172.21.15.31:37260) 2023-11-28T21:07:47.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3e0c6640 1 -- 172.21.15.31:0/3402974947 learned_addr learned my addr 172.21.15.31:0/3402974947 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-28T21:07:47.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3e8c7640 1 --2- 172.21.15.31:0/3402974947 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3f60 0x7fed380b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3d0c4640 1 -- 172.21.15.31:0/3402974947 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700522743 0 0) 0x7fed380ceed0 con 0x7fed380b3250 2023-11-28T21:07:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3d0c4640 1 -- 172.21.15.31:0/3402974947 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed24003530 con 0x7fed380b3250 2023-11-28T21:07:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3d0c4640 1 -- 172.21.15.31:0/3402974947 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618758623 0 0) 0x7fed380d3a00 con 0x7fed380d1c00 2023-11-28T21:07:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3e8c7640 1 -- 172.21.15.31:0/3402974947 >> v1:172.21.15.31:6789/0 conn(0x7fed380b3250 legacy=0x7fed380d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3e8c7640 1 -- 172.21.15.31:0/3402974947 >> v1:172.21.15.6:6789/0 conn(0x7fed380d1c00 legacy=0x7fed380b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.442+0000 7fed3e8c7640 1 -- 172.21.15.31:0/3402974947 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed380b3bb0 con 0x7fed380b3f60 2023-11-28T21:07:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3e8c7640 1 --2- 172.21.15.31:0/3402974947 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3f60 0x7fed380b6550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fed30009dc0 tx=0x7fed380b72a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c4ba4a863223e12 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:47.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3d0c4640 1 -- 172.21.15.31:0/3402974947 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed300a5820 con 0x7fed380b3f60 2023-11-28T21:07:47.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3d0c4640 1 -- 172.21.15.31:0/3402974947 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed300a5980 con 0x7fed380b3f60 2023-11-28T21:07:47.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3d0c4640 1 -- 172.21.15.31:0/3402974947 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed300a5d10 con 0x7fed380b3f60 2023-11-28T21:07:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3402974947 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3f60 msgr2=0x7fed380b6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3f0c8640 1 --2- 172.21.15.31:0/3402974947 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3f60 0x7fed380b6550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fed30009dc0 tx=0x7fed380b72a0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3402974947 shutdown_connections 2023-11-28T21:07:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3f0c8640 1 --2- 172.21.15.31:0/3402974947 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3f60 0x7fed380b6550 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3402974947 >> 172.21.15.31:0/3402974947 conn(0x7fed380d2f10 msgr2=0x7fed380d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3402974947 shutdown_connections 2023-11-28T21:07:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.446+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3402974947 wait complete. 2023-11-28T21:07:47.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 Processor -- start 2023-11-28T21:07:47.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 -- start start 2023-11-28T21:07:47.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3250 0x7fed38152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed380b3f60 0x7fed3814e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed380d1c00 0x7fed38155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed38152ed0 con 0x7fed380d1c00 2023-11-28T21:07:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed381557a0 con 0x7fed380b3f60 2023-11-28T21:07:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3814f080 con 0x7fed380b3250 2023-11-28T21:07:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e0c6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3250 0x7fed38152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3d8c5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed380b3f60 0x7fed3814e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e0c6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3250 0x7fed38152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37662/0 (socket says 172.21.15.31:37662) 2023-11-28T21:07:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e0c6640 1 -- 172.21.15.31:0/3572246760 learned_addr learned my addr 172.21.15.31:0/3572246760 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e8c7640 1 --2- 172.21.15.31:0/3572246760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed380d1c00 0x7fed38155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e0c6640 1 -- 172.21.15.31:0/3572246760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed380b3f60 msgr2=0x7fed3814e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e0c6640 1 --2- 172.21.15.31:0/3572246760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed380b3f60 0x7fed3814e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e0c6640 1 -- 172.21.15.31:0/3572246760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed380d1c00 msgr2=0x7fed38155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e0c6640 1 --2- 172.21.15.31:0/3572246760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed380d1c00 0x7fed38155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e0c6640 1 -- 172.21.15.31:0/3572246760 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed30009a70 con 0x7fed380b3250 2023-11-28T21:07:47.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3d8c5640 1 --2- 172.21.15.31:0/3572246760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed380b3f60 0x7fed3814e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:47.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3e0c6640 1 --2- 172.21.15.31:0/3572246760 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3250 0x7fed38152990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed3400c450 tx=0x7fed3400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:47.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed2effd640 1 -- 172.21.15.31:0/3572246760 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34005cf0 con 0x7fed380b3250 2023-11-28T21:07:47.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed2effd640 1 -- 172.21.15.31:0/3572246760 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed34005e50 con 0x7fed380b3250 2023-11-28T21:07:47.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed2effd640 1 -- 172.21.15.31:0/3572246760 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34007270 con 0x7fed380b3250 2023-11-28T21:07:47.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3572246760 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed38154720 con 0x7fed380b3250 2023-11-28T21:07:47.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3572246760 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed381587a0 con 0x7fed380b3250 2023-11-28T21:07:47.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed2effd640 1 -- 172.21.15.31:0/3572246760 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fed3401c440 con 0x7fed380b3250 2023-11-28T21:07:47.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.450+0000 7fed2effd640 1 -- 172.21.15.31:0/3572246760 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fed3401cc70 con 0x7fed380b3250 2023-11-28T21:07:47.458 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.454+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3572246760 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed38155570 con 0x7fed380b3250 2023-11-28T21:07:47.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.454+0000 7fed2effd640 1 -- 172.21.15.31:0/3572246760 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fed34021060 con 0x7fed380b3250 2023-11-28T21:07:47.499 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:47.495+0000 7fbf22014180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T21:07:47.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.522+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3572246760 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600", "id": 5} v 0) v1 -- 0x7fed3804e850 con 0x7fed380b3250 2023-11-28T21:07:47.528 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:47.526+0000 7f5f4f049180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T21:07:47.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed2effd640 1 -- 172.21.15.31:0/3572246760 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fed34017070 con 0x7fed380b3250 2023-11-28T21:07:47.533 INFO:teuthology.orchestra.run.smithi031.stdout:5 2023-11-28T21:07:47.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3572246760 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3250 msgr2=0x7fed38152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed3f0c8640 1 --2- 172.21.15.31:0/3572246760 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3250 0x7fed38152990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed3400c450 tx=0x7fed3400c910 comp rx=0 tx=0).stop 2023-11-28T21:07:47.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3572246760 shutdown_connections 2023-11-28T21:07:47.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed3f0c8640 1 --2- 172.21.15.31:0/3572246760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed380d1c00 0x7fed38155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed3f0c8640 1 --2- 172.21.15.31:0/3572246760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed380b3f60 0x7fed3814e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed3f0c8640 1 --2- 172.21.15.31:0/3572246760 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed380b3250 0x7fed38152990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3572246760 >> 172.21.15.31:0/3572246760 conn(0x7fed380d2f10 msgr2=0x7fed3815be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:47.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3572246760 shutdown_connections 2023-11-28T21:07:47.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.530+0000 7fed3f0c8640 1 -- 172.21.15.31:0/3572246760 wait complete. 2023-11-28T21:07:47.553 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new aa4289bd-ee2d-4345-abe9-b93fa3959a8a 6 2023-11-28T21:07:47.563 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:47.559+0000 7fbf22014180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T21:07:47.596 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:47.594+0000 7f5f4f049180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T21:07:47.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f78857c3640 1 Processor -- start 2023-11-28T21:07:47.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f78857c3640 1 -- start start 2023-11-28T21:07:47.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f78857c3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f788015fcf0 0x7f78800d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f78857c3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800ceec0 0x7f78800b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f78857c3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78800cea30 con 0x7f78800cf320 2023-11-28T21:07:47.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f78857c3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78800d3ef0 con 0x7f788015fcf0 2023-11-28T21:07:47.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f78857c3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78800b2430 con 0x7f78800ceec0 2023-11-28T21:07:47.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f787e7fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800ceec0 0x7f78800b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f787e7fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800ceec0 0x7f78800b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37674/0 (socket says 172.21.15.31:37674) 2023-11-28T21:07:47.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f787e7fc640 1 -- 172.21.15.31:0/378124173 learned_addr learned my addr 172.21.15.31:0/378124173 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:47.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f787effd640 1 --2- 172.21.15.31:0/378124173 >> v2:172.21.15.31:3300/0 conn(0x7f788015fcf0 0x7f78800d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f787e7fc640 1 -- 172.21.15.31:0/378124173 >> v2:172.21.15.31:3300/0 conn(0x7f788015fcf0 msgr2=0x7f78800d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:47.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f787e7fc640 1 --2- 172.21.15.31:0/378124173 >> v2:172.21.15.31:3300/0 conn(0x7f788015fcf0 0x7f78800d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f787e7fc640 1 -- 172.21.15.31:0/378124173 >> v1:172.21.15.31:6789/0 conn(0x7f78800cf320 legacy=0x7f78800b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f787e7fc640 1 -- 172.21.15.31:0/378124173 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78801610e0 con 0x7f78800ceec0 2023-11-28T21:07:47.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.694+0000 7f787effd640 1 --2- 172.21.15.31:0/378124173 >> v2:172.21.15.31:3300/0 conn(0x7f788015fcf0 0x7f78800d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:47.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f787e7fc640 1 --2- 172.21.15.31:0/378124173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800ceec0 0x7f78800b2ab0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7874009870 tx=0x7f787401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe92cca2b540b6d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:47.704 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f787dffb640 1 -- 172.21.15.31:0/378124173 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740ab680 con 0x7f78800ceec0 2023-11-28T21:07:47.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f787dffb640 1 -- 172.21.15.31:0/378124173 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78740ab7e0 con 0x7f78800ceec0 2023-11-28T21:07:47.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f787dffb640 1 -- 172.21.15.31:0/378124173 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740abb70 con 0x7f78800ceec0 2023-11-28T21:07:47.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 -- 172.21.15.31:0/378124173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800ceec0 msgr2=0x7f78800b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.705 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 --2- 172.21.15.31:0/378124173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800ceec0 0x7f78800b2ab0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7874009870 tx=0x7f787401c480 comp rx=0 tx=0).stop 2023-11-28T21:07:47.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 -- 172.21.15.31:0/378124173 shutdown_connections 2023-11-28T21:07:47.706 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 --2- 172.21.15.31:0/378124173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800ceec0 0x7f78800b2ab0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 --2- 172.21.15.31:0/378124173 >> v2:172.21.15.31:3300/0 conn(0x7f788015fcf0 0x7f78800d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 -- 172.21.15.31:0/378124173 >> 172.21.15.31:0/378124173 conn(0x7f788009c480 msgr2=0x7f78800d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:47.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 -- 172.21.15.31:0/378124173 shutdown_connections 2023-11-28T21:07:47.707 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 -- 172.21.15.31:0/378124173 wait complete. 2023-11-28T21:07:47.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 Processor -- start 2023-11-28T21:07:47.709 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.702+0000 7f78857c3640 1 -- start start 2023-11-28T21:07:47.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78857c3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800ceec0 0x7f78801551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78857c3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788015fcf0 0x7f788009cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.710 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78857c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788009d510 0x7f78800b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78857c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78800b8bc0 con 0x7f788009d510 2023-11-28T21:07:47.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78857c3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78800cb700 con 0x7f78800ceec0 2023-11-28T21:07:47.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78857c3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78801556f0 con 0x7f788015fcf0 2023-11-28T21:07:47.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800ceec0 0x7f78801551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.711 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787e7fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788015fcf0 0x7f788009cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800ceec0 0x7f78801551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35356/0 (socket says 172.21.15.31:35356) 2023-11-28T21:07:47.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787effd640 1 -- 172.21.15.31:0/76801653 learned_addr learned my addr 172.21.15.31:0/76801653 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:47.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787f7fe640 1 --2- 172.21.15.31:0/76801653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788009d510 0x7f78800b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787e7fc640 1 -- 172.21.15.31:0/76801653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800ceec0 msgr2=0x7f78801551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787e7fc640 1 --2- 172.21.15.31:0/76801653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800ceec0 0x7f78801551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787e7fc640 1 -- 172.21.15.31:0/76801653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788009d510 msgr2=0x7f78800b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.712 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787e7fc640 1 --2- 172.21.15.31:0/76801653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788009d510 0x7f78800b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787e7fc640 1 -- 172.21.15.31:0/76801653 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870009420 con 0x7f788015fcf0 2023-11-28T21:07:47.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787effd640 1 --2- 172.21.15.31:0/76801653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800ceec0 0x7f78801551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:47.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f787e7fc640 1 --2- 172.21.15.31:0/76801653 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788015fcf0 0x7f788009cfd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78740ac000 tx=0x7f787401acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:47.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78677fe640 1 -- 172.21.15.31:0/76801653 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740b4800 con 0x7f788015fcf0 2023-11-28T21:07:47.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78677fe640 1 -- 172.21.15.31:0/76801653 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78740b4980 con 0x7f788015fcf0 2023-11-28T21:07:47.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78677fe640 1 -- 172.21.15.31:0/76801653 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740b4d30 con 0x7f788015fcf0 2023-11-28T21:07:47.713 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78857c3640 1 -- 172.21.15.31:0/76801653 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78740094d0 con 0x7f788015fcf0 2023-11-28T21:07:47.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78857c3640 1 -- 172.21.15.31:0/76801653 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78800cb0b0 con 0x7f788015fcf0 2023-11-28T21:07:47.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78677fe640 1 -- 172.21.15.31:0/76801653 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f78740be6f0 con 0x7f788015fcf0 2023-11-28T21:07:47.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78677fe640 1 -- 172.21.15.31:0/76801653 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f78740c89e0 con 0x7f788015fcf0 2023-11-28T21:07:47.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.706+0000 7f78857c3640 1 -- 172.21.15.31:0/76801653 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78800cb840 con 0x7f788015fcf0 2023-11-28T21:07:47.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.710+0000 7f78677fe640 1 -- 172.21.15.31:0/76801653 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f78740c4060 con 0x7f788015fcf0 2023-11-28T21:07:47.727 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:47.723+0000 7fbf22014180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T21:07:47.767 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:47.762+0000 7f5f4f049180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T21:07:47.782 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.778+0000 7f78857c3640 1 -- 172.21.15.31:0/76801653 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aa4289bd-ee2d-4345-abe9-b93fa3959a8a", "id": 6} v 0) v1 -- 0x7f788004e930 con 0x7f788015fcf0 2023-11-28T21:07:47.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.782+0000 7f78677fe640 1 -- 172.21.15.31:0/76801653 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aa4289bd-ee2d-4345-abe9-b93fa3959a8a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f78740c8d10 con 0x7f788015fcf0 2023-11-28T21:07:47.787 INFO:teuthology.orchestra.run.smithi031.stdout:6 2023-11-28T21:07:47.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.786+0000 7f78857c3640 1 -- 172.21.15.31:0/76801653 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788015fcf0 msgr2=0x7f788009cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.786+0000 7f78857c3640 1 --2- 172.21.15.31:0/76801653 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788015fcf0 0x7f788009cfd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f78740ac000 tx=0x7f787401acc0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.786+0000 7f78857c3640 1 -- 172.21.15.31:0/76801653 shutdown_connections 2023-11-28T21:07:47.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.786+0000 7f78857c3640 1 --2- 172.21.15.31:0/76801653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788009d510 0x7f78800b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.786+0000 7f78857c3640 1 --2- 172.21.15.31:0/76801653 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f788015fcf0 0x7f788009cfd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.786+0000 7f78857c3640 1 --2- 172.21.15.31:0/76801653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800ceec0 0x7f78801551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.786+0000 7f78857c3640 1 -- 172.21.15.31:0/76801653 >> 172.21.15.31:0/76801653 conn(0x7f788009c480 msgr2=0x7f78801560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:47.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.786+0000 7f78857c3640 1 -- 172.21.15.31:0/76801653 shutdown_connections 2023-11-28T21:07:47.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.786+0000 7f78857c3640 1 -- 172.21.15.31:0/76801653 wait complete. 2023-11-28T21:07:47.800 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:47.795+0000 7fbf22014180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T21:07:47.807 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 23093f16-67ee-42da-937f-762edf716078 7 2023-11-28T21:07:47.842 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:47.838+0000 7f5f4f049180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T21:07:47.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.978+0000 7f829125a640 1 Processor -- start 2023-11-28T21:07:47.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.978+0000 7f829125a640 1 -- start start 2023-11-28T21:07:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f829125a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f829125a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f828c0ceec0 0x7f828c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f829125a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c0cea30 con 0x7f828c0cf320 2023-11-28T21:07:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f829125a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c0d3ef0 con 0x7f828c0ceec0 2023-11-28T21:07:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f829125a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0b2430 con 0x7f828c15fcf0 2023-11-28T21:07:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f828ad9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f828ad9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0d3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37692/0 (socket says 172.21.15.31:37692) 2023-11-28T21:07:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f828ad9d640 1 -- 172.21.15.31:0/2188338390 learned_addr learned my addr 172.21.15.31:0/2188338390 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f8283fff640 1 --2- 172.21.15.31:0/2188338390 >> v2:172.21.15.6:3300/0 conn(0x7f828c0ceec0 0x7f828c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f828ad9d640 1 -- 172.21.15.31:0/2188338390 >> v2:172.21.15.6:3300/0 conn(0x7f828c0ceec0 msgr2=0x7f828c0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f828ad9d640 1 --2- 172.21.15.31:0/2188338390 >> v2:172.21.15.6:3300/0 conn(0x7f828c0ceec0 0x7f828c0b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f828ad9d640 1 -- 172.21.15.31:0/2188338390 >> v1:172.21.15.6:6789/0 conn(0x7f828c0cf320 legacy=0x7f828c0b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.982+0000 7f828ad9d640 1 -- 172.21.15.31:0/2188338390 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c1610e0 con 0x7f828c15fcf0 2023-11-28T21:07:47.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f828ad9d640 1 --2- 172.21.15.31:0/2188338390 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0d3860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f827c009870 tx=0x7f827c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad632c35e03db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:47.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f828a59c640 1 -- 172.21.15.31:0/2188338390 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0ab680 con 0x7f828c15fcf0 2023-11-28T21:07:47.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f828a59c640 1 -- 172.21.15.31:0/2188338390 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c0ab7e0 con 0x7f828c15fcf0 2023-11-28T21:07:47.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f828a59c640 1 -- 172.21.15.31:0/2188338390 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0abb70 con 0x7f828c15fcf0 2023-11-28T21:07:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 -- 172.21.15.31:0/2188338390 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 msgr2=0x7f828c0d3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 --2- 172.21.15.31:0/2188338390 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0d3860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f827c009870 tx=0x7f827c01c480 comp rx=0 tx=0).stop 2023-11-28T21:07:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 -- 172.21.15.31:0/2188338390 shutdown_connections 2023-11-28T21:07:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 --2- 172.21.15.31:0/2188338390 >> v2:172.21.15.6:3300/0 conn(0x7f828c0ceec0 0x7f828c0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 --2- 172.21.15.31:0/2188338390 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0d3860 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 -- 172.21.15.31:0/2188338390 >> 172.21.15.31:0/2188338390 conn(0x7f828c09c480 msgr2=0x7f828c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 -- 172.21.15.31:0/2188338390 shutdown_connections 2023-11-28T21:07:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 -- 172.21.15.31:0/2188338390 wait complete. 2023-11-28T21:07:47.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 Processor -- start 2023-11-28T21:07:47.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.986+0000 7f829125a640 1 -- start start 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f829125a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828c0ceec0 0x7f828c0c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f829125a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f829125a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f828c152120 0x7f828c14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f829125a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1534e0 con 0x7f828c0ceec0 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f829125a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1537c0 con 0x7f828c152120 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f829125a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c153aa0 con 0x7f828c15fcf0 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f8283fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f828b59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f828c152120 0x7f828c14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f828ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828c0ceec0 0x7f828c0c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:47.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f8283fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:37706/0 (socket says 172.21.15.31:37706) 2023-11-28T21:07:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f8283fff640 1 -- 172.21.15.31:0/4109490092 learned_addr learned my addr 172.21.15.31:0/4109490092 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-28T21:07:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f828ad9d640 1 -- 172.21.15.31:0/4109490092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 msgr2=0x7f828c0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f828ad9d640 1 --2- 172.21.15.31:0/4109490092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f828ad9d640 1 -- 172.21.15.31:0/4109490092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f828c152120 msgr2=0x7f828c14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f828ad9d640 1 --2- 172.21.15.31:0/4109490092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f828c152120 0x7f828c14ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f828ad9d640 1 -- 172.21.15.31:0/4109490092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0094d0 con 0x7f828c0ceec0 2023-11-28T21:07:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f828b59e640 1 --2- 172.21.15.31:0/4109490092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f828c152120 0x7f828c14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f8283fff640 1 --2- 172.21.15.31:0/4109490092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:07:47.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f828ad9d640 1 --2- 172.21.15.31:0/4109490092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828c0ceec0 0x7f828c0c9690 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f827c0ac000 tx=0x7f827c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:47.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f82837fe640 1 -- 172.21.15.31:0/4109490092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0b5810 con 0x7f828c0ceec0 2023-11-28T21:07:47.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f82837fe640 1 -- 172.21.15.31:0/4109490092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c0b5990 con 0x7f828c0ceec0 2023-11-28T21:07:47.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f82837fe640 1 -- 172.21.15.31:0/4109490092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0b5d40 con 0x7f828c0ceec0 2023-11-28T21:07:47.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f829125a640 1 -- 172.21.15.31:0/4109490092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c153d80 con 0x7f828c0ceec0 2023-11-28T21:07:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f829125a640 1 -- 172.21.15.31:0/4109490092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c0c9bd0 con 0x7f828c0ceec0 2023-11-28T21:07:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f82837fe640 1 -- 172.21.15.31:0/4109490092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f827c0bf710 con 0x7f828c0ceec0 2023-11-28T21:07:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f82837fe640 1 -- 172.21.15.31:0/4109490092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f827c0b49f0 con 0x7f828c0ceec0 2023-11-28T21:07:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:47.990+0000 7f829125a640 1 -- 172.21.15.31:0/4109490092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c067960 con 0x7f828c0ceec0 2023-11-28T21:07:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.006+0000 7f82837fe640 1 -- 172.21.15.31:0/4109490092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f827c0b4bb0 con 0x7f828c0ceec0 2023-11-28T21:07:48.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.074+0000 7f829125a640 1 -- 172.21.15.31:0/4109490092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "23093f16-67ee-42da-937f-762edf716078", "id": 7} v 0) v1 -- 0x7f828c04e930 con 0x7f828c0ceec0 2023-11-28T21:07:48.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f82837fe640 1 -- 172.21.15.31:0/4109490092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23093f16-67ee-42da-937f-762edf716078", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f827c0b4e20 con 0x7f828c0ceec0 2023-11-28T21:07:48.082 INFO:teuthology.orchestra.run.smithi031.stdout:7 2023-11-28T21:07:48.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f829125a640 1 -- 172.21.15.31:0/4109490092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828c0ceec0 msgr2=0x7f828c0c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:48.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f829125a640 1 --2- 172.21.15.31:0/4109490092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828c0ceec0 0x7f828c0c9690 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f827c0ac000 tx=0x7f827c019220 comp rx=0 tx=0).stop 2023-11-28T21:07:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f829125a640 1 -- 172.21.15.31:0/4109490092 shutdown_connections 2023-11-28T21:07:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f829125a640 1 --2- 172.21.15.31:0/4109490092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f828c152120 0x7f828c14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f829125a640 1 --2- 172.21.15.31:0/4109490092 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f828c15fcf0 0x7f828c0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f829125a640 1 --2- 172.21.15.31:0/4109490092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f828c0ceec0 0x7f828c0c9690 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f829125a640 1 -- 172.21.15.31:0/4109490092 >> 172.21.15.31:0/4109490092 conn(0x7f828c09c480 msgr2=0x7f828c0b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f829125a640 1 -- 172.21.15.31:0/4109490092 shutdown_connections 2023-11-28T21:07:48.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:07:48.078+0000 7f829125a640 1 -- 172.21.15.31:0/4109490092 wait complete. 2023-11-28T21:07:48.102 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T21:07:48.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T21:07:48.115 INFO:tasks.ceph.osd.0:Started 2023-11-28T21:07:48.115 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T21:07:48.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T21:07:48.121 INFO:tasks.ceph.osd.1:Started 2023-11-28T21:07:48.121 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T21:07:48.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T21:07:48.134 INFO:tasks.ceph.osd.2:Started 2023-11-28T21:07:48.135 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T21:07:48.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T21:07:48.146 INFO:tasks.ceph.osd.3:Started 2023-11-28T21:07:48.146 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T21:07:48.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T21:07:48.151 INFO:tasks.ceph.osd.4:Started 2023-11-28T21:07:48.151 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T21:07:48.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T21:07:48.156 INFO:tasks.ceph.osd.5:Started 2023-11-28T21:07:48.156 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T21:07:48.156 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T21:07:48.161 INFO:tasks.ceph.osd.6:Started 2023-11-28T21:07:48.161 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T21:07:48.161 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T21:07:48.167 INFO:tasks.ceph.osd.7:Started 2023-11-28T21:07:48.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:07:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9b1ae3640 1 Processor -- start 2023-11-28T21:07:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9b1ae3640 1 -- start start 2023-11-28T21:07:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9b1ae3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9ac160ac0 0x7fd9ac0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9b1ae3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd9ac0cfb10 0x7fd9ac0cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9b1ae3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ac0d4050 con 0x7fd9ac0ce810 2023-11-28T21:07:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9b1ae3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac0d0500 con 0x7fd9ac160ac0 2023-11-28T21:07:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9b1ae3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac0b43b0 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9ab7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9ac160ac0 0x7fd9ac0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9ab7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9ac160ac0 0x7fd9ac0d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44680/0 (socket says 172.21.15.6:44680) 2023-11-28T21:07:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9ab7fe640 1 -- 172.21.15.6:0/3192786430 learned_addr learned my addr 172.21.15.6:0/3192786430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:07:48.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9abfff640 1 --2- 172.21.15.6:0/3192786430 >> v2:172.21.15.31:3300/0 conn(0x7fd9ac0cfb10 0x7fd9ac0cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:48.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9ab7fe640 1 -- 172.21.15.6:0/3192786430 >> v2:172.21.15.31:3300/0 conn(0x7fd9ac0cfb10 msgr2=0x7fd9ac0cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9ab7fe640 1 --2- 172.21.15.6:0/3192786430 >> v2:172.21.15.31:3300/0 conn(0x7fd9ac0cfb10 0x7fd9ac0cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9ab7fe640 1 -- 172.21.15.6:0/3192786430 >> v1:172.21.15.6:6789/0 conn(0x7fd9ac0ce810 legacy=0x7fd9ac0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9aa7fc640 1 -- 172.21.15.6:0/3192786430 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819123785 0 0) 0x7fd9a0001120 con 0x7fd9ac0ce810 2023-11-28T21:07:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9ab7fe640 1 -- 172.21.15.6:0/3192786430 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac0cecf0 con 0x7fd9ac160ac0 2023-11-28T21:07:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.331+0000 7fd9abfff640 1 --2- 172.21.15.6:0/3192786430 >> v2:172.21.15.31:3300/0 conn(0x7fd9ac0cfb10 0x7fd9ac0cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:07:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9ab7fe640 1 --2- 172.21.15.6:0/3192786430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac160ac0 0x7fd9ac0d3b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0d3010 tx=0x7fd99c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8a5ea7ee72b6dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9aa7fc640 1 -- 172.21.15.6:0/3192786430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0ab5f0 con 0x7fd9ac160ac0 2023-11-28T21:07:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9aa7fc640 1 -- 172.21.15.6:0/3192786430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c0ab750 con 0x7fd9ac160ac0 2023-11-28T21:07:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9aa7fc640 1 -- 172.21.15.6:0/3192786430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0abae0 con 0x7fd9ac160ac0 2023-11-28T21:07:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/3192786430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac160ac0 msgr2=0x7fd9ac0d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9b1ae3640 1 --2- 172.21.15.6:0/3192786430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac160ac0 0x7fd9ac0d3b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0d3010 tx=0x7fd99c01c500 comp rx=0 tx=0).stop 2023-11-28T21:07:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/3192786430 shutdown_connections 2023-11-28T21:07:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9b1ae3640 1 --2- 172.21.15.6:0/3192786430 >> v2:172.21.15.31:3300/0 conn(0x7fd9ac0cfb10 0x7fd9ac0cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9b1ae3640 1 --2- 172.21.15.6:0/3192786430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac160ac0 0x7fd9ac0d3b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/3192786430 >> 172.21.15.6:0/3192786430 conn(0x7fd9ac09c480 msgr2=0x7fd9ac0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/3192786430 shutdown_connections 2023-11-28T21:07:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.335+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/3192786430 wait complete. 2023-11-28T21:07:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 Processor -- start 2023-11-28T21:07:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 -- start start 2023-11-28T21:07:48.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac0ce810 0x7fd9ac152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:48.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac0cfb10 0x7fd9ac0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:48.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac160ac0 0x7fd9ac150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:48.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0cd040 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac1597b0 con 0x7fd9ac160ac0 2023-11-28T21:07:48.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac159a90 con 0x7fd9ac0ce810 2023-11-28T21:07:48.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9aaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac0cfb10 0x7fd9ac0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:48.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9aaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac0cfb10 0x7fd9ac0ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46070/0 (socket says 172.21.15.6:46070) 2023-11-28T21:07:48.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9aaffd640 1 -- 172.21.15.6:0/252669951 learned_addr learned my addr 172.21.15.6:0/252669951 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:07:48.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9ab7fe640 1 --2- 172.21.15.6:0/252669951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac0ce810 0x7fd9ac152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:48.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9abfff640 1 --2- 172.21.15.6:0/252669951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac160ac0 0x7fd9ac150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:48.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9aaffd640 1 -- 172.21.15.6:0/252669951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac0ce810 msgr2=0x7fd9ac152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:48.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9aaffd640 1 --2- 172.21.15.6:0/252669951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac0ce810 0x7fd9ac152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9aaffd640 1 -- 172.21.15.6:0/252669951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac160ac0 msgr2=0x7fd9ac150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:48.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9aaffd640 1 --2- 172.21.15.6:0/252669951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac160ac0 0x7fd9ac150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9aaffd640 1 -- 172.21.15.6:0/252669951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c0094d0 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9aaffd640 1 --2- 172.21.15.6:0/252669951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac0cfb10 0x7fd9ac0ccb00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000c750 tx=0x7fd9a000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:48.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd993fff640 1 -- 172.21.15.6:0/252669951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0005270 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd993fff640 1 -- 172.21.15.6:0/252669951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a00053f0 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd993fff640 1 -- 172.21.15.6:0/252669951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000a880 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/252669951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac151870 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/252669951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac151e30 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd993fff640 1 -- 172.21.15.6:0/252669951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd9a000ace0 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.339+0000 7fd993fff640 1 -- 172.21.15.6:0/252669951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd9a0003d80 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.343+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/252669951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac152020 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.343+0000 7fd993fff640 1 -- 172.21.15.6:0/252669951 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fd9a0017070 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/252669951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9ac0674d0 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd993fff640 1 -- 172.21.15.6:0/252669951 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd9ac0d4050 con 0x7fd9ac0cfb10 2023-11-28T21:07:48.409 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:07:48.409 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:07:48.079706+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:07:48.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/252669951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac0cfb10 msgr2=0x7fd9ac0ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:48.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 --2- 172.21.15.6:0/252669951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac0cfb10 0x7fd9ac0ccb00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000c750 tx=0x7fd9a000cc10 comp rx=0 tx=0).stop 2023-11-28T21:07:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/252669951 shutdown_connections 2023-11-28T21:07:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 --2- 172.21.15.6:0/252669951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9ac160ac0 0x7fd9ac150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 --2- 172.21.15.6:0/252669951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9ac0cfb10 0x7fd9ac0ccb00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 --2- 172.21.15.6:0/252669951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9ac0ce810 0x7fd9ac152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:48.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/252669951 >> 172.21.15.6:0/252669951 conn(0x7fd9ac09c480 msgr2=0x7fd9ac0d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/252669951 shutdown_connections 2023-11-28T21:07:48.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:07:48.403+0000 7fd9b1ae3640 1 -- 172.21.15.6:0/252669951 wait complete. 2023-11-28T21:07:48.429 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T21:07:48.429 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T21:07:48.506 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T21:07:48.506 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T21:07:48.507 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-11-28T21:07:48.551 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:48.543+0000 7fbf22014180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T21:07:48.561 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-28T21:07:48.555+0000 7fd4b9095640 -1 Falling back to public interface 2023-11-28T21:07:48.570 INFO:tasks.ceph.mgr.x.smithi031.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T21:07:48.571 INFO:tasks.ceph.mgr.x.smithi031.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T21:07:48.571 INFO:tasks.ceph.mgr.x.smithi031.stderr: from numpy import show_config as show_numpy_config 2023-11-28T21:07:48.626 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:48.622+0000 7f5f4f049180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T21:07:48.695 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:48.687+0000 7fbf22014180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T21:07:48.769 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:48.766+0000 7f5f4f049180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T21:07:48.816 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-28T21:07:48.811+0000 7fef6fb67640 -1 Falling back to public interface 2023-11-28T21:07:48.836 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-28T21:07:48.831+0000 7fdf2b165640 -1 Falling back to public interface 2023-11-28T21:07:48.849 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T21:07:48.846+0000 7f7b1b2ac640 -1 Falling back to public interface 2023-11-28T21:07:48.850 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-28T21:07:48.846+0000 7fb80c42b640 -1 Falling back to public interface 2023-11-28T21:07:48.851 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T21:07:48.846+0000 7f7b1a26c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-11-28T21:07:48.852 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-28T21:07:48.847+0000 7fe933c4f640 -1 Falling back to public interface 2023-11-28T21:07:48.862 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-28T21:07:48.858+0000 7f2a8af03640 -1 Falling back to public interface 2023-11-28T21:07:48.865 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-28T21:07:48.862+0000 7f7a6f0e0640 -1 Falling back to public interface 2023-11-28T21:07:48.890 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:48.883+0000 7fbf22014180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T21:07:48.958 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:48.954+0000 7f5f4f049180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T21:07:48.969 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:48.963+0000 7fbf22014180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T21:07:49.047 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:49.042+0000 7f5f4f049180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T21:07:49.118 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:49.107+0000 7fbf22014180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T21:07:49.195 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:49.190+0000 7f5f4f049180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T21:07:49.235 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T21:07:49.368 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f025cafd640 1 Processor -- start 2023-11-28T21:07:49.368 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f025cafd640 1 -- start start 2023-11-28T21:07:49.370 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f025cafd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02580ac8d0 0x7f02580ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:49.370 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f025cafd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 0x7f02580b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f025cafd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0258157e30 con 0x7f0258157a50 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f025cafd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025806ac30 con 0x7f02580ac8d0 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f025cafd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02580adad0 con 0x7f02580ad6a0 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f025659c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0258157a50 0x7f025806a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:38908/0 (socket says 172.21.15.6:38908) 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f025659c640 1 -- 172.21.15.6:0/3477451451 learned_addr learned my addr 172.21.15.6:0/3477451451 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f024ffff640 1 --2- 172.21.15.6:0/3477451451 >> v2:172.21.15.31:3300/0 conn(0x7f02580ac8d0 0x7f02580ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f0256d9d640 1 --2- 172.21.15.6:0/3477451451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 0x7f02580b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f024ffff640 1 -- 172.21.15.6:0/3477451451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 msgr2=0x7f02580b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f024ffff640 1 --2- 172.21.15.6:0/3477451451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 0x7f02580b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f024ffff640 1 -- 172.21.15.6:0/3477451451 >> v1:172.21.15.31:6789/0 conn(0x7f0258157a50 legacy=0x7f025806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:49.371 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.363+0000 7f024ffff640 1 -- 172.21.15.6:0/3477451451 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025806ae90 con 0x7f02580ac8d0 2023-11-28T21:07:49.373 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f024ffff640 1 --2- 172.21.15.6:0/3477451451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 0x7f02580ad160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f02400097c0 tx=0x7f024001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ee218a59ff979e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:49.374 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f0255d9b640 1 -- 172.21.15.6:0/3477451451 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400ab600 con 0x7f02580ac8d0 2023-11-28T21:07:49.374 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f0255d9b640 1 -- 172.21.15.6:0/3477451451 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02400a7050 con 0x7f02580ac8d0 2023-11-28T21:07:49.374 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f0255d9b640 1 -- 172.21.15.6:0/3477451451 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400ab980 con 0x7f02580ac8d0 2023-11-28T21:07:49.374 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f025cafd640 1 -- 172.21.15.6:0/3477451451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 msgr2=0x7f02580ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:49.375 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f025cafd640 1 --2- 172.21.15.6:0/3477451451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 0x7f02580ad160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f02400097c0 tx=0x7f024001c480 comp rx=0 tx=0).stop 2023-11-28T21:07:49.375 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f025cafd640 1 -- 172.21.15.6:0/3477451451 shutdown_connections 2023-11-28T21:07:49.375 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f025cafd640 1 --2- 172.21.15.6:0/3477451451 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 0x7f02580b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:49.375 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f025cafd640 1 --2- 172.21.15.6:0/3477451451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 0x7f02580ad160 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:49.375 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f025cafd640 1 -- 172.21.15.6:0/3477451451 >> 172.21.15.6:0/3477451451 conn(0x7f02580cf6e0 msgr2=0x7f02580cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:49.375 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f025cafd640 1 -- 172.21.15.6:0/3477451451 shutdown_connections 2023-11-28T21:07:49.375 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.367+0000 7f025cafd640 1 -- 172.21.15.6:0/3477451451 wait complete. 2023-11-28T21:07:49.376 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025cafd640 1 Processor -- start 2023-11-28T21:07:49.376 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025cafd640 1 -- start start 2023-11-28T21:07:49.378 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025cafd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 0x7f025806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025cafd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 0x7f0258156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025cafd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0258157a50 0x7f025814b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025cafd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0258156ff0 con 0x7f0258157a50 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025cafd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025806e440 con 0x7f02580ac8d0 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025cafd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025806e720 con 0x7f02580ad6a0 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 0x7f025806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f0256d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0258157a50 0x7f025814b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 0x7f025806ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:56088/0 (socket says 172.21.15.6:56088) 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f024ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 0x7f0258156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:07:49.379 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025659c640 1 -- 172.21.15.6:0/3209172890 learned_addr learned my addr 172.21.15.6:0/3209172890 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:07:49.380 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025659c640 1 -- 172.21.15.6:0/3209172890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 msgr2=0x7f0258156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:49.380 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025659c640 1 --2- 172.21.15.6:0/3209172890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 0x7f0258156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:49.380 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025659c640 1 -- 172.21.15.6:0/3209172890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0258157a50 msgr2=0x7f025814b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:49.380 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025659c640 1 --2- 172.21.15.6:0/3209172890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0258157a50 0x7f025814b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:49.380 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025659c640 1 -- 172.21.15.6:0/3209172890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240009420 con 0x7f02580ac8d0 2023-11-28T21:07:49.380 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025659c640 1 --2- 172.21.15.6:0/3209172890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 0x7f025806ddf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f024800c430 tx=0x7f024800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:07:49.381 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f024effd640 1 -- 172.21.15.6:0/3209172890 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248005cf0 con 0x7f02580ac8d0 2023-11-28T21:07:49.381 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f024effd640 1 -- 172.21.15.6:0/3209172890 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0248005e50 con 0x7f02580ac8d0 2023-11-28T21:07:49.381 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f025cafd640 1 -- 172.21.15.6:0/3209172890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025806ea00 con 0x7f02580ac8d0 2023-11-28T21:07:49.381 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.371+0000 7f024effd640 1 -- 172.21.15.6:0/3209172890 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02480072d0 con 0x7f02580ac8d0 2023-11-28T21:07:49.381 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.375+0000 7f025cafd640 1 -- 172.21.15.6:0/3209172890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025806efc0 con 0x7f02580ac8d0 2023-11-28T21:07:49.381 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.375+0000 7f024effd640 1 -- 172.21.15.6:0/3209172890 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f024801c440 con 0x7f02580ac8d0 2023-11-28T21:07:49.381 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.375+0000 7f024effd640 1 -- 172.21.15.6:0/3209172890 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f024801cdc0 con 0x7f02580ac8d0 2023-11-28T21:07:49.381 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.375+0000 7f025cafd640 1 -- 172.21.15.6:0/3209172890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02580674d0 con 0x7f02580ac8d0 2023-11-28T21:07:49.382 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.375+0000 7f024effd640 1 -- 172.21.15.6:0/3209172890 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0248021060 con 0x7f02580ac8d0 2023-11-28T21:07:49.441 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.435+0000 7f025cafd640 1 -- 172.21.15.6:0/3209172890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0258143c00 con 0x7f02580ac8d0 2023-11-28T21:07:49.442 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.435+0000 7f024effd640 1 -- 172.21.15.6:0/3209172890 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0248017070 con 0x7f02580ac8d0 2023-11-28T21:07:49.442 INFO:teuthology.misc.health.smithi006.stdout: 2023-11-28T21:07:49.442 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:07:48.079706+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:07:49.443 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.435+0000 7f025cafd640 1 -- 172.21.15.6:0/3209172890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 msgr2=0x7f025806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:07:49.443 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.435+0000 7f025cafd640 1 --2- 172.21.15.6:0/3209172890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 0x7f025806ddf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f024800c430 tx=0x7f024800c8f0 comp rx=0 tx=0).stop 2023-11-28T21:07:49.444 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.439+0000 7f025cafd640 1 -- 172.21.15.6:0/3209172890 shutdown_connections 2023-11-28T21:07:49.444 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.439+0000 7f025cafd640 1 --2- 172.21.15.6:0/3209172890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0258157a50 0x7f025814b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:49.444 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.439+0000 7f025cafd640 1 --2- 172.21.15.6:0/3209172890 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f02580ad6a0 0x7f0258156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:49.444 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.439+0000 7f025cafd640 1 --2- 172.21.15.6:0/3209172890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02580ac8d0 0x7f025806ddf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:07:49.445 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.439+0000 7f025cafd640 1 -- 172.21.15.6:0/3209172890 >> 172.21.15.6:0/3209172890 conn(0x7f02580cf6e0 msgr2=0x7f02580af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:07:49.445 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.439+0000 7f025cafd640 1 -- 172.21.15.6:0/3209172890 shutdown_connections 2023-11-28T21:07:49.445 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:07:49.439+0000 7f025cafd640 1 -- 172.21.15.6:0/3209172890 wait complete. 2023-11-28T21:07:49.460 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T21:07:49.838 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:49.831+0000 7fbf22014180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T21:07:49.915 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:49.910+0000 7f5f4f049180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T21:07:49.929 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:49.923+0000 7fbf22014180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T21:07:50.007 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:50.002+0000 7f5f4f049180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T21:07:50.129 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:50.123+0000 7fbf22014180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T21:07:50.211 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:50.206+0000 7f5f4f049180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T21:07:50.219 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:50.215+0000 7fbf22014180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T21:07:50.301 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:50.298+0000 7f5f4f049180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T21:07:50.567 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:50.559+0000 7fbf22014180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T21:07:50.639 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:50.631+0000 7fbf22014180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T21:07:50.654 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:50.650+0000 7f5f4f049180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T21:07:50.731 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-28T21:07:50.726+0000 7f5f4f049180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T21:07:51.662 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:51.655+0000 7fbec9794640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T21:07:51.662 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-28T21:07:51.655+0000 7fbec9794640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T21:07:52.472 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-28T21:07:52.467+0000 7fd4b9095640 -1 osd.0 0 log_to_monitors true 2023-11-28T21:07:52.618 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-28T21:07:52.611+0000 7fef6fb67640 -1 osd.3 0 log_to_monitors true 2023-11-28T21:07:52.718 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-28T21:07:52.714+0000 7fb80c42b640 -1 osd.6 0 log_to_monitors true 2023-11-28T21:07:52.736 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-28T21:07:52.731+0000 7fdf2b165640 -1 osd.2 0 log_to_monitors true 2023-11-28T21:07:52.741 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-28T21:07:52.735+0000 7fe933c4f640 -1 osd.1 0 log_to_monitors true 2023-11-28T21:07:52.809 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T21:07:52.806+0000 7f7b1b2ac640 -1 osd.5 0 log_to_monitors true 2023-11-28T21:07:52.839 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-28T21:07:52.834+0000 7f2a8af03640 -1 osd.4 0 log_to_monitors true 2023-11-28T21:07:53.110 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-28T21:07:53.106+0000 7f7a6f0e0640 -1 osd.7 0 log_to_monitors true 2023-11-28T21:07:55.251 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-28T21:07:55.243+0000 7fd4b6053640 -1 osd.0 0 waiting for initial osdmap 2023-11-28T21:08:01.665 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-28T21:07:55.259+0000 7fef6b2ef640 -1 osd.3 0 waiting for initial osdmap 2023-11-28T21:08:01.665 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T21:07:56.990+0000 7f7b16a32640 -1 osd.5 0 waiting for initial osdmap 2023-11-28T21:08:01.665 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T21:07:57.026+0000 7f7b0f07f640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T21:08:01.666 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-28T21:07:55.291+0000 7fd4ace6a640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T21:08:01.666 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-28T21:07:57.110+0000 7f2a86689640 -1 osd.4 0 waiting for initial osdmap 2023-11-28T21:08:01.666 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-28T21:07:57.134+0000 7f7a6a866640 -1 osd.7 0 waiting for initial osdmap 2023-11-28T21:08:01.666 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-28T21:07:55.299+0000 7fef6393c640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T21:08:01.667 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-28T21:07:57.138+0000 7f2a7ecd6640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T21:08:01.667 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-28T21:07:56.223+0000 7fe92f3d5640 -1 osd.1 0 waiting for initial osdmap 2023-11-28T21:08:01.667 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-28T21:07:56.247+0000 7fe927a22640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T21:08:01.667 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-28T21:07:57.154+0000 7fb807192640 -1 osd.6 0 waiting for initial osdmap 2023-11-28T21:08:01.668 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-28T21:07:57.174+0000 7f7a62eb3640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T21:08:01.668 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-28T21:07:56.263+0000 7fdf28121640 -1 osd.2 0 waiting for initial osdmap 2023-11-28T21:08:01.668 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-28T21:07:56.291+0000 7fdf1ef38640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T21:08:01.668 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-28T21:07:57.186+0000 7fb7ff7df640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T21:08:02.470 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:02.613 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.607+0000 7f34def01640 1 Processor -- start 2023-11-28T21:08:02.614 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.607+0000 7f34def01640 1 -- start start 2023-11-28T21:08:02.615 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.607+0000 7f34def01640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34d806c5b0 0x7f34d806c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.615 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.607+0000 7f34def01640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34d81625d0 0x7f34d8144c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.615 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.607+0000 7f34def01640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d806ced0 con 0x7f34d8145150 2023-11-28T21:08:02.615 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.607+0000 7f34def01640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d81449c0 con 0x7f34d806c5b0 2023-11-28T21:08:02.616 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.607+0000 7f34def01640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d80707c0 con 0x7f34d81625d0 2023-11-28T21:08:02.616 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34dcc9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34d806c5b0 0x7f34d806c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.616 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34dd49e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f34d8145150 0x7f34d8071860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56224/0 (socket says 172.21.15.6:56224) 2023-11-28T21:08:02.616 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34dcc9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34d806c5b0 0x7f34d806c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49718/0 (socket says 172.21.15.6:49718) 2023-11-28T21:08:02.616 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34dd49e640 1 -- 172.21.15.6:0/1117633387 learned_addr learned my addr 172.21.15.6:0/1117633387 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:02.616 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34d7fff640 1 --2- 172.21.15.6:0/1117633387 >> v2:172.21.15.31:3300/0 conn(0x7f34d81625d0 0x7f34d8144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.616 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34dcc9d640 1 -- 172.21.15.6:0/1117633387 >> v2:172.21.15.31:3300/0 conn(0x7f34d81625d0 msgr2=0x7f34d8144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:02.616 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34dcc9d640 1 --2- 172.21.15.6:0/1117633387 >> v2:172.21.15.31:3300/0 conn(0x7f34d81625d0 0x7f34d8144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.617 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34dcc9d640 1 -- 172.21.15.6:0/1117633387 >> v1:172.21.15.6:6789/0 conn(0x7f34d8145150 legacy=0x7f34d8071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.617 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34dcc9d640 1 -- 172.21.15.6:0/1117633387 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8070aa0 con 0x7f34d806c5b0 2023-11-28T21:08:02.617 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34d7fff640 1 --2- 172.21.15.6:0/1117633387 >> v2:172.21.15.31:3300/0 conn(0x7f34d81625d0 0x7f34d8144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:02.618 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34dcc9d640 1 --2- 172.21.15.6:0/1117633387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d806c5b0 0x7f34d806c990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34d806de20 tx=0x7f34cc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c86be57d25f5c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:02.619 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34d77fe640 1 -- 172.21.15.6:0/1117633387 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0ac600 con 0x7f34d806c5b0 2023-11-28T21:08:02.619 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34d77fe640 1 -- 172.21.15.6:0/1117633387 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc0a8050 con 0x7f34d806c5b0 2023-11-28T21:08:02.619 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.611+0000 7f34d77fe640 1 -- 172.21.15.6:0/1117633387 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0ac980 con 0x7f34d806c5b0 2023-11-28T21:08:02.620 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 -- 172.21.15.6:0/1117633387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d806c5b0 msgr2=0x7f34d806c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.620 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 --2- 172.21.15.6:0/1117633387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d806c5b0 0x7f34d806c990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34d806de20 tx=0x7f34cc01c3a0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.620 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 -- 172.21.15.6:0/1117633387 shutdown_connections 2023-11-28T21:08:02.620 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 --2- 172.21.15.6:0/1117633387 >> v2:172.21.15.31:3300/0 conn(0x7f34d81625d0 0x7f34d8144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.620 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 --2- 172.21.15.6:0/1117633387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d806c5b0 0x7f34d806c990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.620 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 -- 172.21.15.6:0/1117633387 >> 172.21.15.6:0/1117633387 conn(0x7f34d806a520 msgr2=0x7f34d806a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:02.620 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 -- 172.21.15.6:0/1117633387 shutdown_connections 2023-11-28T21:08:02.620 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 -- 172.21.15.6:0/1117633387 wait complete. 2023-11-28T21:08:02.621 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 Processor -- start 2023-11-28T21:08:02.622 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 -- start start 2023-11-28T21:08:02.625 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d806c5b0 0x7f34d81413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.625 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d8145150 0x7f34d8140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.625 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34d81625d0 0x7f34d8142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.625 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d81411f0 con 0x7f34d8145150 2023-11-28T21:08:02.625 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d8143ae0 con 0x7f34d806c5b0 2023-11-28T21:08:02.625 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34def01640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d8142fa0 con 0x7f34d81625d0 2023-11-28T21:08:02.625 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d8145150 0x7f34d8140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.625 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d8145150 0x7f34d8140cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49722/0 (socket says 172.21.15.6:49722) 2023-11-28T21:08:02.626 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.615+0000 7f34d7fff640 1 -- 172.21.15.6:0/1507607943 learned_addr learned my addr 172.21.15.6:0/1507607943 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34dcc9d640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d806c5b0 0x7f34d81413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34dd49e640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34d81625d0 0x7f34d8142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d7fff640 1 -- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34d81625d0 msgr2=0x7f34d8142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d7fff640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34d81625d0 0x7f34d8142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d7fff640 1 -- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d806c5b0 msgr2=0x7f34d81413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d7fff640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d806c5b0 0x7f34d81413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d7fff640 1 -- 172.21.15.6:0/1507607943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc009420 con 0x7f34d8145150 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34dd49e640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34d81625d0 0x7f34d8142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34dcc9d640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d806c5b0 0x7f34d81413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:02.628 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d7fff640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d8145150 0x7f34d8140cb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34c400d800 tx=0x7f34c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d57fa640 1 -- 172.21.15.6:0/1507607943 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c400b6c0 con 0x7f34d8145150 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d57fa640 1 -- 172.21.15.6:0/1507607943 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c400b820 con 0x7f34d8145150 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d57fa640 1 -- 172.21.15.6:0/1507607943 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c400bbd0 con 0x7f34d8145150 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d8143240 con 0x7f34d8145150 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d8143800 con 0x7f34d8145150 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d80674d0 con 0x7f34d8145150 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d57fa640 1 -- 172.21.15.6:0/1507607943 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f34c400bd30 con 0x7f34d8145150 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d57fa640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f34bc066470 0x7f34bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.619+0000 7f34d57fa640 1 -- 172.21.15.6:0/1507607943 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34c4084040 con 0x7f34d8145150 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.623+0000 7f34dcc9d640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f34bc066470 0x7f34bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.629 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.623+0000 7f34dcc9d640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f34bc066470 0x7f34bc068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0ae000 tx=0x7f34cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:02.631 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.627+0000 7f34d57fa640 1 -- 172.21.15.6:0/1507607943 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34c40b5280 con 0x7f34d8145150 2023-11-28T21:08:02.791 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.783+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34d816d2a0 con 0x7f34d8145150 2023-11-28T21:08:02.791 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34d57fa640 1 -- 172.21.15.6:0/1507607943 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12742 (secure 0 0 0) 0x7f34c4055290 con 0x7f34d8145150 2023-11-28T21:08:02.792 INFO:teuthology.misc.health.smithi006.stdout: 2023-11-28T21:08:02.792 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":17,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:07:59.304584+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:02.794 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f34bc066470 msgr2=0x7f34bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.794 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f34bc066470 0x7f34bc068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0ae000 tx=0x7f34cc008040 comp rx=0 tx=0).stop 2023-11-28T21:08:02.794 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d8145150 msgr2=0x7f34d8140cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.794 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d8145150 0x7f34d8140cb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34c400d800 tx=0x7f34c400dcc0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.794 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 shutdown_connections 2023-11-28T21:08:02.795 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f34bc066470 0x7f34bc068930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.795 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34d81625d0 0x7f34d8142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.795 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34d8145150 0x7f34d8140cb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.795 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 --2- 172.21.15.6:0/1507607943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34d806c5b0 0x7f34d81413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.795 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 >> 172.21.15.6:0/1507607943 conn(0x7f34d806a520 msgr2=0x7f34d8071860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:02.795 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 shutdown_connections 2023-11-28T21:08:02.795 INFO:teuthology.misc.health.smithi006.stderr:2023-11-28T21:08:02.787+0000 7f34def01640 1 -- 172.21.15.6:0/1507607943 wait complete. 2023-11-28T21:08:02.812 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T21:08:02.812 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T21:08:02.812 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T21:08:02.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T21:08:02.816 INFO:tasks.ceph.mds.a:Started 2023-11-28T21:08:02.816 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T21:08:02.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T21:08:02.819 INFO:tasks.ceph.mds.c:Started 2023-11-28T21:08:02.819 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T21:08:02.820 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T21:08:02.823 INFO:tasks.ceph.mds.b:Started 2023-11-28T21:08:02.824 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T21:08:02.824 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T21:08:02.827 INFO:tasks.ceph.mds.d:Started 2023-11-28T21:08:02.827 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T21:08:02.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:02.917 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-11-28T21:08:02.919 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-11-28T21:08:02.934 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2023-11-28T21:08:02.934 INFO:tasks.ceph.mds.d.smithi031.stdout:starting mds.d at 2023-11-28T21:08:02.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f829d39d640 1 Processor -- start 2023-11-28T21:08:02.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f829d39d640 1 -- start start 2023-11-28T21:08:02.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f829d39d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82980b0340 0x7f829806e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f829d39d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8298099980 0x7f8298099e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f829d39d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829806f2f0 con 0x7f8298160a10 2023-11-28T21:08:02.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f829d39d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829809a350 con 0x7f82980b0340 2023-11-28T21:08:02.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f829d39d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829806f820 con 0x7f8298099980 2023-11-28T21:08:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f82977fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8298099980 0x7f8298099e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f828ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82980b0340 0x7f829806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f82977fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8298099980 0x7f8298099e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:35170/0 (socket says 172.21.15.6:35170) 2023-11-28T21:08:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f82977fe640 1 -- 172.21.15.6:0/3328748671 learned_addr learned my addr 172.21.15.6:0/3328748671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f828ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82980b0340 0x7f829806e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:60314/0 (socket says 172.21.15.6:60314) 2023-11-28T21:08:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f82977fe640 1 -- 172.21.15.6:0/3328748671 >> v2:172.21.15.31:3300/0 conn(0x7f82980b0340 msgr2=0x7f829806e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f82977fe640 1 --2- 172.21.15.6:0/3328748671 >> v2:172.21.15.31:3300/0 conn(0x7f82980b0340 0x7f829806e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f82977fe640 1 -- 172.21.15.6:0/3328748671 >> v1:172.21.15.31:6789/0 conn(0x7f8298160a10 legacy=0x7f82980adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.975+0000 7f82977fe640 1 -- 172.21.15.6:0/3328748671 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980b0080 con 0x7f8298099980 2023-11-28T21:08:02.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f82977fe640 1 --2- 172.21.15.6:0/3328748671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8298099980 0x7f8298099e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8290009e50 tx=0x7f829001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1b8a73bbcf67cc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f82967fc640 1 -- 172.21.15.6:0/3328748671 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82900a58e0 con 0x7f8298099980 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f82967fc640 1 -- 172.21.15.6:0/3328748671 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82900a5a40 con 0x7f8298099980 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f82967fc640 1 -- 172.21.15.6:0/3328748671 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82900a5dd0 con 0x7f8298099980 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f829d39d640 1 -- 172.21.15.6:0/3328748671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8298099980 msgr2=0x7f8298099e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f829d39d640 1 --2- 172.21.15.6:0/3328748671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8298099980 0x7f8298099e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8290009e50 tx=0x7f829001ca10 comp rx=0 tx=0).stop 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f829d39d640 1 -- 172.21.15.6:0/3328748671 shutdown_connections 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f829d39d640 1 --2- 172.21.15.6:0/3328748671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8298099980 0x7f8298099e10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f829d39d640 1 --2- 172.21.15.6:0/3328748671 >> v2:172.21.15.31:3300/0 conn(0x7f82980b0340 0x7f829806e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f829d39d640 1 -- 172.21.15.6:0/3328748671 >> 172.21.15.6:0/3328748671 conn(0x7f82980b2a30 msgr2=0x7f82980b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f829d39d640 1 -- 172.21.15.6:0/3328748671 shutdown_connections 2023-11-28T21:08:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.979+0000 7f829d39d640 1 -- 172.21.15.6:0/3328748671 wait complete. 2023-11-28T21:08:02.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 Processor -- start 2023-11-28T21:08:02.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 -- start start 2023-11-28T21:08:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8298099980 0x7f82981593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82980b0340 0x7f8298154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8298160a10 0x7f8298142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8298159cd0 con 0x7f8298099980 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8298155350 con 0x7f8298160a10 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82980c9f50 con 0x7f82980b0340 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f8296ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8298099980 0x7f82981593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f8296ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8298099980 0x7f82981593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49760/0 (socket says 172.21.15.6:49760) 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f8296ffd640 1 -- 172.21.15.6:0/4273449067 learned_addr learned my addr 172.21.15.6:0/4273449067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f828ffff640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82980b0340 0x7f8298154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f82977fe640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8298160a10 0x7f8298142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f8296ffd640 1 -- 172.21.15.6:0/4273449067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82980b0340 msgr2=0x7f8298154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f8296ffd640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82980b0340 0x7f8298154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f8296ffd640 1 -- 172.21.15.6:0/4273449067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8298160a10 msgr2=0x7f8298142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f8296ffd640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8298160a10 0x7f8298142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f8296ffd640 1 -- 172.21.15.6:0/4273449067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290009b30 con 0x7f8298099980 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f8296ffd640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8298099980 0x7f82981593e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f828800c370 tx=0x7f828800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f828f7fe640 1 -- 172.21.15.6:0/4273449067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82880052d0 con 0x7f8298099980 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f828f7fe640 1 -- 172.21.15.6:0/4273449067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288005430 con 0x7f8298099980 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82980c9660 con 0x7f8298099980 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f828f7fe640 1 -- 172.21.15.6:0/4273449067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288007260 con 0x7f8298099980 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.983+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82980c9900 con 0x7f8298099980 2023-11-28T21:08:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.987+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82980674d0 con 0x7f8298099980 2023-11-28T21:08:02.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.987+0000 7f828f7fe640 1 -- 172.21.15.6:0/4273449067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82880073c0 con 0x7f8298099980 2023-11-28T21:08:02.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.987+0000 7f828f7fe640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8278066470 0x7f8278068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:02.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.987+0000 7f828f7fe640 1 -- 172.21.15.6:0/4273449067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8288082e40 con 0x7f8298099980 2023-11-28T21:08:02.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.987+0000 7f828ffff640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8278066470 0x7f8278068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:02.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.987+0000 7f828ffff640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8278066470 0x7f8278068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8298159920 tx=0x7f8280009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:02.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:02.991+0000 7f828f7fe640 1 -- 172.21.15.6:0/4273449067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82880506b0 con 0x7f8298099980 2023-11-28T21:08:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.151+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82980b6ec0 con 0x7f8298099980 2023-11-28T21:08:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.151+0000 7f828f7fe640 1 -- 172.21.15.6:0/4273449067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12742 (secure 0 0 0) 0x7f8288053cd0 con 0x7f8298099980 2023-11-28T21:08:03.159 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:03.159 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:07:59.304584+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8278066470 msgr2=0x7f8278068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8278066470 0x7f8278068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8298159920 tx=0x7f8280009190 comp rx=0 tx=0).stop 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8298099980 msgr2=0x7f82981593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8298099980 0x7f82981593e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f828800c370 tx=0x7f828800c830 comp rx=0 tx=0).stop 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 shutdown_connections 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8278066470 0x7f8278068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8298160a10 0x7f8298142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82980b0340 0x7f8298154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 --2- 172.21.15.6:0/4273449067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8298099980 0x7f82981593e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 >> 172.21.15.6:0/4273449067 conn(0x7f82980b2a30 msgr2=0x7f82980cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 shutdown_connections 2023-11-28T21:08:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.155+0000 7f829d39d640 1 -- 172.21.15.6:0/4273449067 wait complete. 2023-11-28T21:08:03.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:03.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:03.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.319+0000 7fd10a43a640 1 Processor -- start 2023-11-28T21:08:03.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd10a43a640 1 -- start start 2023-11-28T21:08:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd10a43a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1040d1c20 0x7fd1040b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd10a43a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1040cffe0 0x7fd1040cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd10a43a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1040d0d10 con 0x7fd1040c94c0 2023-11-28T21:08:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd10a43a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1040d3a50 con 0x7fd1040cffe0 2023-11-28T21:08:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd10a43a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1040c98a0 con 0x7fd1040d1c20 2023-11-28T21:08:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd109c39640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1040cffe0 0x7fd1040cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd109438640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd1040c94c0 0x7fd1040d1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56238/0 (socket says 172.21.15.6:56238) 2023-11-28T21:08:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd109438640 1 -- 172.21.15.6:0/2039169422 learned_addr learned my addr 172.21.15.6:0/2039169422 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd108c37640 1 --2- 172.21.15.6:0/2039169422 >> v2:172.21.15.31:3300/0 conn(0x7fd1040d1c20 0x7fd1040b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd109c39640 1 -- 172.21.15.6:0/2039169422 >> v2:172.21.15.31:3300/0 conn(0x7fd1040d1c20 msgr2=0x7fd1040b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd109c39640 1 --2- 172.21.15.6:0/2039169422 >> v2:172.21.15.31:3300/0 conn(0x7fd1040d1c20 0x7fd1040b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd109c39640 1 -- 172.21.15.6:0/2039169422 >> v1:172.21.15.6:6789/0 conn(0x7fd1040c94c0 legacy=0x7fd1040d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd109c39640 1 -- 172.21.15.6:0/2039169422 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040b46f0 con 0x7fd1040cffe0 2023-11-28T21:08:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd0fbfff640 1 -- 172.21.15.6:0/2039169422 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177839391 0 0) 0x7fd1040d0d10 con 0x7fd1040c94c0 2023-11-28T21:08:03.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.323+0000 7fd108c37640 1 --2- 172.21.15.6:0/2039169422 >> v2:172.21.15.31:3300/0 conn(0x7fd1040d1c20 0x7fd1040b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd109c39640 1 --2- 172.21.15.6:0/2039169422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 0x7fd1040cdd20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd10408b8d0 tx=0x7fd0fc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52edd7aa2e1db0cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd0fbfff640 1 -- 172.21.15.6:0/2039169422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0a59a0 con 0x7fd1040cffe0 2023-11-28T21:08:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd0fbfff640 1 -- 172.21.15.6:0/2039169422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc0a5b00 con 0x7fd1040cffe0 2023-11-28T21:08:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd0fbfff640 1 -- 172.21.15.6:0/2039169422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0a5e90 con 0x7fd1040cffe0 2023-11-28T21:08:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 -- 172.21.15.6:0/2039169422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 msgr2=0x7fd1040cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 --2- 172.21.15.6:0/2039169422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 0x7fd1040cdd20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd10408b8d0 tx=0x7fd0fc01c8e0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 -- 172.21.15.6:0/2039169422 shutdown_connections 2023-11-28T21:08:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 --2- 172.21.15.6:0/2039169422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 0x7fd1040cdd20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 --2- 172.21.15.6:0/2039169422 >> v2:172.21.15.31:3300/0 conn(0x7fd1040d1c20 0x7fd1040b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 -- 172.21.15.6:0/2039169422 >> 172.21.15.6:0/2039169422 conn(0x7fd1040d2f30 msgr2=0x7fd1040d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 -- 172.21.15.6:0/2039169422 shutdown_connections 2023-11-28T21:08:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 -- 172.21.15.6:0/2039169422 wait complete. 2023-11-28T21:08:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 Processor -- start 2023-11-28T21:08:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.327+0000 7fd10a43a640 1 -- start start 2023-11-28T21:08:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd10a43a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1040c94c0 0x7fd104159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd10a43a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 0x7fd104156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd10a43a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1040d1c20 0x7fd104152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd10a43a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10415a400 con 0x7fd1040cffe0 2023-11-28T21:08:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd10a43a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd104156cc0 con 0x7fd1040d1c20 2023-11-28T21:08:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd10a43a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10415c0b0 con 0x7fd1040c94c0 2023-11-28T21:08:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd108c37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 0x7fd104156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd108c37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 0x7fd104156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49782/0 (socket says 172.21.15.6:49782) 2023-11-28T21:08:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd108c37640 1 -- 172.21.15.6:0/3980905787 learned_addr learned my addr 172.21.15.6:0/3980905787 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd109438640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1040c94c0 0x7fd104159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd109c39640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1040d1c20 0x7fd104152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd108c37640 1 -- 172.21.15.6:0/3980905787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1040c94c0 msgr2=0x7fd104159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd108c37640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1040c94c0 0x7fd104159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd108c37640 1 -- 172.21.15.6:0/3980905787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1040d1c20 msgr2=0x7fd104152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd108c37640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1040d1c20 0x7fd104152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd108c37640 1 -- 172.21.15.6:0/3980905787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc009a70 con 0x7fd1040cffe0 2023-11-28T21:08:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd108c37640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 0x7fd104156780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400c7c0 tx=0x7fd0f400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd0f9ffb640 1 -- 172.21.15.6:0/3980905787 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40079d0 con 0x7fd1040cffe0 2023-11-28T21:08:03.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd0f9ffb640 1 -- 172.21.15.6:0/3980905787 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f4007b30 con 0x7fd1040cffe0 2023-11-28T21:08:03.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd0f9ffb640 1 -- 172.21.15.6:0/3980905787 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400ce70 con 0x7fd1040cffe0 2023-11-28T21:08:03.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10415b810 con 0x7fd1040cffe0 2023-11-28T21:08:03.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10415bdd0 con 0x7fd1040cffe0 2023-11-28T21:08:03.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd104154c20 con 0x7fd1040cffe0 2023-11-28T21:08:03.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.331+0000 7fd0f9ffb640 1 -- 172.21.15.6:0/3980905787 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0f40113f0 con 0x7fd1040cffe0 2023-11-28T21:08:03.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.335+0000 7fd0f9ffb640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0e8066470 0x7fd0e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.335+0000 7fd0f9ffb640 1 -- 172.21.15.6:0/3980905787 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0f4083eb0 con 0x7fd1040cffe0 2023-11-28T21:08:03.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.335+0000 7fd109438640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0e8066470 0x7fd0e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.335+0000 7fd109438640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0e8066470 0x7fd0e8068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd100000f70 tx=0x7fd100007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.339+0000 7fd0f9ffb640 1 -- 172.21.15.6:0/3980905787 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd104154c20 con 0x7fd1040cffe0 2023-11-28T21:08:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.499+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd104154c20 con 0x7fd1040cffe0 2023-11-28T21:08:03.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.499+0000 7fd0f9ffb640 1 -- 172.21.15.6:0/3980905787 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd104154c20 con 0x7fd1040cffe0 2023-11-28T21:08:03.506 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0e8066470 msgr2=0x7fd0e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0e8066470 0x7fd0e8068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd100000f70 tx=0x7fd100007df0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 msgr2=0x7fd104156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 0x7fd104156780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400c7c0 tx=0x7fd0f400cc80 comp rx=0 tx=0).stop 2023-11-28T21:08:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 shutdown_connections 2023-11-28T21:08:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0e8066470 0x7fd0e8068930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1040d1c20 0x7fd104152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1040cffe0 0x7fd104156780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 --2- 172.21.15.6:0/3980905787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1040c94c0 0x7fd104159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 >> 172.21.15.6:0/3980905787 conn(0x7fd1040d2f30 msgr2=0x7fd1040d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 shutdown_connections 2023-11-28T21:08:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.503+0000 7fd10a43a640 1 -- 172.21.15.6:0/3980905787 wait complete. 2023-11-28T21:08:03.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:08:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f77346e3640 1 Processor -- start 2023-11-28T21:08:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f77346e3640 1 -- start start 2023-11-28T21:08:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f77346e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f772c15d400 0x7f772c0af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f77346e3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0b2710 0x7f772c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f77346e3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c0b0930 con 0x7f772c0af890 2023-11-28T21:08:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f77346e3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c0b0c10 con 0x7f772c15d400 2023-11-28T21:08:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f77346e3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0b0ef0 con 0x7f772c0b2710 2023-11-28T21:08:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f773247f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f772c15d400 0x7f772c0af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f773247f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f772c15d400 0x7f772c0af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49788/0 (socket says 172.21.15.6:49788) 2023-11-28T21:08:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f773247f640 1 -- 172.21.15.6:0/3880395661 learned_addr learned my addr 172.21.15.6:0/3880395661 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f7732c80640 1 --2- 172.21.15.6:0/3880395661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0b2710 0x7f772c0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f773247f640 1 -- 172.21.15.6:0/3880395661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0b2710 msgr2=0x7f772c0abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f773247f640 1 --2- 172.21.15.6:0/3880395661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0b2710 0x7f772c0abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f773247f640 1 -- 172.21.15.6:0/3880395661 >> v1:172.21.15.31:6789/0 conn(0x7f772c0af890 legacy=0x7f772c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f773247f640 1 -- 172.21.15.6:0/3880395661 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0b11d0 con 0x7f772c15d400 2023-11-28T21:08:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.663+0000 7f7732c80640 1 --2- 172.21.15.6:0/3880395661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0b2710 0x7f772c0abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f773247f640 1 --2- 172.21.15.6:0/3880395661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c15d400 0x7f772c0af350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7728009870 tx=0x7f772801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81bbdca8a26d9c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f773147d640 1 -- 172.21.15.6:0/3880395661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280ab600 con 0x7f772c15d400 2023-11-28T21:08:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f773147d640 1 -- 172.21.15.6:0/3880395661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77280a7050 con 0x7f772c15d400 2023-11-28T21:08:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f773147d640 1 -- 172.21.15.6:0/3880395661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280ab980 con 0x7f772c15d400 2023-11-28T21:08:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f77346e3640 1 -- 172.21.15.6:0/3880395661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c15d400 msgr2=0x7f772c0af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f77346e3640 1 --2- 172.21.15.6:0/3880395661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c15d400 0x7f772c0af350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7728009870 tx=0x7f772801c500 comp rx=0 tx=0).stop 2023-11-28T21:08:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f77346e3640 1 -- 172.21.15.6:0/3880395661 shutdown_connections 2023-11-28T21:08:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f77346e3640 1 --2- 172.21.15.6:0/3880395661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0b2710 0x7f772c0abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f77346e3640 1 --2- 172.21.15.6:0/3880395661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c15d400 0x7f772c0af350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f77346e3640 1 -- 172.21.15.6:0/3880395661 >> 172.21.15.6:0/3880395661 conn(0x7f772c0b4520 msgr2=0x7f772c0b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f77346e3640 1 -- 172.21.15.6:0/3880395661 shutdown_connections 2023-11-28T21:08:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.667+0000 7f77346e3640 1 -- 172.21.15.6:0/3880395661 wait complete. 2023-11-28T21:08:03.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 Processor -- start 2023-11-28T21:08:03.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 -- start start 2023-11-28T21:08:03.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c0b2710 0x7f772c155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0cf1a0 0x7f772c0cf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f772c0cce00 0x7f772c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0cfb60 con 0x7f772c0b2710 2023-11-28T21:08:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c0cdb30 con 0x7f772c0cce00 2023-11-28T21:08:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c15b8b0 con 0x7f772c0cf1a0 2023-11-28T21:08:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f773247f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c0b2710 0x7f772c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f773247f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c0b2710 0x7f772c155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49792/0 (socket says 172.21.15.6:49792) 2023-11-28T21:08:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f773247f640 1 -- 172.21.15.6:0/3022149366 learned_addr learned my addr 172.21.15.6:0/3022149366 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f7732c80640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f772c0cce00 0x7f772c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f7731c7e640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0cf1a0 0x7f772c0cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f773247f640 1 -- 172.21.15.6:0/3022149366 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0cf1a0 msgr2=0x7f772c0cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f773247f640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0cf1a0 0x7f772c0cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f773247f640 1 -- 172.21.15.6:0/3022149366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f772c0cce00 msgr2=0x7f772c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f773247f640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f772c0cce00 0x7f772c0cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f773247f640 1 -- 172.21.15.6:0/3022149366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77280094d0 con 0x7f772c0b2710 2023-11-28T21:08:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f773247f640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c0b2710 0x7f772c155040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f77280ae040 tx=0x7f772801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f7722ffd640 1 -- 172.21.15.6:0/3022149366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280b6620 con 0x7f772c0b2710 2023-11-28T21:08:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f7722ffd640 1 -- 172.21.15.6:0/3022149366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77280b67a0 con 0x7f772c0b2710 2023-11-28T21:08:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c15bb90 con 0x7f772c0b2710 2023-11-28T21:08:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f7722ffd640 1 -- 172.21.15.6:0/3022149366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280b6b50 con 0x7f772c0b2710 2023-11-28T21:08:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.671+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c15c150 con 0x7f772c0b2710 2023-11-28T21:08:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.675+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c15c340 con 0x7f772c0b2710 2023-11-28T21:08:03.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.675+0000 7f7722ffd640 1 -- 172.21.15.6:0/3022149366 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77280b2040 con 0x7f772c0b2710 2023-11-28T21:08:03.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.675+0000 7f7722ffd640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7710066470 0x7f7710068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:03.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.675+0000 7f7722ffd640 1 -- 172.21.15.6:0/3022149366 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f772811df70 con 0x7f772c0b2710 2023-11-28T21:08:03.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.675+0000 7f7731c7e640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7710066470 0x7f7710068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:03.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.675+0000 7f7731c7e640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7710066470 0x7f7710068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f772c0cb8b0 tx=0x7f771c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:03.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.679+0000 7f7722ffd640 1 -- 172.21.15.6:0/3022149366 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77280eb620 con 0x7f772c0b2710 2023-11-28T21:08:03.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.867+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f772c0674d0 con 0x7f772c0b2710 2023-11-28T21:08:03.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f7722ffd640 1 -- 172.21.15.6:0/3022149366 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f77280b0540 con 0x7f772c0b2710 2023-11-28T21:08:03.876 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T21:08:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2023-11-28T21:08:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7710066470 msgr2=0x7f7710068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7710066470 0x7f7710068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f772c0cb8b0 tx=0x7f771c009040 comp rx=0 tx=0).stop 2023-11-28T21:08:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c0b2710 msgr2=0x7f772c155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c0b2710 0x7f772c155040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f77280ae040 tx=0x7f772801ad40 comp rx=0 tx=0).stop 2023-11-28T21:08:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 shutdown_connections 2023-11-28T21:08:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7710066470 0x7f7710068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f772c0cce00 0x7f772c0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f772c0cf1a0 0x7f772c0cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 --2- 172.21.15.6:0/3022149366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c0b2710 0x7f772c155040 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 >> 172.21.15.6:0/3022149366 conn(0x7f772c0b4520 msgr2=0x7f772c0ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 shutdown_connections 2023-11-28T21:08:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:03.871+0000 7f77346e3640 1 -- 172.21.15.6:0/3022149366 wait complete. 2023-11-28T21:08:05.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:08:06.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67fb85a640 1 Processor -- start 2023-11-28T21:08:06.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67fb85a640 1 -- start start 2023-11-28T21:08:06.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67fb85a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67f4070cf0 0x7f67f416c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67fb85a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f40b32c0 con 0x7f67f415f230 2023-11-28T21:08:06.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67fb85a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f415f610 con 0x7f67f4162890 2023-11-28T21:08:06.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67fb85a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f406d580 con 0x7f67f4070cf0 2023-11-28T21:08:06.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67f95f6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f67f415f230 0x7f67f40b1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56254/0 (socket says 172.21.15.6:56254) 2023-11-28T21:08:06.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67f95f6640 1 -- 172.21.15.6:0/3082311790 learned_addr learned my addr 172.21.15.6:0/3082311790 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:06.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67f9df7640 1 --2- 172.21.15.6:0/3082311790 >> v2:172.21.15.6:3300/0 conn(0x7f67f4070cf0 0x7f67f416c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67ebfff640 1 -- 172.21.15.6:0/3082311790 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845362573 0 0) 0x7f67f40b32c0 con 0x7f67f415f230 2023-11-28T21:08:06.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67ebfff640 1 -- 172.21.15.6:0/3082311790 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e0003530 con 0x7f67f415f230 2023-11-28T21:08:06.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67f9df7640 1 -- 172.21.15.6:0/3082311790 >> v1:172.21.15.31:6789/0 conn(0x7f67f4162890 legacy=0x7f67f40705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67f9df7640 1 -- 172.21.15.6:0/3082311790 >> v1:172.21.15.6:6789/0 conn(0x7f67f415f230 legacy=0x7f67f40b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.051+0000 7f67f9df7640 1 -- 172.21.15.6:0/3082311790 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40b26f0 con 0x7f67f4070cf0 2023-11-28T21:08:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67f9df7640 1 --2- 172.21.15.6:0/3082311790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4070cf0 0x7f67f416c340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009d90 tx=0x7f67ec01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a70356dcfc77b0a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67ebfff640 1 -- 172.21.15.6:0/3082311790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0a5900 con 0x7f67f4070cf0 2023-11-28T21:08:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67ebfff640 1 -- 172.21.15.6:0/3082311790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0a5a60 con 0x7f67f4070cf0 2023-11-28T21:08:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67ebfff640 1 -- 172.21.15.6:0/3082311790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0a5df0 con 0x7f67f4070cf0 2023-11-28T21:08:06.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67fb85a640 1 -- 172.21.15.6:0/3082311790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4070cf0 msgr2=0x7f67f416c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67fb85a640 1 --2- 172.21.15.6:0/3082311790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4070cf0 0x7f67f416c340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009d90 tx=0x7f67ec01c950 comp rx=0 tx=0).stop 2023-11-28T21:08:06.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67fb85a640 1 -- 172.21.15.6:0/3082311790 shutdown_connections 2023-11-28T21:08:06.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67fb85a640 1 --2- 172.21.15.6:0/3082311790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4070cf0 0x7f67f416c340 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67fb85a640 1 -- 172.21.15.6:0/3082311790 >> 172.21.15.6:0/3082311790 conn(0x7f67f406ab80 msgr2=0x7f67f40b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:06.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67fb85a640 1 -- 172.21.15.6:0/3082311790 shutdown_connections 2023-11-28T21:08:06.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.055+0000 7f67fb85a640 1 -- 172.21.15.6:0/3082311790 wait complete. 2023-11-28T21:08:06.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 Processor -- start 2023-11-28T21:08:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 -- start start 2023-11-28T21:08:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67f4070cf0 0x7f67f414d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f415f230 0x7f67f40afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4162890 0x7f67f41562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40b0160 con 0x7f67f4162890 2023-11-28T21:08:06.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f4165170 con 0x7f67f415f230 2023-11-28T21:08:06.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f40b0340 con 0x7f67f4070cf0 2023-11-28T21:08:06.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f9df7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4162890 0x7f67f41562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f9df7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4162890 0x7f67f41562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49812/0 (socket says 172.21.15.6:49812) 2023-11-28T21:08:06.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f9df7640 1 -- 172.21.15.6:0/308501106 learned_addr learned my addr 172.21.15.6:0/308501106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:06.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f95f6640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67f4070cf0 0x7f67f414d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f8df5640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f415f230 0x7f67f40afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f9df7640 1 -- 172.21.15.6:0/308501106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67f4070cf0 msgr2=0x7f67f414d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f9df7640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67f4070cf0 0x7f67f414d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f9df7640 1 -- 172.21.15.6:0/308501106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f415f230 msgr2=0x7f67f40afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f9df7640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f415f230 0x7f67f40afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f9df7640 1 -- 172.21.15.6:0/308501106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec009a70 con 0x7f67f4162890 2023-11-28T21:08:06.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67f9df7640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4162890 0x7f67f41562f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67ec01a580 tx=0x7f67ec0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:06.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67e9ffb640 1 -- 172.21.15.6:0/308501106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0b9860 con 0x7f67f4162890 2023-11-28T21:08:06.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67e9ffb640 1 -- 172.21.15.6:0/308501106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec0a58f0 con 0x7f67f4162890 2023-11-28T21:08:06.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67e9ffb640 1 -- 172.21.15.6:0/308501106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0b9bc0 con 0x7f67f4162890 2023-11-28T21:08:06.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f40b0620 con 0x7f67f4162890 2023-11-28T21:08:06.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.059+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f41656a0 con 0x7f67f4162890 2023-11-28T21:08:06.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.063+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f40b0810 con 0x7f67f4162890 2023-11-28T21:08:06.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.063+0000 7f67e9ffb640 1 -- 172.21.15.6:0/308501106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f67ec0b9d20 con 0x7f67f4162890 2023-11-28T21:08:06.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.063+0000 7f67e9ffb640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67d8066470 0x7f67d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.063+0000 7f67e9ffb640 1 -- 172.21.15.6:0/308501106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f67ec11edb0 con 0x7f67f4162890 2023-11-28T21:08:06.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.063+0000 7f67f95f6640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67d8066470 0x7f67d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.063+0000 7f67f95f6640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67d8066470 0x7f67d8068930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67f00011f0 tx=0x7f67f0007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:06.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.067+0000 7f67e9ffb640 1 -- 172.21.15.6:0/308501106 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67ec123070 con 0x7f67f4162890 2023-11-28T21:08:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67f40674d0 con 0x7f67f4162890 2023-11-28T21:08:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67e9ffb640 1 -- 172.21.15.6:0/308501106 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7f67ec0b2e80 con 0x7f67f4162890 2023-11-28T21:08:06.264 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:06.265 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2017265312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2017265312},{"type":"v1","addr":"172.21.15.6:6837","nonce":2017265312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2658515931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2658515931},{"type":"v1","addr":"172.21.15.31:6834","nonce":2658515931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3368809777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3368809777},{"type":"v1","addr":"172.21.15.31:6835","nonce":3368809777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T21:08:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2023-11-28T21:08:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67d8066470 msgr2=0x7f67d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67d8066470 0x7f67d8068930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67f00011f0 tx=0x7f67f0007d40 comp rx=0 tx=0).stop 2023-11-28T21:08:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4162890 msgr2=0x7f67f41562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4162890 0x7f67f41562f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f67ec01a580 tx=0x7f67ec0196f0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 shutdown_connections 2023-11-28T21:08:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67d8066470 0x7f67d8068930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67f4162890 0x7f67f41562f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67f415f230 0x7f67f40afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 --2- 172.21.15.6:0/308501106 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67f4070cf0 0x7f67f414d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 >> 172.21.15.6:0/308501106 conn(0x7f67f406ab80 msgr2=0x7f67f40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 shutdown_connections 2023-11-28T21:08:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.259+0000 7f67fb85a640 1 -- 172.21.15.6:0/308501106 wait complete. 2023-11-28T21:08:06.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:06.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bef71d640 1 Processor -- start 2023-11-28T21:08:06.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bef71d640 1 -- start start 2023-11-28T21:08:06.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bef71d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3be8160ac0 0x7f3be80d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bef71d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3be80cfb10 0x7f3be80cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bef71d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be80d4050 con 0x7f3be80ce810 2023-11-28T21:08:06.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bef71d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80d0500 con 0x7f3be8160ac0 2023-11-28T21:08:06.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bef71d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80b43b0 con 0x7f3be80cfb10 2023-11-28T21:08:06.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bed4b9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3be8160ac0 0x7f3be80d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bed4b9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3be8160ac0 0x7f3be80d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49816/0 (socket says 172.21.15.6:49816) 2023-11-28T21:08:06.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bed4b9640 1 -- 172.21.15.6:0/2269031785 learned_addr learned my addr 172.21.15.6:0/2269031785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:06.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bedcba640 1 --2- 172.21.15.6:0/2269031785 >> v2:172.21.15.31:3300/0 conn(0x7f3be80cfb10 0x7f3be80cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bed4b9640 1 -- 172.21.15.6:0/2269031785 >> v2:172.21.15.31:3300/0 conn(0x7f3be80cfb10 msgr2=0x7f3be80cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:06.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bed4b9640 1 --2- 172.21.15.6:0/2269031785 >> v2:172.21.15.31:3300/0 conn(0x7f3be80cfb10 0x7f3be80cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bed4b9640 1 -- 172.21.15.6:0/2269031785 >> v1:172.21.15.31:6789/0 conn(0x7f3be80ce810 legacy=0x7f3be80b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.423+0000 7f3bed4b9640 1 -- 172.21.15.6:0/2269031785 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80cecf0 con 0x7f3be8160ac0 2023-11-28T21:08:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bed4b9640 1 --2- 172.21.15.6:0/2269031785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be8160ac0 0x7f3be80d3b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3be80d3010 tx=0x7f3be401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72caa9bce37285a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bdffff640 1 -- 172.21.15.6:0/2269031785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40ac410 con 0x7f3be8160ac0 2023-11-28T21:08:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bdffff640 1 -- 172.21.15.6:0/2269031785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be40ac570 con 0x7f3be8160ac0 2023-11-28T21:08:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bdffff640 1 -- 172.21.15.6:0/2269031785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40ac900 con 0x7f3be8160ac0 2023-11-28T21:08:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bef71d640 1 -- 172.21.15.6:0/2269031785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be8160ac0 msgr2=0x7f3be80d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bef71d640 1 --2- 172.21.15.6:0/2269031785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be8160ac0 0x7f3be80d3b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3be80d3010 tx=0x7f3be401c4c0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bef71d640 1 -- 172.21.15.6:0/2269031785 shutdown_connections 2023-11-28T21:08:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bef71d640 1 --2- 172.21.15.6:0/2269031785 >> v2:172.21.15.31:3300/0 conn(0x7f3be80cfb10 0x7f3be80cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bef71d640 1 --2- 172.21.15.6:0/2269031785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be8160ac0 0x7f3be80d3b10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bef71d640 1 -- 172.21.15.6:0/2269031785 >> 172.21.15.6:0/2269031785 conn(0x7f3be809c480 msgr2=0x7f3be80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bef71d640 1 -- 172.21.15.6:0/2269031785 shutdown_connections 2023-11-28T21:08:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.427+0000 7f3bef71d640 1 -- 172.21.15.6:0/2269031785 wait complete. 2023-11-28T21:08:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 Processor -- start 2023-11-28T21:08:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 -- start start 2023-11-28T21:08:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3be80ce810 0x7f3be8150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be80cfb10 0x7f3be814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3be8160ac0 0x7f3be80b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be814de30 con 0x7f3be80cfb10 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8151500 con 0x7f3be80ce810 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be8152ee0 con 0x7f3be8160ac0 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3beccb8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be80cfb10 0x7f3be814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3beccb8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be80cfb10 0x7f3be814eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49830/0 (socket says 172.21.15.6:49830) 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3beccb8640 1 -- 172.21.15.6:0/997475483 learned_addr learned my addr 172.21.15.6:0/997475483 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bed4b9640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3be80ce810 0x7f3be8150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3beccb8640 1 -- 172.21.15.6:0/997475483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3be8160ac0 msgr2=0x7f3be80b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3beccb8640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3be8160ac0 0x7f3be80b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3beccb8640 1 -- 172.21.15.6:0/997475483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3be80ce810 msgr2=0x7f3be8150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3beccb8640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3be80ce810 0x7f3be8150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3beccb8640 1 -- 172.21.15.6:0/997475483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be40094d0 con 0x7f3be80cfb10 2023-11-28T21:08:06.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bed4b9640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3be80ce810 0x7f3be8150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:06.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3beccb8640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be80cfb10 0x7f3be814eaf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800c480 tx=0x7f3bd800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:06.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bddffb640 1 -- 172.21.15.6:0/997475483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8012830 con 0x7f3be80cfb10 2023-11-28T21:08:06.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bddffb640 1 -- 172.21.15.6:0/997475483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd80129b0 con 0x7f3be80cfb10 2023-11-28T21:08:06.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bddffb640 1 -- 172.21.15.6:0/997475483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8012d60 con 0x7f3be80cfb10 2023-11-28T21:08:06.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be814e010 con 0x7f3be80cfb10 2023-11-28T21:08:06.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.431+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be814e5d0 con 0x7f3be80cfb10 2023-11-28T21:08:06.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.435+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be814e7f0 con 0x7f3be80cfb10 2023-11-28T21:08:06.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.435+0000 7f3bddffb640 1 -- 172.21.15.6:0/997475483 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3bd801c460 con 0x7f3be80cfb10 2023-11-28T21:08:06.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.435+0000 7f3bddffb640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3bcc066470 0x7f3bcc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.435+0000 7f3bddffb640 1 -- 172.21.15.6:0/997475483 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3bd8083a10 con 0x7f3be80cfb10 2023-11-28T21:08:06.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.435+0000 7f3bed4b9640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3bcc066470 0x7f3bcc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.435+0000 7f3bed4b9640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3bcc066470 0x7f3bcc068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3be40ae000 tx=0x7f3be40a6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:06.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.439+0000 7f3bddffb640 1 -- 172.21.15.6:0/997475483 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3bd80511d0 con 0x7f3be80cfb10 2023-11-28T21:08:06.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.595+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3be80674d0 con 0x7f3be80cfb10 2023-11-28T21:08:06.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.595+0000 7f3bddffb640 1 -- 172.21.15.6:0/997475483 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12742 (secure 0 0 0) 0x7f3bd80547f0 con 0x7f3be80cfb10 2023-11-28T21:08:06.602 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:06.602 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:07:59.304584+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:06.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3bcc066470 msgr2=0x7f3bcc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3bcc066470 0x7f3bcc068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3be40ae000 tx=0x7f3be40a6040 comp rx=0 tx=0).stop 2023-11-28T21:08:06.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be80cfb10 msgr2=0x7f3be814eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be80cfb10 0x7f3be814eaf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800c480 tx=0x7f3bd800c940 comp rx=0 tx=0).stop 2023-11-28T21:08:06.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 shutdown_connections 2023-11-28T21:08:06.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3bcc066470 0x7f3bcc068930 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3be8160ac0 0x7f3be80b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be80cfb10 0x7f3be814eaf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 --2- 172.21.15.6:0/997475483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3be80ce810 0x7f3be8150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 >> 172.21.15.6:0/997475483 conn(0x7f3be809c480 msgr2=0x7f3be80d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:06.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 shutdown_connections 2023-11-28T21:08:06.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.599+0000 7f3bef71d640 1 -- 172.21.15.6:0/997475483 wait complete. 2023-11-28T21:08:06.624 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:06.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.763+0000 7f6bf9980640 1 Processor -- start 2023-11-28T21:08:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.763+0000 7f6bf9980640 1 -- start start 2023-11-28T21:08:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf9980640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 0x7f6bf40cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf9980640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6bf406cde0 0x7f6bf415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf9980640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bf415c270 0x7f6bf415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf9980640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf40cd400 con 0x7f6bf415c270 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf9980640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf415c700 con 0x7f6bf406cde0 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf9980640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40cc930 con 0x7f6bf406ca00 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bf415c270 0x7f6bf415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bf415c270 0x7f6bf415eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49840/0 (socket says 172.21.15.6:49840) 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf37fe640 1 -- 172.21.15.6:0/2361100275 learned_addr learned my addr 172.21.15.6:0/2361100275 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bebfff640 1 --2- 172.21.15.6:0/2361100275 >> v2:172.21.15.31:3300/0 conn(0x7f6bf406cde0 0x7f6bf415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf2ffd640 1 --2- 172.21.15.6:0/2361100275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 0x7f6bf40cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf37fe640 1 -- 172.21.15.6:0/2361100275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 msgr2=0x7f6bf40cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf37fe640 1 --2- 172.21.15.6:0/2361100275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 0x7f6bf40cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf37fe640 1 -- 172.21.15.6:0/2361100275 >> v2:172.21.15.31:3300/0 conn(0x7f6bf406cde0 msgr2=0x7f6bf415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf37fe640 1 --2- 172.21.15.6:0/2361100275 >> v2:172.21.15.31:3300/0 conn(0x7f6bf406cde0 0x7f6bf415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bf37fe640 1 -- 172.21.15.6:0/2361100275 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf40ccb60 con 0x7f6bf415c270 2023-11-28T21:08:06.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.767+0000 7f6bebfff640 1 --2- 172.21.15.6:0/2361100275 >> v2:172.21.15.31:3300/0 conn(0x7f6bf406cde0 0x7f6bf415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf37fe640 1 --2- 172.21.15.6:0/2361100275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 0x7f6bf415eb90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bf406fd20 tx=0x7f6bec01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f119b3f0d886201c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf27fc640 1 -- 172.21.15.6:0/2361100275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0a64e0 con 0x7f6bf415c270 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf27fc640 1 -- 172.21.15.6:0/2361100275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec0a6640 con 0x7f6bf415c270 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf27fc640 1 -- 172.21.15.6:0/2361100275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0a69d0 con 0x7f6bf415c270 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 -- 172.21.15.6:0/2361100275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 msgr2=0x7f6bf415eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 --2- 172.21.15.6:0/2361100275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 0x7f6bf415eb90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bf406fd20 tx=0x7f6bec01c650 comp rx=0 tx=0).stop 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 -- 172.21.15.6:0/2361100275 shutdown_connections 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 --2- 172.21.15.6:0/2361100275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 0x7f6bf415eb90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 --2- 172.21.15.6:0/2361100275 >> v2:172.21.15.31:3300/0 conn(0x7f6bf406cde0 0x7f6bf415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 --2- 172.21.15.6:0/2361100275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 0x7f6bf40cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 -- 172.21.15.6:0/2361100275 >> 172.21.15.6:0/2361100275 conn(0x7f6bf406a980 msgr2=0x7f6bf406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 -- 172.21.15.6:0/2361100275 shutdown_connections 2023-11-28T21:08:06.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 -- 172.21.15.6:0/2361100275 wait complete. 2023-11-28T21:08:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 Processor -- start 2023-11-28T21:08:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.771+0000 7f6bf9980640 1 -- start start 2023-11-28T21:08:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf9980640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 0x7f6bf4153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf9980640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bf406cde0 0x7f6bf413f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf9980640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 0x7f6bf41421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf9980640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf413ff00 con 0x7f6bf415c270 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf9980640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4140190 con 0x7f6bf406cde0 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf9980640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4142a70 con 0x7f6bf406ca00 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 0x7f6bf41421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 0x7f6bf41421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49848/0 (socket says 172.21.15.6:49848) 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf37fe640 1 -- 172.21.15.6:0/3157022873 learned_addr learned my addr 172.21.15.6:0/3157022873 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bebfff640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bf406cde0 0x7f6bf413f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf2ffd640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 0x7f6bf4153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf37fe640 1 -- 172.21.15.6:0/3157022873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 msgr2=0x7f6bf4153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf37fe640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 0x7f6bf4153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf37fe640 1 -- 172.21.15.6:0/3157022873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bf406cde0 msgr2=0x7f6bf413f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf37fe640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bf406cde0 0x7f6bf413f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf37fe640 1 -- 172.21.15.6:0/3157022873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec009b30 con 0x7f6bf415c270 2023-11-28T21:08:06.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf37fe640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 0x7f6bf41421e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009040 tx=0x7f6bec0193f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf0ff9640 1 -- 172.21.15.6:0/3157022873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0b4070 con 0x7f6bf415c270 2023-11-28T21:08:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf0ff9640 1 -- 172.21.15.6:0/3157022873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec0091d0 con 0x7f6bf415c270 2023-11-28T21:08:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf0ff9640 1 -- 172.21.15.6:0/3157022873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0a6a10 con 0x7f6bf415c270 2023-11-28T21:08:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf4142d50 con 0x7f6bf415c270 2023-11-28T21:08:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf4140430 con 0x7f6bf415c270 2023-11-28T21:08:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.775+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf4140620 con 0x7f6bf415c270 2023-11-28T21:08:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.779+0000 7f6bf0ff9640 1 -- 172.21.15.6:0/3157022873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6bec0b8070 con 0x7f6bf415c270 2023-11-28T21:08:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.779+0000 7f6bf0ff9640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6bd40664a0 0x7f6bd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.779+0000 7f6bf0ff9640 1 -- 172.21.15.6:0/3157022873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6bec0aa070 con 0x7f6bf415c270 2023-11-28T21:08:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.779+0000 7f6bf2ffd640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6bd40664a0 0x7f6bd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.779+0000 7f6bf2ffd640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6bd40664a0 0x7f6bd4068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40cb920 tx=0x7f6be4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:06.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.783+0000 7f6bf0ff9640 1 -- 172.21.15.6:0/3157022873 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6bec0eaca0 con 0x7f6bf415c270 2023-11-28T21:08:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bf4072b90 con 0x7f6bf415c270 2023-11-28T21:08:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf0ff9640 1 -- 172.21.15.6:0/3157022873 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bec0ee2c0 con 0x7f6bf415c270 2023-11-28T21:08:06.944 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6bd40664a0 msgr2=0x7f6bd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6bd40664a0 0x7f6bd4068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40cb920 tx=0x7f6be4008040 comp rx=0 tx=0).stop 2023-11-28T21:08:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 msgr2=0x7f6bf41421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 0x7f6bf41421e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009040 tx=0x7f6bec0193f0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 shutdown_connections 2023-11-28T21:08:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6bd40664a0 0x7f6bd4068960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bf415c270 0x7f6bf41421e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bf406cde0 0x7f6bf413f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 --2- 172.21.15.6:0/3157022873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bf406ca00 0x7f6bf4153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 >> 172.21.15.6:0/3157022873 conn(0x7f6bf406a980 msgr2=0x7f6bf40afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 shutdown_connections 2023-11-28T21:08:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:06.939+0000 7f6bf9980640 1 -- 172.21.15.6:0/3157022873 wait complete. 2023-11-28T21:08:06.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T21:08:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.103+0000 7f90976dd640 1 Processor -- start 2023-11-28T21:08:07.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.103+0000 7f90976dd640 1 -- start start 2023-11-28T21:08:07.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.103+0000 7f90976dd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 0x7f9090071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.103+0000 7f90976dd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90900b2d70 0x7f90900ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.103+0000 7f90976dd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9090071530 con 0x7f909006c570 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.103+0000 7f90976dd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9090072360 con 0x7f90900b2d70 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.103+0000 7f90976dd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9090071810 con 0x7f909015d300 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095c7a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90900b2d70 0x7f90900ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095479640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 0x7f9090071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095c7a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90900b2d70 0x7f90900ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:60406/0 (socket says 172.21.15.6:60406) 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095c7a640 1 -- 172.21.15.6:0/3231292175 learned_addr learned my addr 172.21.15.6:0/3231292175 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095c7a640 1 -- 172.21.15.6:0/3231292175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 msgr2=0x7f9090071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095c7a640 1 --2- 172.21.15.6:0/3231292175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 0x7f9090071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095c7a640 1 -- 172.21.15.6:0/3231292175 >> v1:172.21.15.31:6789/0 conn(0x7f909006c570 legacy=0x7f90900b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095c7a640 1 -- 172.21.15.6:0/3231292175 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900ad1b0 con 0x7f90900b2d70 2023-11-28T21:08:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095479640 1 --2- 172.21.15.6:0/3231292175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 0x7f9090071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9095c7a640 1 --2- 172.21.15.6:0/3231292175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90900b2d70 0x7f90900ad9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9088009e50 tx=0x7f908801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9e8590602bb8fcd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.107+0000 7f9087fff640 1 -- 172.21.15.6:0/3231292175 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90880a57f0 con 0x7f90900b2d70 2023-11-28T21:08:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f9087fff640 1 -- 172.21.15.6:0/3231292175 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90880a5950 con 0x7f90900b2d70 2023-11-28T21:08:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f9087fff640 1 -- 172.21.15.6:0/3231292175 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90880a5ce0 con 0x7f90900b2d70 2023-11-28T21:08:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 -- 172.21.15.6:0/3231292175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90900b2d70 msgr2=0x7f90900ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 --2- 172.21.15.6:0/3231292175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90900b2d70 0x7f90900ad9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9088009e50 tx=0x7f908801ca10 comp rx=0 tx=0).stop 2023-11-28T21:08:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 -- 172.21.15.6:0/3231292175 shutdown_connections 2023-11-28T21:08:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 --2- 172.21.15.6:0/3231292175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90900b2d70 0x7f90900ad9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 --2- 172.21.15.6:0/3231292175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 0x7f9090071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 -- 172.21.15.6:0/3231292175 >> 172.21.15.6:0/3231292175 conn(0x7f909006ab80 msgr2=0x7f90900b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:07.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 -- 172.21.15.6:0/3231292175 shutdown_connections 2023-11-28T21:08:07.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 -- 172.21.15.6:0/3231292175 wait complete. 2023-11-28T21:08:07.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 Processor -- start 2023-11-28T21:08:07.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 -- start start 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006c570 0x7f90901554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90900b2d70 0x7f909015fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 0x7f909014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9090155b90 con 0x7f909006c570 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9090155e70 con 0x7f90900b2d70 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f90976dd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9090156150 con 0x7f909015d300 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f9095479640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006c570 0x7f90901554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f9095479640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006c570 0x7f90901554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49864/0 (socket says 172.21.15.6:49864) 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f9095479640 1 -- 172.21.15.6:0/3094763316 learned_addr learned my addr 172.21.15.6:0/3094763316 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f9094c78640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90900b2d70 0x7f909015fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.111+0000 7f9095c7a640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 0x7f909014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9095479640 1 -- 172.21.15.6:0/3094763316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 msgr2=0x7f909014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9095479640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 0x7f909014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9095479640 1 -- 172.21.15.6:0/3094763316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90900b2d70 msgr2=0x7f909015fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9095479640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90900b2d70 0x7f909015fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9095479640 1 -- 172.21.15.6:0/3094763316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c009420 con 0x7f909006c570 2023-11-28T21:08:07.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9095479640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006c570 0x7f90901554d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f908c00e980 tx=0x7f908c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:07.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9085ffb640 1 -- 172.21.15.6:0/3094763316 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c00ca00 con 0x7f909006c570 2023-11-28T21:08:07.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9085ffb640 1 -- 172.21.15.6:0/3094763316 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c00cb60 con 0x7f909006c570 2023-11-28T21:08:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9085ffb640 1 -- 172.21.15.6:0/3094763316 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c013470 con 0x7f909006c570 2023-11-28T21:08:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088009b30 con 0x7f909006c570 2023-11-28T21:08:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9090151860 con 0x7f909006c570 2023-11-28T21:08:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90901516c0 con 0x7f909006c570 2023-11-28T21:08:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9085ffb640 1 -- 172.21.15.6:0/3094763316 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f908c0135d0 con 0x7f909006c570 2023-11-28T21:08:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9085ffb640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9085ffb640 1 -- 172.21.15.6:0/3094763316 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f908c083c60 con 0x7f909006c570 2023-11-28T21:08:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.115+0000 7f9094c78640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.119+0000 7f9094c78640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f90900b1ca0 tx=0x7f9080009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:07.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.119+0000 7f9085ffb640 1 -- 172.21.15.6:0/3094763316 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90901516c0 con 0x7f909006c570 2023-11-28T21:08:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.279+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f90901516c0 con 0x7f909006c570 2023-11-28T21:08:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.279+0000 7f9085ffb640 1 -- 172.21.15.6:0/3094763316 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f908c017060 con 0x7f909006c570 2023-11-28T21:08:07.285 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:07.286 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-11-28T21:08:07.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:08:07.286 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-11-28T21:08:07.286 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-11-28T21:08:07.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:08:07.286 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-11-28T21:08:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 msgr2=0x7f9074068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f90900b1ca0 tx=0x7f9080009040 comp rx=0 tx=0).stop 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006c570 msgr2=0x7f90901554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006c570 0x7f90901554d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f908c00e980 tx=0x7f908c00ee40 comp rx=0 tx=0).stop 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 shutdown_connections 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f909015d300 0x7f909014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90900b2d70 0x7f909015fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 --2- 172.21.15.6:0/3094763316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006c570 0x7f90901554d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 >> 172.21.15.6:0/3094763316 conn(0x7f909006ab80 msgr2=0x7f9090070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 shutdown_connections 2023-11-28T21:08:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.283+0000 7f90976dd640 1 -- 172.21.15.6:0/3094763316 wait complete. 2023-11-28T21:08:07.307 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T21:08:07.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T21:08:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.451+0000 7fd2f85d1640 1 Processor -- start 2023-11-28T21:08:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.451+0000 7fd2f85d1640 1 -- start start 2023-11-28T21:08:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.451+0000 7fd2f85d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2f0141970 0x7fd2f006c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.451+0000 7fd2f85d1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f00b40f0 con 0x7fd2f00b3c90 2023-11-28T21:08:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.451+0000 7fd2f85d1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f006cbf0 con 0x7fd2f00b2510 2023-11-28T21:08:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.451+0000 7fd2f85d1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f006ced0 con 0x7fd2f0141970 2023-11-28T21:08:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.451+0000 7fd2f5b6c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd2f00b3c90 0x7fd2f00b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56268/0 (socket says 172.21.15.6:56268) 2023-11-28T21:08:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.451+0000 7fd2f636d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2f0141970 0x7fd2f006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.451+0000 7fd2f5b6c640 1 -- 172.21.15.6:0/1589845077 learned_addr learned my addr 172.21.15.6:0/1589845077 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:07.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f636d640 1 -- 172.21.15.6:0/1589845077 >> v1:172.21.15.31:6789/0 conn(0x7fd2f00b2510 legacy=0x7fd2f00ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f636d640 1 -- 172.21.15.6:0/1589845077 >> v1:172.21.15.6:6789/0 conn(0x7fd2f00b3c90 legacy=0x7fd2f00b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f636d640 1 -- 172.21.15.6:0/1589845077 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f006d1b0 con 0x7fd2f0141970 2023-11-28T21:08:07.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f536b640 1 -- 172.21.15.6:0/1589845077 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889208982 0 0) 0x7fd2f00b40f0 con 0x7fd2f00b3c90 2023-11-28T21:08:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f636d640 1 --2- 172.21.15.6:0/1589845077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 0x7fd2f006c610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0097c0 tx=0x7fd2ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93719f8dc3802bd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f536b640 1 -- 172.21.15.6:0/1589845077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec0ab600 con 0x7fd2f0141970 2023-11-28T21:08:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f536b640 1 -- 172.21.15.6:0/1589845077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec0a7050 con 0x7fd2f0141970 2023-11-28T21:08:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f536b640 1 -- 172.21.15.6:0/1589845077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec0ab980 con 0x7fd2f0141970 2023-11-28T21:08:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f85d1640 1 -- 172.21.15.6:0/1589845077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 msgr2=0x7fd2f006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.455+0000 7fd2f85d1640 1 --2- 172.21.15.6:0/1589845077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 0x7fd2f006c610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0097c0 tx=0x7fd2ec01c480 comp rx=0 tx=0).stop 2023-11-28T21:08:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 -- 172.21.15.6:0/1589845077 shutdown_connections 2023-11-28T21:08:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 --2- 172.21.15.6:0/1589845077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 0x7fd2f006c610 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 -- 172.21.15.6:0/1589845077 >> 172.21.15.6:0/1589845077 conn(0x7fd2f00b0b00 msgr2=0x7fd2f00b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 -- 172.21.15.6:0/1589845077 shutdown_connections 2023-11-28T21:08:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 -- 172.21.15.6:0/1589845077 wait complete. 2023-11-28T21:08:07.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 Processor -- start 2023-11-28T21:08:07.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 -- start start 2023-11-28T21:08:07.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2f00b2510 0x7fd2f015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2f00b3c90 0x7fd2f0142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 0x7fd2f0070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0144520 con 0x7fd2f0141970 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0143910 con 0x7fd2f00b3c90 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f85d1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0143bf0 con 0x7fd2f00b2510 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f6b6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 0x7fd2f0070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f6b6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 0x7fd2f0070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49890/0 (socket says 172.21.15.6:49890) 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f6b6e640 1 -- 172.21.15.6:0/2867135197 learned_addr learned my addr 172.21.15.6:0/2867135197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f5b6c640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2f00b3c90 0x7fd2f0142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f636d640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2f00b2510 0x7fd2f015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f6b6e640 1 -- 172.21.15.6:0/2867135197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2f00b2510 msgr2=0x7fd2f015a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f6b6e640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2f00b2510 0x7fd2f015a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f6b6e640 1 -- 172.21.15.6:0/2867135197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2f00b3c90 msgr2=0x7fd2f0142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f6b6e640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2f00b3c90 0x7fd2f0142ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.459+0000 7fd2f6b6e640 1 -- 172.21.15.6:0/2867135197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec009420 con 0x7fd2f0141970 2023-11-28T21:08:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2f6b6e640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 0x7fd2f0070390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800c730 tx=0x7fd2e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2867135197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8003b80 con 0x7fd2f0141970 2023-11-28T21:08:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2867135197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8003ce0 con 0x7fd2f0141970 2023-11-28T21:08:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f0143ed0 con 0x7fd2f0141970 2023-11-28T21:08:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2867135197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8005310 con 0x7fd2f0141970 2023-11-28T21:08:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f01433e0 con 0x7fd2f0141970 2023-11-28T21:08:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f015b890 con 0x7fd2f0141970 2023-11-28T21:08:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2867135197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd2e8005680 con 0x7fd2f0141970 2023-11-28T21:08:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2e6ffd640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd2d4066470 0x7fd2d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2867135197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2e80839f0 con 0x7fd2f0141970 2023-11-28T21:08:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.463+0000 7fd2f636d640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd2d4066470 0x7fd2d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.467+0000 7fd2f636d640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd2d4066470 0x7fd2d4068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0ad000 tx=0x7fd2ec0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.467+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2867135197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2f015b890 con 0x7fd2f0141970 2023-11-28T21:08:07.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:07.631+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd2f015b890 con 0x7fd2f0141970 2023-11-28T21:08:07.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:07.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:08.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2867135197 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd2f015b890 con 0x7fd2f0141970 2023-11-28T21:08:08.376 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-11-28T21:08:08.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd2d4066470 msgr2=0x7fd2d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:08.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd2d4066470 0x7fd2d4068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0ad000 tx=0x7fd2ec0a6000 comp rx=0 tx=0).stop 2023-11-28T21:08:08.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 msgr2=0x7fd2f0070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:08.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 0x7fd2f0070390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800c730 tx=0x7fd2e800cbf0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 shutdown_connections 2023-11-28T21:08:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd2d4066470 0x7fd2d4068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f0141970 0x7fd2f0070390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2f00b3c90 0x7fd2f0142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 --2- 172.21.15.6:0/2867135197 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2f00b2510 0x7fd2f015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 >> 172.21.15.6:0/2867135197 conn(0x7fd2f00b0b00 msgr2=0x7fd2f00afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 shutdown_connections 2023-11-28T21:08:08.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.371+0000 7fd2f85d1640 1 -- 172.21.15.6:0/2867135197 wait complete. 2023-11-28T21:08:08.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T21:08:08.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.551+0000 7f910e3f5640 1 Processor -- start 2023-11-28T21:08:08.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.551+0000 7f910e3f5640 1 -- start start 2023-11-28T21:08:08.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910e3f5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f910815e370 0x7f91080ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:08.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910e3f5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f910815e750 0x7f91080cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:08.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910e3f5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91080cbd70 0x7f910815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910e3f5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91080cd730 con 0x7f91080cbd70 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910e3f5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910813d450 con 0x7f910815e370 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910e3f5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91080cec40 con 0x7f910815e750 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910c992640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91080cbd70 0x7f910815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910c992640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91080cbd70 0x7f910815a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44358/0 (socket says 172.21.15.6:44358) 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910c992640 1 -- 172.21.15.6:0/2753668109 learned_addr learned my addr 172.21.15.6:0/2753668109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f91077fe640 1 --2- 172.21.15.6:0/2753668109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f910815e750 0x7f91080cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f9107fff640 1 --2- 172.21.15.6:0/2753668109 >> v2:172.21.15.31:3300/0 conn(0x7f910815e370 0x7f91080ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910c992640 1 -- 172.21.15.6:0/2753668109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f910815e750 msgr2=0x7f91080cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910c992640 1 --2- 172.21.15.6:0/2753668109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f910815e750 0x7f91080cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910c992640 1 -- 172.21.15.6:0/2753668109 >> v2:172.21.15.31:3300/0 conn(0x7f910815e370 msgr2=0x7f91080ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:08.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910c992640 1 --2- 172.21.15.6:0/2753668109 >> v2:172.21.15.31:3300/0 conn(0x7f910815e370 0x7f91080ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.555+0000 7f910c992640 1 -- 172.21.15.6:0/2753668109 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91080cc1d0 con 0x7f91080cbd70 2023-11-28T21:08:08.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910c992640 1 --2- 172.21.15.6:0/2753668109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91080cbd70 0x7f910815a7e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f910806c9d0 tx=0x7f910001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dd1aa7e28e0297 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:08.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f9106ffd640 1 -- 172.21.15.6:0/2753668109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91000a56b0 con 0x7f91080cbd70 2023-11-28T21:08:08.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f9106ffd640 1 -- 172.21.15.6:0/2753668109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91000a5810 con 0x7f91080cbd70 2023-11-28T21:08:08.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f9106ffd640 1 -- 172.21.15.6:0/2753668109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91000a5ba0 con 0x7f91080cbd70 2023-11-28T21:08:08.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 -- 172.21.15.6:0/2753668109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91080cbd70 msgr2=0x7f910815a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:08.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 --2- 172.21.15.6:0/2753668109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91080cbd70 0x7f910815a7e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f910806c9d0 tx=0x7f910001c940 comp rx=0 tx=0).stop 2023-11-28T21:08:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 -- 172.21.15.6:0/2753668109 shutdown_connections 2023-11-28T21:08:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 --2- 172.21.15.6:0/2753668109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91080cbd70 0x7f910815a7e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 --2- 172.21.15.6:0/2753668109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f910815e750 0x7f91080cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 --2- 172.21.15.6:0/2753668109 >> v2:172.21.15.31:3300/0 conn(0x7f910815e370 0x7f91080ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 -- 172.21.15.6:0/2753668109 >> 172.21.15.6:0/2753668109 conn(0x7f910806a980 msgr2=0x7f910806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 -- 172.21.15.6:0/2753668109 shutdown_connections 2023-11-28T21:08:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 -- 172.21.15.6:0/2753668109 wait complete. 2023-11-28T21:08:08.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 Processor -- start 2023-11-28T21:08:08.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.559+0000 7f910e3f5640 1 -- start start 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910e3f5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91080cbd70 0x7f9108152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910e3f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f910815e370 0x7f9108159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910e3f5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910815e750 0x7f9108159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910e3f5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108152690 con 0x7f910815e370 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910e3f5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91080b0810 con 0x7f910815e750 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910e3f5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91080b0ab0 con 0x7f91080cbd70 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f91077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f910815e370 0x7f9108159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f91077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f910815e370 0x7f9108159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44370/0 (socket says 172.21.15.6:44370) 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f91077fe640 1 -- 172.21.15.6:0/350210903 learned_addr learned my addr 172.21.15.6:0/350210903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f9107fff640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91080cbd70 0x7f9108152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910c992640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910815e750 0x7f9108159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f91077fe640 1 -- 172.21.15.6:0/350210903 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91080cbd70 msgr2=0x7f9108152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f91077fe640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91080cbd70 0x7f9108152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f91077fe640 1 -- 172.21.15.6:0/350210903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910815e750 msgr2=0x7f9108159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f91077fe640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910815e750 0x7f9108159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f91077fe640 1 -- 172.21.15.6:0/350210903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100009b30 con 0x7f910815e370 2023-11-28T21:08:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f91077fe640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f910815e370 0x7f9108159010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00e930 tx=0x7f90fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f9104ff9640 1 -- 172.21.15.6:0/350210903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc009690 con 0x7f910815e370 2023-11-28T21:08:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f9104ff9640 1 -- 172.21.15.6:0/350210903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc00ca00 con 0x7f910815e370 2023-11-28T21:08:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91080b0d90 con 0x7f910815e370 2023-11-28T21:08:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f9104ff9640 1 -- 172.21.15.6:0/350210903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00cd70 con 0x7f910815e370 2023-11-28T21:08:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91080b1350 con 0x7f910815e370 2023-11-28T21:08:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9108072b90 con 0x7f910815e370 2023-11-28T21:08:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.563+0000 7f9104ff9640 1 -- 172.21.15.6:0/350210903 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90fc013470 con 0x7f910815e370 2023-11-28T21:08:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.567+0000 7f9104ff9640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f90f4066470 0x7f90f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.567+0000 7f9104ff9640 1 -- 172.21.15.6:0/350210903 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f90fc083dd0 con 0x7f910815e370 2023-11-28T21:08:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.567+0000 7f9107fff640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f90f4066470 0x7f90f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:08.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.567+0000 7f9107fff640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f90f4066470 0x7f90f4068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009b60 tx=0x7f90f8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:08.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.571+0000 7f9104ff9640 1 -- 172.21.15.6:0/350210903 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90fc051590 con 0x7f910815e370 2023-11-28T21:08:08.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:08.731+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f910813f540 con 0x7f910815e370 2023-11-28T21:08:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.371+0000 7f9104ff9640 1 -- 172.21.15.6:0/350210903 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f90fc0170d0 con 0x7f910815e370 2023-11-28T21:08:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-11-28T21:08:09.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f90f4066470 msgr2=0x7f90f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:09.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f90f4066470 0x7f90f4068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009b60 tx=0x7f90f8009190 comp rx=0 tx=0).stop 2023-11-28T21:08:09.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f910815e370 msgr2=0x7f9108159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:09.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f910815e370 0x7f9108159010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00e930 tx=0x7f90fc00edf0 comp rx=0 tx=0).stop 2023-11-28T21:08:09.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 shutdown_connections 2023-11-28T21:08:09.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f90f4066470 0x7f90f4068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:09.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910815e750 0x7f9108159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:09.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f910815e370 0x7f9108159010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:09.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 --2- 172.21.15.6:0/350210903 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91080cbd70 0x7f9108152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:09.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 >> 172.21.15.6:0/350210903 conn(0x7f910806a980 msgr2=0x7f9108071410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:09.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 shutdown_connections 2023-11-28T21:08:09.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.375+0000 7f910e3f5640 1 -- 172.21.15.6:0/350210903 wait complete. 2023-11-28T21:08:09.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T21:08:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f995d0640 1 Processor -- start 2023-11-28T21:08:09.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f995d0640 1 -- start start 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f995d0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f940cffe0 0x7f7f940b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f995d0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f940d0d10 con 0x7f7f940d1c20 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f995d0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f940c98a0 con 0x7f7f940c94c0 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f995d0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f940d3a50 con 0x7f7f940cffe0 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f937fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7f940d1c20 0x7f7f940cdd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58112/0 (socket says 172.21.15.6:58112) 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f937fe640 1 -- 172.21.15.6:0/803119400 learned_addr learned my addr 172.21.15.6:0/803119400 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f98dcf640 1 --2- 172.21.15.6:0/803119400 >> v2:172.21.15.31:3300/0 conn(0x7f7f940cffe0 0x7f7f940b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.571+0000 7f7f92ffd640 1 -- 172.21.15.6:0/803119400 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83543378 0 0) 0x7f7f940d0d10 con 0x7f7f940d1c20 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.575+0000 7f7f92ffd640 1 -- 172.21.15.6:0/803119400 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f7c003530 con 0x7f7f940d1c20 2023-11-28T21:08:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.575+0000 7f7f98dcf640 1 -- 172.21.15.6:0/803119400 >> v1:172.21.15.31:6789/0 conn(0x7f7f940c94c0 legacy=0x7f7f940d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:09.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.575+0000 7f7f98dcf640 1 -- 172.21.15.6:0/803119400 >> v1:172.21.15.6:6789/0 conn(0x7f7f940d1c20 legacy=0x7f7f940cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:09.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.575+0000 7f7f98dcf640 1 -- 172.21.15.6:0/803119400 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f940b46f0 con 0x7f7f940cffe0 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.575+0000 7f7f98dcf640 1 --2- 172.21.15.6:0/803119400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940cffe0 0x7f7f940b3eb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009d90 tx=0x7f7f8c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ed0c276bbdc8341 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.575+0000 7f7f92ffd640 1 -- 172.21.15.6:0/803119400 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0a59e0 con 0x7f7f940cffe0 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.575+0000 7f7f92ffd640 1 -- 172.21.15.6:0/803119400 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c0a5b40 con 0x7f7f940cffe0 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.575+0000 7f7f92ffd640 1 -- 172.21.15.6:0/803119400 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0ad440 con 0x7f7f940cffe0 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 -- 172.21.15.6:0/803119400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940cffe0 msgr2=0x7f7f940b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 --2- 172.21.15.6:0/803119400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940cffe0 0x7f7f940b3eb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009d90 tx=0x7f7f8c01c920 comp rx=0 tx=0).stop 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 -- 172.21.15.6:0/803119400 shutdown_connections 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 --2- 172.21.15.6:0/803119400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940cffe0 0x7f7f940b3eb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 -- 172.21.15.6:0/803119400 >> 172.21.15.6:0/803119400 conn(0x7f7f940d2f30 msgr2=0x7f7f940d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:09.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 -- 172.21.15.6:0/803119400 shutdown_connections 2023-11-28T21:08:09.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 -- 172.21.15.6:0/803119400 wait complete. 2023-11-28T21:08:09.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 Processor -- start 2023-11-28T21:08:09.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 -- start start 2023-11-28T21:08:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940c94c0 0x7f7f941483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f940cffe0 0x7f7f940b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f940d1c20 0x7f7f9406bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940b7870 con 0x7f7f940cffe0 2023-11-28T21:08:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940b7b50 con 0x7f7f940c94c0 2023-11-28T21:08:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f995d0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940b7e30 con 0x7f7f940d1c20 2023-11-28T21:08:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f940cffe0 0x7f7f940b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f940cffe0 0x7f7f940b6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44378/0 (socket says 172.21.15.6:44378) 2023-11-28T21:08:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f937fe640 1 -- 172.21.15.6:0/3144882080 learned_addr learned my addr 172.21.15.6:0/3144882080 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f98dcf640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f940d1c20 0x7f7f9406bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f93fff640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940c94c0 0x7f7f941483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f937fe640 1 -- 172.21.15.6:0/3144882080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f940d1c20 msgr2=0x7f7f9406bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f937fe640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f940d1c20 0x7f7f9406bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f937fe640 1 -- 172.21.15.6:0/3144882080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940c94c0 msgr2=0x7f7f941483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f937fe640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940c94c0 0x7f7f941483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f937fe640 1 -- 172.21.15.6:0/3144882080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c009a70 con 0x7f7f940cffe0 2023-11-28T21:08:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.579+0000 7f7f93fff640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940c94c0 0x7f7f941483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f937fe640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f940cffe0 0x7f7f940b6f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800c4d0 tx=0x7f7f8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:09.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f90ff9640 1 -- 172.21.15.6:0/3144882080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88005cf0 con 0x7f7f940cffe0 2023-11-28T21:08:09.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f90ff9640 1 -- 172.21.15.6:0/3144882080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f88005e50 con 0x7f7f940cffe0 2023-11-28T21:08:09.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f90ff9640 1 -- 172.21.15.6:0/3144882080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88007270 con 0x7f7f940cffe0 2023-11-28T21:08:09.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f940b8110 con 0x7f7f940cffe0 2023-11-28T21:08:09.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f941488e0 con 0x7f7f940cffe0 2023-11-28T21:08:09.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f9404e850 con 0x7f7f940cffe0 2023-11-28T21:08:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f90ff9640 1 -- 172.21.15.6:0/3144882080 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7f880073d0 con 0x7f7f940cffe0 2023-11-28T21:08:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f90ff9640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7f80066470 0x7f7f80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f90ff9640 1 -- 172.21.15.6:0/3144882080 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7f88083410 con 0x7f7f940cffe0 2023-11-28T21:08:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.583+0000 7f7f93fff640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7f80066470 0x7f7f80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.587+0000 7f7f93fff640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7f80066470 0x7f7f80068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f940b2140 tx=0x7f7f84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.591+0000 7f7f90ff9640 1 -- 172.21.15.6:0/3144882080 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7f88050900 con 0x7f7f940cffe0 2023-11-28T21:08:09.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:09.779+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7f940d12f0 con 0x7f7f940cffe0 2023-11-28T21:08:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.403+0000 7f7f90ff9640 1 -- 172.21.15.6:0/3144882080 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7f88053f20 con 0x7f7f940cffe0 2023-11-28T21:08:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2023-11-28T21:08:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.403+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7f80066470 msgr2=0x7f7f80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.403+0000 7f7f995d0640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7f80066470 0x7f7f80068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f940b2140 tx=0x7f7f84009040 comp rx=0 tx=0).stop 2023-11-28T21:08:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f940cffe0 msgr2=0x7f7f940b6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f940cffe0 0x7f7f940b6f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800c4d0 tx=0x7f7f8800c990 comp rx=0 tx=0).stop 2023-11-28T21:08:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 shutdown_connections 2023-11-28T21:08:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7f80066470 0x7f7f80068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f940d1c20 0x7f7f9406bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f940cffe0 0x7f7f940b6f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 --2- 172.21.15.6:0/3144882080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f940c94c0 0x7f7f941483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 >> 172.21.15.6:0/3144882080 conn(0x7f7f940d2f30 msgr2=0x7f7f940d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 shutdown_connections 2023-11-28T21:08:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.407+0000 7f7f995d0640 1 -- 172.21.15.6:0/3144882080 wait complete. 2023-11-28T21:08:10.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:10.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48ca5aa640 1 Processor -- start 2023-11-28T21:08:10.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48ca5aa640 1 -- start start 2023-11-28T21:08:10.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48ca5aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48c40d1880 0x7f48c41605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48ca5aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48c40b2550 0x7f48c4160b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48ca5aa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48c40d3a50 0x7f48c40b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48ca5aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c40aff60 con 0x7f48c40d1880 2023-11-28T21:08:10.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48ca5aa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c40b0240 con 0x7f48c40d3a50 2023-11-28T21:08:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48ca5aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40b0520 con 0x7f48c40b2550 2023-11-28T21:08:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48c40d1880 0x7f48c41605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48c40d1880 0x7f48c41605c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44386/0 (socket says 172.21.15.6:44386) 2023-11-28T21:08:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c3fff640 1 -- 172.21.15.6:0/3992643579 learned_addr learned my addr 172.21.15.6:0/3992643579 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c3fff640 1 -- 172.21.15.6:0/3992643579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48c40b2550 msgr2=0x7f48c4160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c3fff640 1 --2- 172.21.15.6:0/3992643579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48c40b2550 0x7f48c4160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c3fff640 1 -- 172.21.15.6:0/3992643579 >> v2:172.21.15.31:3300/0 conn(0x7f48c40d3a50 msgr2=0x7f48c40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c8b47640 1 --2- 172.21.15.6:0/3992643579 >> v2:172.21.15.31:3300/0 conn(0x7f48c40d3a50 0x7f48c40b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c3fff640 1 --2- 172.21.15.6:0/3992643579 >> v2:172.21.15.31:3300/0 conn(0x7f48c40d3a50 0x7f48c40b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c3fff640 1 -- 172.21.15.6:0/3992643579 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40b0800 con 0x7f48c40d1880 2023-11-28T21:08:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.583+0000 7f48c8b47640 1 --2- 172.21.15.6:0/3992643579 >> v2:172.21.15.31:3300/0 conn(0x7f48c40d3a50 0x7f48c40b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:10.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48c3fff640 1 --2- 172.21.15.6:0/3992643579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d1880 0x7f48c41605c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48c408c590 tx=0x7f48b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3278d5b26c7c5f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:10.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48c2ffd640 1 -- 172.21.15.6:0/3992643579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40aa640 con 0x7f48c40d1880 2023-11-28T21:08:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48c2ffd640 1 -- 172.21.15.6:0/3992643579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b40aa7a0 con 0x7f48c40d1880 2023-11-28T21:08:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48c2ffd640 1 -- 172.21.15.6:0/3992643579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40aab30 con 0x7f48c40d1880 2023-11-28T21:08:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48ca5aa640 1 -- 172.21.15.6:0/3992643579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d1880 msgr2=0x7f48c41605c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/3992643579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d1880 0x7f48c41605c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48c408c590 tx=0x7f48b401c500 comp rx=0 tx=0).stop 2023-11-28T21:08:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48ca5aa640 1 -- 172.21.15.6:0/3992643579 shutdown_connections 2023-11-28T21:08:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/3992643579 >> v2:172.21.15.31:3300/0 conn(0x7f48c40d3a50 0x7f48c40b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/3992643579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48c40b2550 0x7f48c4160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/3992643579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d1880 0x7f48c41605c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48ca5aa640 1 -- 172.21.15.6:0/3992643579 >> 172.21.15.6:0/3992643579 conn(0x7f48c409c460 msgr2=0x7f48c40d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48ca5aa640 1 -- 172.21.15.6:0/3992643579 shutdown_connections 2023-11-28T21:08:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.587+0000 7f48ca5aa640 1 -- 172.21.15.6:0/3992643579 wait complete. 2023-11-28T21:08:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48ca5aa640 1 Processor -- start 2023-11-28T21:08:10.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48ca5aa640 1 -- start start 2023-11-28T21:08:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48ca5aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2550 0x7f48c415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48ca5aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48c40d1880 0x7f48c40c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48ca5aa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48c40d3a50 0x7f48c415f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48ca5aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c415e090 con 0x7f48c40b2550 2023-11-28T21:08:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48ca5aa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c415d480 con 0x7f48c40d3a50 2023-11-28T21:08:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48ca5aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c415d760 con 0x7f48c40d1880 2023-11-28T21:08:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2550 0x7f48c415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2550 0x7f48c415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44394/0 (socket says 172.21.15.6:44394) 2023-11-28T21:08:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c3fff640 1 -- 172.21.15.6:0/2354768849 learned_addr learned my addr 172.21.15.6:0/2354768849 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c37fe640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48c40d1880 0x7f48c40c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c8b47640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48c40d3a50 0x7f48c415f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c3fff640 1 -- 172.21.15.6:0/2354768849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48c40d1880 msgr2=0x7f48c40c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c3fff640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48c40d1880 0x7f48c40c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c3fff640 1 -- 172.21.15.6:0/2354768849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48c40d3a50 msgr2=0x7f48c415f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c3fff640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48c40d3a50 0x7f48c415f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c3fff640 1 -- 172.21.15.6:0/2354768849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b40094d0 con 0x7f48c40b2550 2023-11-28T21:08:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c3fff640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2550 0x7f48c415e520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48b40ac040 tx=0x7f48b401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c0ff9640 1 -- 172.21.15.6:0/2354768849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40b3800 con 0x7f48c40b2550 2023-11-28T21:08:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c0ff9640 1 -- 172.21.15.6:0/2354768849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b40b3980 con 0x7f48c40b2550 2023-11-28T21:08:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48c0ff9640 1 -- 172.21.15.6:0/2354768849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40b3d30 con 0x7f48c40b2550 2023-11-28T21:08:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.591+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c415da40 con 0x7f48c40b2550 2023-11-28T21:08:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.595+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c415bf30 con 0x7f48c40b2550 2023-11-28T21:08:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.595+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c40674d0 con 0x7f48c40b2550 2023-11-28T21:08:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.595+0000 7f48c0ff9640 1 -- 172.21.15.6:0/2354768849 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48b40a8050 con 0x7f48c40b2550 2023-11-28T21:08:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.595+0000 7f48c0ff9640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f48b0066470 0x7f48b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.595+0000 7f48c0ff9640 1 -- 172.21.15.6:0/2354768849 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48b411e300 con 0x7f48c40b2550 2023-11-28T21:08:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.595+0000 7f48c37fe640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f48b0066470 0x7f48b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.595+0000 7f48c37fe640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f48b0066470 0x7f48b0068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ccc50 tx=0x7f48b8009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.599+0000 7f48c0ff9640 1 -- 172.21.15.6:0/2354768849 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48b40eb830 con 0x7f48c40b2550 2023-11-28T21:08:10.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.759+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48c415d8a0 con 0x7f48c40b2550 2023-11-28T21:08:10.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48c0ff9640 1 -- 172.21.15.6:0/2354768849 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16410 (secure 0 0 0) 0x7f48c415d8a0 con 0x7f48c40b2550 2023-11-28T21:08:10.768 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:10.768 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:09.785083+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:10.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f48b0066470 msgr2=0x7f48b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f48b0066470 0x7f48b0068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ccc50 tx=0x7f48b8009110 comp rx=0 tx=0).stop 2023-11-28T21:08:10.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2550 msgr2=0x7f48c415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2550 0x7f48c415e520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48b40ac040 tx=0x7f48b401ad40 comp rx=0 tx=0).stop 2023-11-28T21:08:10.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 shutdown_connections 2023-11-28T21:08:10.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f48b0066470 0x7f48b0068930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48c40d3a50 0x7f48c415f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f48c40d1880 0x7f48c40c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 --2- 172.21.15.6:0/2354768849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2550 0x7f48c415e520 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 >> 172.21.15.6:0/2354768849 conn(0x7f48c409c460 msgr2=0x7f48c40c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:10.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 shutdown_connections 2023-11-28T21:08:10.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.763+0000 7f48ca5aa640 1 -- 172.21.15.6:0/2354768849 wait complete. 2023-11-28T21:08:10.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:10.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb7d6e3640 1 Processor -- start 2023-11-28T21:08:10.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb7d6e3640 1 -- start start 2023-11-28T21:08:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb7d6e3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb7813e090 0x7fbb780cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb7d6e3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb78140e90 0x7fbb7806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb7d6e3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb780cea50 con 0x7fbb7815c250 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb7d6e3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb7813e470 con 0x7fbb78140e90 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb7d6e3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780ce1b0 con 0x7fbb7813e090 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb6ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb7815c250 0x7fbb78140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58126/0 (socket says 172.21.15.6:58126) 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb6ffff640 1 -- 172.21.15.6:0/2896015604 learned_addr learned my addr 172.21.15.6:0/2896015604 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb76ffd640 1 --2- 172.21.15.6:0/2896015604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb7813e090 0x7fbb780cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.927+0000 7fbb777fe640 1 --2- 172.21.15.6:0/2896015604 >> v2:172.21.15.31:3300/0 conn(0x7fbb78140e90 0x7fbb7806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb767fc640 1 -- 172.21.15.6:0/2896015604 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999636485 0 0) 0x7fbb780cea50 con 0x7fbb7815c250 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb767fc640 1 -- 172.21.15.6:0/2896015604 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb64003530 con 0x7fbb7815c250 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb76ffd640 1 -- 172.21.15.6:0/2896015604 >> v2:172.21.15.31:3300/0 conn(0x7fbb78140e90 msgr2=0x7fbb7806cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb76ffd640 1 --2- 172.21.15.6:0/2896015604 >> v2:172.21.15.31:3300/0 conn(0x7fbb78140e90 0x7fbb7806cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb76ffd640 1 -- 172.21.15.6:0/2896015604 >> v1:172.21.15.6:6789/0 conn(0x7fbb7815c250 legacy=0x7fbb78140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb76ffd640 1 -- 172.21.15.6:0/2896015604 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780ce490 con 0x7fbb7813e090 2023-11-28T21:08:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb76ffd640 1 --2- 172.21.15.6:0/2896015604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb7813e090 0x7fbb780cd740 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbb680097c0 tx=0x7fbb6801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d359e9c99aa31a07 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb767fc640 1 -- 172.21.15.6:0/2896015604 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680ac620 con 0x7fbb7813e090 2023-11-28T21:08:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb767fc640 1 -- 172.21.15.6:0/2896015604 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb680ac780 con 0x7fbb7813e090 2023-11-28T21:08:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.931+0000 7fbb767fc640 1 -- 172.21.15.6:0/2896015604 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680acb10 con 0x7fbb7813e090 2023-11-28T21:08:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2896015604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb7813e090 msgr2=0x7fbb780cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 --2- 172.21.15.6:0/2896015604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb7813e090 0x7fbb780cd740 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbb680097c0 tx=0x7fbb6801c3c0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2896015604 shutdown_connections 2023-11-28T21:08:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 --2- 172.21.15.6:0/2896015604 >> v2:172.21.15.31:3300/0 conn(0x7fbb78140e90 0x7fbb7806cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 --2- 172.21.15.6:0/2896015604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb7813e090 0x7fbb780cd740 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2896015604 >> 172.21.15.6:0/2896015604 conn(0x7fbb7806ab80 msgr2=0x7fbb780b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2896015604 shutdown_connections 2023-11-28T21:08:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2896015604 wait complete. 2023-11-28T21:08:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 Processor -- start 2023-11-28T21:08:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 -- start start 2023-11-28T21:08:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7813e090 0x7fbb781414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb78140e90 0x7fbb7813d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7815c250 0x7fbb780a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780a9fe0 con 0x7fbb7813e090 2023-11-28T21:08:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78141aa0 con 0x7fbb7815c250 2023-11-28T21:08:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb7d6e3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78141d80 con 0x7fbb78140e90 2023-11-28T21:08:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb76ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7813e090 0x7fbb781414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb78140e90 0x7fbb7813d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb76ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7813e090 0x7fbb781414c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44398/0 (socket says 172.21.15.6:44398) 2023-11-28T21:08:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb76ffd640 1 -- 172.21.15.6:0/2642704586 learned_addr learned my addr 172.21.15.6:0/2642704586 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb777fe640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7815c250 0x7fbb780a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb76ffd640 1 -- 172.21.15.6:0/2642704586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb78140e90 msgr2=0x7fbb7813d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb76ffd640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb78140e90 0x7fbb7813d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb76ffd640 1 -- 172.21.15.6:0/2642704586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7815c250 msgr2=0x7fbb780a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:10.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb76ffd640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7815c250 0x7fbb780a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.935+0000 7fbb76ffd640 1 -- 172.21.15.6:0/2642704586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68009420 con 0x7fbb7813e090 2023-11-28T21:08:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb76ffd640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7813e090 0x7fbb781414c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb68019ff0 tx=0x7fbb6801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb6f7fe640 1 -- 172.21.15.6:0/2642704586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680ac620 con 0x7fbb7813e090 2023-11-28T21:08:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb6f7fe640 1 -- 172.21.15.6:0/2642704586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb680b8450 con 0x7fbb7813e090 2023-11-28T21:08:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb6f7fe640 1 -- 172.21.15.6:0/2642704586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb680b87e0 con 0x7fbb7813e090 2023-11-28T21:08:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb78142060 con 0x7fbb7813e090 2023-11-28T21:08:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb78142620 con 0x7fbb7813e090 2023-11-28T21:08:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb780674d0 con 0x7fbb7813e090 2023-11-28T21:08:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb6f7fe640 1 -- 172.21.15.6:0/2642704586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbb680aa070 con 0x7fbb7813e090 2023-11-28T21:08:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb6f7fe640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbb58066470 0x7fbb58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb6f7fe640 1 -- 172.21.15.6:0/2642704586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb6811e270 con 0x7fbb7813e090 2023-11-28T21:08:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb6ffff640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbb58066470 0x7fbb58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:10.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.939+0000 7fbb6ffff640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbb58066470 0x7fbb58068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb7815c970 tx=0x7fbb60007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:10.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:10.943+0000 7fbb6f7fe640 1 -- 172.21.15.6:0/2642704586 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb680eb790 con 0x7fbb7813e090 2023-11-28T21:08:11.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb780ae290 con 0x7fbb7813e090 2023-11-28T21:08:11.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb6f7fe640 1 -- 172.21.15.6:0/2642704586 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16410 (secure 0 0 0) 0x7fbb680eedb0 con 0x7fbb7813e090 2023-11-28T21:08:11.109 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:11.109 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:09.785083+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbb58066470 msgr2=0x7fbb58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbb58066470 0x7fbb58068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbb7815c970 tx=0x7fbb60007d40 comp rx=0 tx=0).stop 2023-11-28T21:08:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7813e090 msgr2=0x7fbb781414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7813e090 0x7fbb781414c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb68019ff0 tx=0x7fbb6801ac00 comp rx=0 tx=0).stop 2023-11-28T21:08:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 shutdown_connections 2023-11-28T21:08:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbb58066470 0x7fbb58068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb7815c250 0x7fbb780a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb78140e90 0x7fbb7813d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 --2- 172.21.15.6:0/2642704586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7813e090 0x7fbb781414c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 >> 172.21.15.6:0/2642704586 conn(0x7fbb7806ab80 msgr2=0x7fbb780723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 shutdown_connections 2023-11-28T21:08:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.103+0000 7fbb7d6e3640 1 -- 172.21.15.6:0/2642704586 wait complete. 2023-11-28T21:08:11.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T21:08:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.271+0000 7f7b0bdf8640 1 Processor -- start 2023-11-28T21:08:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.271+0000 7f7b0bdf8640 1 -- start start 2023-11-28T21:08:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.271+0000 7f7b0bdf8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b040b42e0 0x7f7b0406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.271+0000 7f7b0bdf8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b04157bd0 con 0x7f7b0415d780 2023-11-28T21:08:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.271+0000 7f7b0bdf8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0406b2b0 con 0x7f7b0415e270 2023-11-28T21:08:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.271+0000 7f7b0bdf8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0406b590 con 0x7f7b040b42e0 2023-11-28T21:08:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b09b94640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7b0415d780 0x7f7b0415db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58132/0 (socket says 172.21.15.6:58132) 2023-11-28T21:08:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b09b94640 1 -- 172.21.15.6:0/2686298413 learned_addr learned my addr 172.21.15.6:0/2686298413 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b09393640 1 --2- 172.21.15.6:0/2686298413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b040b42e0 0x7f7b0406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b08b92640 1 -- 172.21.15.6:0/2686298413 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287341838 0 0) 0x7f7b04157bd0 con 0x7f7b0415d780 2023-11-28T21:08:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b08b92640 1 -- 172.21.15.6:0/2686298413 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af0003530 con 0x7f7b0415d780 2023-11-28T21:08:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b08b92640 1 -- 172.21.15.6:0/2686298413 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138506199 0 0) 0x7f7b0406b2b0 con 0x7f7b0415e270 2023-11-28T21:08:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b08b92640 1 -- 172.21.15.6:0/2686298413 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b04157bd0 con 0x7f7b0415e270 2023-11-28T21:08:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b09393640 1 -- 172.21.15.6:0/2686298413 >> v1:172.21.15.31:6789/0 conn(0x7f7b0415e270 legacy=0x7f7b0406aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b09393640 1 -- 172.21.15.6:0/2686298413 >> v1:172.21.15.6:6789/0 conn(0x7f7b0415d780 legacy=0x7f7b0415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b09393640 1 -- 172.21.15.6:0/2686298413 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0406b870 con 0x7f7b040b42e0 2023-11-28T21:08:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b09393640 1 --2- 172.21.15.6:0/2686298413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b040b42e0 0x7f7b0406a580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7af40097f0 tx=0x7f7af401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e70c931039339c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.275+0000 7f7b08b92640 1 -- 172.21.15.6:0/2686298413 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40aa5f0 con 0x7f7b040b42e0 2023-11-28T21:08:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b08b92640 1 -- 172.21.15.6:0/2686298413 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af40aa750 con 0x7f7b040b42e0 2023-11-28T21:08:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b08b92640 1 -- 172.21.15.6:0/2686298413 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40aaac0 con 0x7f7b040b42e0 2023-11-28T21:08:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/2686298413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b040b42e0 msgr2=0x7f7b0406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 --2- 172.21.15.6:0/2686298413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b040b42e0 0x7f7b0406a580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7af40097f0 tx=0x7f7af401c490 comp rx=0 tx=0).stop 2023-11-28T21:08:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/2686298413 shutdown_connections 2023-11-28T21:08:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 --2- 172.21.15.6:0/2686298413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b040b42e0 0x7f7b0406a580 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/2686298413 >> 172.21.15.6:0/2686298413 conn(0x7f7b040b1670 msgr2=0x7f7b040b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/2686298413 shutdown_connections 2023-11-28T21:08:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/2686298413 wait complete. 2023-11-28T21:08:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 Processor -- start 2023-11-28T21:08:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 -- start start 2023-11-28T21:08:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b040b42e0 0x7f7b041543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b0415d780 0x7f7b04153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0415e270 0x7f7b04149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0414f2f0 con 0x7f7b040b42e0 2023-11-28T21:08:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0414f5d0 con 0x7f7b0415e270 2023-11-28T21:08:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0bdf8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0414f8b0 con 0x7f7b0415d780 2023-11-28T21:08:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b09b94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b040b42e0 0x7f7b041543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b09b94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b040b42e0 0x7f7b041543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44404/0 (socket says 172.21.15.6:44404) 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b09b94640 1 -- 172.21.15.6:0/3339794265 learned_addr learned my addr 172.21.15.6:0/3339794265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b09393640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b0415d780 0x7f7b04153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.279+0000 7f7b0a395640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0415e270 0x7f7b04149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b09b94640 1 -- 172.21.15.6:0/3339794265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b0415d780 msgr2=0x7f7b04153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b09b94640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b0415d780 0x7f7b04153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b09b94640 1 -- 172.21.15.6:0/3339794265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0415e270 msgr2=0x7f7b04149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b09b94640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0415e270 0x7f7b04149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b09b94640 1 -- 172.21.15.6:0/3339794265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af4009420 con 0x7f7b040b42e0 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b09b94640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b040b42e0 0x7f7b041543d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c4d0 tx=0x7f7b0000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7afa7fc640 1 -- 172.21.15.6:0/3339794265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00005cf0 con 0x7f7b040b42e0 2023-11-28T21:08:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7afa7fc640 1 -- 172.21.15.6:0/3339794265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b00005e50 con 0x7f7b040b42e0 2023-11-28T21:08:11.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0406d670 con 0x7f7b040b42e0 2023-11-28T21:08:11.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7afa7fc640 1 -- 172.21.15.6:0/3339794265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00007270 con 0x7f7b040b42e0 2023-11-28T21:08:11.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b041538d0 con 0x7f7b040b42e0 2023-11-28T21:08:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0406d8b0 con 0x7f7b040b42e0 2023-11-28T21:08:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7afa7fc640 1 -- 172.21.15.6:0/3339794265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b000073d0 con 0x7f7b040b42e0 2023-11-28T21:08:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7afa7fc640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ae80664a0 0x7f7ae8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7afa7fc640 1 -- 172.21.15.6:0/3339794265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b000832c0 con 0x7f7b040b42e0 2023-11-28T21:08:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.283+0000 7f7b09393640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ae80664a0 0x7f7ae8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.287+0000 7f7b09393640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ae80664a0 0x7f7ae8068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7af40ae000 tx=0x7f7af40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.287+0000 7f7afa7fc640 1 -- 172.21.15.6:0/3339794265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b0406d8b0 con 0x7f7b040b42e0 2023-11-28T21:08:11.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:11.483+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7b0406d8b0 con 0x7f7b040b42e0 2023-11-28T21:08:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7afa7fc640 1 -- 172.21.15.6:0/3339794265 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7b0406d8b0 con 0x7f7b040b42e0 2023-11-28T21:08:12.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ae80664a0 msgr2=0x7f7ae8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:12.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ae80664a0 0x7f7ae8068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7af40ae000 tx=0x7f7af40a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:12.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b040b42e0 msgr2=0x7f7b041543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:12.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b040b42e0 0x7f7b041543d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c4d0 tx=0x7f7b0000c990 comp rx=0 tx=0).stop 2023-11-28T21:08:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 shutdown_connections 2023-11-28T21:08:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ae80664a0 0x7f7ae8068960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b0415e270 0x7f7b04149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b0415d780 0x7f7b04153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 --2- 172.21.15.6:0/3339794265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b040b42e0 0x7f7b041543d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 >> 172.21.15.6:0/3339794265 conn(0x7f7b040b1670 msgr2=0x7f7b040b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 shutdown_connections 2023-11-28T21:08:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.427+0000 7f7b0bdf8640 1 -- 172.21.15.6:0/3339794265 wait complete. 2023-11-28T21:08:12.459 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T21:08:12.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T21:08:12.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7af98d640 1 Processor -- start 2023-11-28T21:08:12.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7af98d640 1 -- start start 2023-11-28T21:08:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7af98d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7a806d060 0x7ff7a80cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7af98d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80b2850 con 0x7ff7a814b0e0 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7af98d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80b2b30 con 0x7ff7a80b1e70 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7af98d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a814b4c0 con 0x7ff7a806d060 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7ad729640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff7a814b0e0 0x7ff7a80b38f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58134/0 (socket says 172.21.15.6:58134) 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7ad729640 1 -- 172.21.15.6:0/3745687680 learned_addr learned my addr 172.21.15.6:0/3745687680 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7adf2a640 1 --2- 172.21.15.6:0/3745687680 >> v2:172.21.15.31:3300/0 conn(0x7ff7a806d060 0x7ff7a80cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343362222 0 0) 0x7ff7a80b2850 con 0x7ff7a814b0e0 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff794003530 con 0x7ff7a814b0e0 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3125435373 0 0) 0x7ff794003530 con 0x7ff7a814b0e0 2023-11-28T21:08:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 >> v2:172.21.15.31:3300/0 conn(0x7ff7a806d060 msgr2=0x7ff7a80cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 --2- 172.21.15.6:0/3745687680 >> v2:172.21.15.31:3300/0 conn(0x7ff7a806d060 0x7ff7a80cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 >> v1:172.21.15.31:6789/0 conn(0x7ff7a80b1e70 legacy=0x7ff7a806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80b2e10 con 0x7ff7a814b0e0 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7ff7a4001680 con 0x7ff7a814b0e0 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7adf2a640 1 --2- 172.21.15.6:0/3745687680 >> v2:172.21.15.31:3300/0 conn(0x7ff7a806d060 0x7ff7a80cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 >> v1:172.21.15.6:6789/0 conn(0x7ff7a814b0e0 legacy=0x7ff7a80b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff794003980 0x7ff794003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940047d0 0x7ff794004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff794005190 0x7ff79400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79400c000 con 0x7ff794005190 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79400c170 con 0x7ff7940047d0 2023-11-28T21:08:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79400c330 con 0x7ff794003980 2023-11-28T21:08:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7acf28640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940047d0 0x7ff794004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7adf2a640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff794005190 0x7ff79400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7ad729640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff794003980 0x7ff794003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7adf2a640 1 -- 172.21.15.6:0/3745687680 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff794003980 msgr2=0x7ff794003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7adf2a640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff794003980 0x7ff794003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7adf2a640 1 -- 172.21.15.6:0/3745687680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940047d0 msgr2=0x7ff794004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7adf2a640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940047d0 0x7ff794004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7adf2a640 1 -- 172.21.15.6:0/3745687680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794003530 con 0x7ff794005190 2023-11-28T21:08:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.611+0000 7ff7acf28640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7940047d0 0x7ff794004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff7adf2a640 1 -- 172.21.15.6:0/3745687680 reap_dead start 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff7adf2a640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff794005190 0x7ff79400b990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000e350 tx=0x7ff7a001ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c665a8ff5ef3297 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a00a5e70 con 0x7ff794005190 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a000f040 con 0x7ff794005190 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff79ffff640 1 -- 172.21.15.6:0/3745687680 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0003be0 con 0x7ff794005190 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff7af98d640 1 -- 172.21.15.6:0/3745687680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff794005190 msgr2=0x7ff79400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff7af98d640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff794005190 0x7ff79400b990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000e350 tx=0x7ff7a001ce60 comp rx=0 tx=0).stop 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff7af98d640 1 -- 172.21.15.6:0/3745687680 shutdown_connections 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff7af98d640 1 --2- 172.21.15.6:0/3745687680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff794005190 0x7ff79400b990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff7af98d640 1 -- 172.21.15.6:0/3745687680 >> 172.21.15.6:0/3745687680 conn(0x7ff7a806a980 msgr2=0x7ff7a806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff7af98d640 1 -- 172.21.15.6:0/3745687680 shutdown_connections 2023-11-28T21:08:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.615+0000 7ff7af98d640 1 -- 172.21.15.6:0/3745687680 wait complete. 2023-11-28T21:08:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7af98d640 1 Processor -- start 2023-11-28T21:08:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7af98d640 1 -- start start 2023-11-28T21:08:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7af98d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff794005190 0x7ff7a8162080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7af98d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7a8140dd0 0x7ff7a8141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7af98d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8141250 0x7ff7a8145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7af98d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8144690 con 0x7ff7a8141250 2023-11-28T21:08:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7af98d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8144970 con 0x7ff794005190 2023-11-28T21:08:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7af98d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8144c50 con 0x7ff7a8140dd0 2023-11-28T21:08:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7adf2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8141250 0x7ff7a8145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7adf2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8141250 0x7ff7a8145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44420/0 (socket says 172.21.15.6:44420) 2023-11-28T21:08:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7adf2a640 1 -- 172.21.15.6:0/3764596109 learned_addr learned my addr 172.21.15.6:0/3764596109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7acf28640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7a8140dd0 0x7ff7a8141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7ad729640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff794005190 0x7ff7a8162080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7adf2a640 1 -- 172.21.15.6:0/3764596109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7a8140dd0 msgr2=0x7ff7a8141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7adf2a640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7a8140dd0 0x7ff7a8141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7adf2a640 1 -- 172.21.15.6:0/3764596109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff794005190 msgr2=0x7ff7a8162080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7adf2a640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff794005190 0x7ff7a8162080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7adf2a640 1 -- 172.21.15.6:0/3764596109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8144f30 con 0x7ff7a8141250 2023-11-28T21:08:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7acf28640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7a8140dd0 0x7ff7a8141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7adf2a640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8141250 0x7ff7a8145730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7a001d700 tx=0x7ff7a0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff79dffb640 1 -- 172.21.15.6:0/3764596109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a00bd070 con 0x7ff7a8141250 2023-11-28T21:08:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff79dffb640 1 -- 172.21.15.6:0/3764596109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a00aeef0 con 0x7ff7a8141250 2023-11-28T21:08:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff79dffb640 1 -- 172.21.15.6:0/3764596109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0003be0 con 0x7ff7a8141250 2023-11-28T21:08:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.619+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a8145210 con 0x7ff7a8141250 2023-11-28T21:08:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.623+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a8142120 con 0x7ff7a8141250 2023-11-28T21:08:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.623+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a8072b90 con 0x7ff7a8141250 2023-11-28T21:08:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.623+0000 7ff79dffb640 1 -- 172.21.15.6:0/3764596109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7a0003d40 con 0x7ff7a8141250 2023-11-28T21:08:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.623+0000 7ff79dffb640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff78c066470 0x7ff78c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.623+0000 7ff79dffb640 1 -- 172.21.15.6:0/3764596109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7a011f210 con 0x7ff7a8141250 2023-11-28T21:08:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.623+0000 7ff7ad729640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff78c066470 0x7ff78c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.623+0000 7ff7ad729640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff78c066470 0x7ff78c068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4000c10 tx=0x7ff7a4000ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.627+0000 7ff79dffb640 1 -- 172.21.15.6:0/3764596109 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7a00ec680 con 0x7ff7a8141250 2023-11-28T21:08:12.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:12.819+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff7a8068620 con 0x7ff7a8141250 2023-11-28T21:08:12.943 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-28T21:08:12.935+0000 7f0bf37b0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T21:08:13.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.431+0000 7ff79dffb640 1 -- 172.21.15.6:0/3764596109 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff7a0009de0 con 0x7ff7a8141250 2023-11-28T21:08:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff78c066470 msgr2=0x7ff78c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff78c066470 0x7ff78c068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4000c10 tx=0x7ff7a4000ee0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8141250 msgr2=0x7ff7a8145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8141250 0x7ff7a8145730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7a001d700 tx=0x7ff7a0009750 comp rx=0 tx=0).stop 2023-11-28T21:08:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 shutdown_connections 2023-11-28T21:08:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff78c066470 0x7ff78c068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a8141250 0x7ff7a8145730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7a8140dd0 0x7ff7a8141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 --2- 172.21.15.6:0/3764596109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff794005190 0x7ff7a8162080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 >> 172.21.15.6:0/3764596109 conn(0x7ff7a806a980 msgr2=0x7ff7a815e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 shutdown_connections 2023-11-28T21:08:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.435+0000 7ff7af98d640 1 -- 172.21.15.6:0/3764596109 wait complete. 2023-11-28T21:08:13.462 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T21:08:13.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:08:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a8d96640 1 Processor -- start 2023-11-28T21:08:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a8d96640 1 -- start start 2023-11-28T21:08:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a8d96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc2a406dd90 0x7fc2a4071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a8d96640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc2a415e7d0 0x7fc2a40b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a8d96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a415e340 con 0x7fc2a4142da0 2023-11-28T21:08:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a8d96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a415dae0 con 0x7fc2a406dd90 2023-11-28T21:08:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a8d96640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a40b39b0 con 0x7fc2a415e7d0 2023-11-28T21:08:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc29bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc2a406dd90 0x7fc2a4071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc2a4142da0 0x7fc2a406d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58136/0 (socket says 172.21.15.6:58136) 2023-11-28T21:08:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a259c640 1 -- 172.21.15.6:0/1836358269 learned_addr learned my addr 172.21.15.6:0/1836358269 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc2a2d9d640 1 --2- 172.21.15.6:0/1836358269 >> v2:172.21.15.31:3300/0 conn(0x7fc2a415e7d0 0x7fc2a40b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc29bfff640 1 -- 172.21.15.6:0/1836358269 >> v2:172.21.15.31:3300/0 conn(0x7fc2a415e7d0 msgr2=0x7fc2a40b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc29bfff640 1 --2- 172.21.15.6:0/1836358269 >> v2:172.21.15.31:3300/0 conn(0x7fc2a415e7d0 0x7fc2a40b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc29bfff640 1 -- 172.21.15.6:0/1836358269 >> v1:172.21.15.6:6789/0 conn(0x7fc2a4142da0 legacy=0x7fc2a406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.603+0000 7fc29bfff640 1 -- 172.21.15.6:0/1836358269 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4143440 con 0x7fc2a406dd90 2023-11-28T21:08:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc29bfff640 1 --2- 172.21.15.6:0/1836358269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a406dd90 0x7fc2a4071fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40b3670 tx=0x7fc28c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de5ec024c3dedbb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a1d9b640 1 -- 172.21.15.6:0/1836358269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0a7070 con 0x7fc2a406dd90 2023-11-28T21:08:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a1d9b640 1 -- 172.21.15.6:0/1836358269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c0ab430 con 0x7fc2a406dd90 2023-11-28T21:08:13.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a1d9b640 1 -- 172.21.15.6:0/1836358269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0ab7c0 con 0x7fc2a406dd90 2023-11-28T21:08:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a8d96640 1 -- 172.21.15.6:0/1836358269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a406dd90 msgr2=0x7fc2a4071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a8d96640 1 --2- 172.21.15.6:0/1836358269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a406dd90 0x7fc2a4071fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40b3670 tx=0x7fc28c01c430 comp rx=0 tx=0).stop 2023-11-28T21:08:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a8d96640 1 -- 172.21.15.6:0/1836358269 shutdown_connections 2023-11-28T21:08:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a8d96640 1 --2- 172.21.15.6:0/1836358269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a406dd90 0x7fc2a4071fb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a8d96640 1 --2- 172.21.15.6:0/1836358269 >> v2:172.21.15.31:3300/0 conn(0x7fc2a415e7d0 0x7fc2a40b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a8d96640 1 -- 172.21.15.6:0/1836358269 >> 172.21.15.6:0/1836358269 conn(0x7fc2a406ab80 msgr2=0x7fc2a40b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a8d96640 1 -- 172.21.15.6:0/1836358269 shutdown_connections 2023-11-28T21:08:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.607+0000 7fc2a8d96640 1 -- 172.21.15.6:0/1836358269 wait complete. 2023-11-28T21:08:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a8d96640 1 Processor -- start 2023-11-28T21:08:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a8d96640 1 -- start start 2023-11-28T21:08:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a8d96640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2a406dd90 0x7fc2a4135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a8d96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a4142da0 0x7fc2a40ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a8d96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a415e7d0 0x7fc2a40afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a8d96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a40ced40 con 0x7fc2a4142da0 2023-11-28T21:08:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a8d96640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a40cf020 con 0x7fc2a415e7d0 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a8d96640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a40cf300 con 0x7fc2a406dd90 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a4142da0 0x7fc2a40ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a4142da0 0x7fc2a40ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44434/0 (socket says 172.21.15.6:44434) 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29bfff640 1 -- 172.21.15.6:0/2103732037 learned_addr learned my addr 172.21.15.6:0/2103732037 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a259c640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2a406dd90 0x7fc2a4135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29bfff640 1 -- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2a406dd90 msgr2=0x7fc2a4135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29bfff640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2a406dd90 0x7fc2a4135cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29bfff640 1 -- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a415e7d0 msgr2=0x7fc2a40afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a2d9d640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a415e7d0 0x7fc2a40afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29bfff640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a415e7d0 0x7fc2a40afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29bfff640 1 -- 172.21.15.6:0/2103732037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c009420 con 0x7fc2a4142da0 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a259c640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2a406dd90 0x7fc2a4135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:13.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc2a2d9d640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a415e7d0 0x7fc2a40afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29bfff640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a4142da0 0x7fc2a40ce2d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc28c019040 tx=0x7fc28c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29affd640 1 -- 172.21.15.6:0/2103732037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0b5810 con 0x7fc2a4142da0 2023-11-28T21:08:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.611+0000 7fc29affd640 1 -- 172.21.15.6:0/2103732037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c0b5990 con 0x7fc2a4142da0 2023-11-28T21:08:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.615+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a40cf5e0 con 0x7fc2a4142da0 2023-11-28T21:08:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.615+0000 7fc29affd640 1 -- 172.21.15.6:0/2103732037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0b5d40 con 0x7fc2a4142da0 2023-11-28T21:08:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.615+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a41423c0 con 0x7fc2a4142da0 2023-11-28T21:08:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.615+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a40674d0 con 0x7fc2a4142da0 2023-11-28T21:08:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.615+0000 7fc29affd640 1 -- 172.21.15.6:0/2103732037 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc28c0bf410 con 0x7fc2a4142da0 2023-11-28T21:08:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.615+0000 7fc29affd640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc284066470 0x7fc284068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.615+0000 7fc29affd640 1 -- 172.21.15.6:0/2103732037 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc28c11e790 con 0x7fc2a4142da0 2023-11-28T21:08:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.615+0000 7fc2a259c640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc284066470 0x7fc284068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.615+0000 7fc2a259c640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc284066470 0x7fc284068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc294005890 tx=0x7fc294009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:13.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.619+0000 7fc29affd640 1 -- 172.21.15.6:0/2103732037 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc28c0ebe70 con 0x7fc2a4142da0 2023-11-28T21:08:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.807+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2a40b3010 con 0x7fc2a4142da0 2023-11-28T21:08:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc29affd640 1 -- 172.21.15.6:0/2103732037 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7fc28c006e20 con 0x7fc2a4142da0 2023-11-28T21:08:13.816 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:13.816 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2017265312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2017265312},{"type":"v1","addr":"172.21.15.6:6837","nonce":2017265312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2658515931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2658515931},{"type":"v1","addr":"172.21.15.31:6834","nonce":2658515931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3368809777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3368809777},{"type":"v1","addr":"172.21.15.31:6835","nonce":3368809777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:08:09.785431+0000","modified":"2023-11-28T21:08:12.826904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:08:13.816 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-11-28T21:08:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc284066470 msgr2=0x7fc284068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc284066470 0x7fc284068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc294005890 tx=0x7fc294009040 comp rx=0 tx=0).stop 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a4142da0 msgr2=0x7fc2a40ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a4142da0 0x7fc2a40ce2d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc28c019040 tx=0x7fc28c01ac70 comp rx=0 tx=0).stop 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 shutdown_connections 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc284066470 0x7fc284068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2a415e7d0 0x7fc2a40afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a4142da0 0x7fc2a40ce2d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 --2- 172.21.15.6:0/2103732037 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2a406dd90 0x7fc2a4135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 >> 172.21.15.6:0/2103732037 conn(0x7fc2a406ab80 msgr2=0x7fc2a40aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 shutdown_connections 2023-11-28T21:08:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.811+0000 7fc2a8d96640 1 -- 172.21.15.6:0/2103732037 wait complete. 2023-11-28T21:08:13.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:13.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5abdf640 1 Processor -- start 2023-11-28T21:08:13.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5abdf640 1 -- start start 2023-11-28T21:08:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5abdf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf540b2550 0x7faf540b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5abdf640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf540aff60 con 0x7faf540d1880 2023-11-28T21:08:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5abdf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf540b0240 con 0x7faf54160cd0 2023-11-28T21:08:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5abdf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf540b0520 con 0x7faf540b2550 2023-11-28T21:08:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5897b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faf540d1880 0x7faf541605c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58150/0 (socket says 172.21.15.6:58150) 2023-11-28T21:08:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5897b640 1 -- 172.21.15.6:0/1899126136 learned_addr learned my addr 172.21.15.6:0/1899126136 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5917c640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf540b2550 0x7faf540b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625371578 0 0) 0x7faf540aff60 con 0x7faf540d1880 2023-11-28T21:08:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf44003530 con 0x7faf540d1880 2023-11-28T21:08:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070411938 0 0) 0x7faf540b0240 con 0x7faf54160cd0 2023-11-28T21:08:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf540aff60 con 0x7faf54160cd0 2023-11-28T21:08:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2104807739 0 0) 0x7faf44003530 con 0x7faf540d1880 2023-11-28T21:08:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf540b2550 msgr2=0x7faf540b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf540b2550 0x7faf540b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 >> v1:172.21.15.31:6789/0 conn(0x7faf54160cd0 legacy=0x7faf540b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540b0800 con 0x7faf540d1880 2023-11-28T21:08:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7faf48001680 con 0x7faf540d1880 2023-11-28T21:08:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 >> v1:172.21.15.6:6789/0 conn(0x7faf540d1880 legacy=0x7faf541605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf540b2550 0x7faf44003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf440040f0 0x7faf440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf44004d10 0x7faf44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540b0520 con 0x7faf44004d10 2023-11-28T21:08:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4400bad0 con 0x7faf440040f0 2023-11-28T21:08:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4400bc90 con 0x7faf540b2550 2023-11-28T21:08:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5917c640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf44004d10 0x7faf44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5897b640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf540b2550 0x7faf44003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf53fff640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf440040f0 0x7faf440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5917c640 1 -- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf540b2550 msgr2=0x7faf44003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5917c640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf540b2550 0x7faf44003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5917c640 1 -- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf440040f0 msgr2=0x7faf440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:13.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5917c640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf440040f0 0x7faf440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.975+0000 7faf5917c640 1 -- 172.21.15.6:0/1899126136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf44003530 con 0x7faf44004d10 2023-11-28T21:08:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf5917c640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf44004d10 0x7faf44005190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009fc0 tx=0x7faf4c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6c5474508b6a61 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0a5b60 con 0x7faf44004d10 2023-11-28T21:08:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c00f040 con 0x7faf44004d10 2023-11-28T21:08:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf537fe640 1 -- 172.21.15.6:0/1899126136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0ad440 con 0x7faf44004d10 2023-11-28T21:08:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf5abdf640 1 -- 172.21.15.6:0/1899126136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf44004d10 msgr2=0x7faf44005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf5abdf640 1 --2- 172.21.15.6:0/1899126136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf44004d10 0x7faf44005190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009fc0 tx=0x7faf4c01cc60 comp rx=0 tx=0).stop 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf5917c640 1 -- 172.21.15.6:0/1899126136 reap_dead start 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf5abdf640 1 -- 172.21.15.6:0/1899126136 shutdown_connections 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf5abdf640 1 -- 172.21.15.6:0/1899126136 >> 172.21.15.6:0/1899126136 conn(0x7faf5409c460 msgr2=0x7faf540d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf5abdf640 1 -- 172.21.15.6:0/1899126136 shutdown_connections 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.979+0000 7faf5abdf640 1 -- 172.21.15.6:0/1899126136 wait complete. 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 Processor -- start 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 -- start start 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf44004d10 0x7faf5414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf540c8a80 0x7faf540b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf540b8070 0x7faf5406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540c85f0 con 0x7faf540b8070 2023-11-28T21:08:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540c79e0 con 0x7faf540c8a80 2023-11-28T21:08:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf540c7cc0 con 0x7faf44004d10 2023-11-28T21:08:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5917c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf540b8070 0x7faf5406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5917c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf540b8070 0x7faf5406bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44460/0 (socket says 172.21.15.6:44460) 2023-11-28T21:08:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5917c640 1 -- 172.21.15.6:0/2942219781 learned_addr learned my addr 172.21.15.6:0/2942219781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf53fff640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf540c8a80 0x7faf540b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5897b640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf44004d10 0x7faf5414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5917c640 1 -- 172.21.15.6:0/2942219781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf44004d10 msgr2=0x7faf5414f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5917c640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf44004d10 0x7faf5414f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5917c640 1 -- 172.21.15.6:0/2942219781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf540c8a80 msgr2=0x7faf540b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5917c640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf540c8a80 0x7faf540b7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5917c640 1 -- 172.21.15.6:0/2942219781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540c7fa0 con 0x7faf540b8070 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5897b640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf44004d10 0x7faf5414f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5917c640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf540b8070 0x7faf5406bd20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf4c002240 tx=0x7faf4c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf517fa640 1 -- 172.21.15.6:0/2942219781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0039a0 con 0x7faf540b8070 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf517fa640 1 -- 172.21.15.6:0/2942219781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c003b00 con 0x7faf540b8070 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf517fa640 1 -- 172.21.15.6:0/2942219781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c003e70 con 0x7faf540b8070 2023-11-28T21:08:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf540c8280 con 0x7faf540b8070 2023-11-28T21:08:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.983+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf540c7670 con 0x7faf540b8070 2023-11-28T21:08:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.987+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf540674d0 con 0x7faf540b8070 2023-11-28T21:08:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.987+0000 7faf517fa640 1 -- 172.21.15.6:0/2942219781 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf4c0b4040 con 0x7faf540b8070 2023-11-28T21:08:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.987+0000 7faf517fa640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faf38066470 0x7faf38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.987+0000 7faf517fa640 1 -- 172.21.15.6:0/2942219781 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf4c11d760 con 0x7faf540b8070 2023-11-28T21:08:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.987+0000 7faf5897b640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faf38066470 0x7faf38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.987+0000 7faf5897b640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faf38066470 0x7faf38068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faf48000c10 tx=0x7faf48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:13.991+0000 7faf517fa640 1 -- 172.21.15.6:0/2942219781 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf4c0eab60 con 0x7faf540b8070 2023-11-28T21:08:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.147+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf54068520 con 0x7faf540b8070 2023-11-28T21:08:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf517fa640 1 -- 172.21.15.6:0/2942219781 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7faf4c0b2020 con 0x7faf540b8070 2023-11-28T21:08:14.156 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:14.156 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faf38066470 msgr2=0x7faf38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faf38066470 0x7faf38068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faf48000c10 tx=0x7faf48009040 comp rx=0 tx=0).stop 2023-11-28T21:08:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf540b8070 msgr2=0x7faf5406bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf540b8070 0x7faf5406bd20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf4c002240 tx=0x7faf4c009750 comp rx=0 tx=0).stop 2023-11-28T21:08:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 shutdown_connections 2023-11-28T21:08:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faf38066470 0x7faf38068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf540b8070 0x7faf5406bd20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf540c8a80 0x7faf540b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 --2- 172.21.15.6:0/2942219781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf44004d10 0x7faf5414f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 >> 172.21.15.6:0/2942219781 conn(0x7faf5409c460 msgr2=0x7faf5415f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 shutdown_connections 2023-11-28T21:08:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.151+0000 7faf5abdf640 1 -- 172.21.15.6:0/2942219781 wait complete. 2023-11-28T21:08:14.178 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T21:08:14.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:08:14.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe717f2a640 1 Processor -- start 2023-11-28T21:08:14.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe717f2a640 1 -- start start 2023-11-28T21:08:14.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe717f2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe71013e090 0x7fe7100cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe717f2a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100cea50 con 0x7fe71015c250 2023-11-28T21:08:14.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe717f2a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7100ce1b0 con 0x7fe710140e90 2023-11-28T21:08:14.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe717f2a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71013e470 con 0x7fe71013e090 2023-11-28T21:08:14.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe7154c5640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe71015c250 0x7fe710140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58152/0 (socket says 172.21.15.6:58152) 2023-11-28T21:08:14.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe7154c5640 1 -- 172.21.15.6:0/1628291484 learned_addr learned my addr 172.21.15.6:0/1628291484 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:14.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe715cc6640 1 --2- 172.21.15.6:0/1628291484 >> v2:172.21.15.31:3300/0 conn(0x7fe71013e090 0x7fe7100cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201139268 0 0) 0x7fe7100cea50 con 0x7fe71015c250 2023-11-28T21:08:14.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.315+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6fc003530 con 0x7fe71015c250 2023-11-28T21:08:14.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 528316326 0 0) 0x7fe6fc003530 con 0x7fe71015c250 2023-11-28T21:08:14.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 >> v2:172.21.15.31:3300/0 conn(0x7fe71013e090 msgr2=0x7fe7100cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:14.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 --2- 172.21.15.6:0/1628291484 >> v2:172.21.15.31:3300/0 conn(0x7fe71013e090 0x7fe7100cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 >> v1:172.21.15.31:6789/0 conn(0x7fe710140e90 legacy=0x7fe71006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100ce490 con 0x7fe71015c250 2023-11-28T21:08:14.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fe700001680 con 0x7fe71015c250 2023-11-28T21:08:14.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 >> v1:172.21.15.6:6789/0 conn(0x7fe71015c250 legacy=0x7fe710140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe6fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6fc0047d0 0x7fe6fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6fc005190 0x7fe6fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71013e470 con 0x7fe6fc003980 2023-11-28T21:08:14.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc00c130 con 0x7fe6fc0047d0 2023-11-28T21:08:14.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc00c2f0 con 0x7fe6fc005190 2023-11-28T21:08:14.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe715cc6640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe6fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe7154c5640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6fc0047d0 0x7fe6fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe7164c7640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6fc005190 0x7fe6fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe715cc6640 1 -- 172.21.15.6:0/1628291484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6fc005190 msgr2=0x7fe6fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:14.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe715cc6640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6fc005190 0x7fe6fc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe715cc6640 1 -- 172.21.15.6:0/1628291484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6fc0047d0 msgr2=0x7fe6fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:14.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe715cc6640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6fc0047d0 0x7fe6fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe715cc6640 1 -- 172.21.15.6:0/1628291484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc003530 con 0x7fe6fc003980 2023-11-28T21:08:14.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe7154c5640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6fc0047d0 0x7fe6fc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:14.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe7164c7640 1 -- 172.21.15.6:0/1628291484 reap_dead start 2023-11-28T21:08:14.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.319+0000 7fe715cc6640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe6fc003da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009ac0 tx=0x7fe70c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7dc1138a29ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:14.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0a55d0 con 0x7fe6fc003980 2023-11-28T21:08:14.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c0a5730 con 0x7fe6fc003980 2023-11-28T21:08:14.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe714cc4640 1 -- 172.21.15.6:0/1628291484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0a58c0 con 0x7fe6fc003980 2023-11-28T21:08:14.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 -- 172.21.15.6:0/1628291484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 msgr2=0x7fe6fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe6fc003da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009ac0 tx=0x7fe70c01ca00 comp rx=0 tx=0).stop 2023-11-28T21:08:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 -- 172.21.15.6:0/1628291484 shutdown_connections 2023-11-28T21:08:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 --2- 172.21.15.6:0/1628291484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe6fc003da0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 -- 172.21.15.6:0/1628291484 >> 172.21.15.6:0/1628291484 conn(0x7fe71006ab80 msgr2=0x7fe7100b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 -- 172.21.15.6:0/1628291484 shutdown_connections 2023-11-28T21:08:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 -- 172.21.15.6:0/1628291484 wait complete. 2023-11-28T21:08:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 Processor -- start 2023-11-28T21:08:14.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 -- start start 2023-11-28T21:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe710072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe71013cbb0 0x7fe7101439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe71013d030 0x7fe710143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710142e90 con 0x7fe6fc003980 2023-11-28T21:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710071920 con 0x7fe71013d030 2023-11-28T21:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe717f2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe710070f80 con 0x7fe71013cbb0 2023-11-28T21:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe715cc6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe710072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe715cc6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe710072110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44466/0 (socket says 172.21.15.6:44466) 2023-11-28T21:08:14.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe715cc6640 1 -- 172.21.15.6:0/1277325193 learned_addr learned my addr 172.21.15.6:0/1277325193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe7164c7640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe71013d030 0x7fe710143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.323+0000 7fe7154c5640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe71013cbb0 0x7fe7101439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe715cc6640 1 -- 172.21.15.6:0/1277325193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe71013cbb0 msgr2=0x7fe7101439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe715cc6640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe71013cbb0 0x7fe7101439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe715cc6640 1 -- 172.21.15.6:0/1277325193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe71013d030 msgr2=0x7fe710143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe715cc6640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe71013d030 0x7fe710143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe715cc6640 1 -- 172.21.15.6:0/1277325193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710071260 con 0x7fe6fc003980 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe7164c7640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe71013d030 0x7fe710143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe715cc6640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe710072110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009ac0 tx=0x7fe70c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe7067fc640 1 -- 172.21.15.6:0/1277325193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0b8440 con 0x7fe6fc003980 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe7067fc640 1 -- 172.21.15.6:0/1277325193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c0b85a0 con 0x7fe6fc003980 2023-11-28T21:08:14.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe7067fc640 1 -- 172.21.15.6:0/1277325193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0b8950 con 0x7fe6fc003980 2023-11-28T21:08:14.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe710071540 con 0x7fe6fc003980 2023-11-28T21:08:14.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7101f6170 con 0x7fe6fc003980 2023-11-28T21:08:14.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71015aff0 con 0x7fe6fc003980 2023-11-28T21:08:14.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe7067fc640 1 -- 172.21.15.6:0/1277325193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe70c0b4040 con 0x7fe6fc003980 2023-11-28T21:08:14.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe7067fc640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe6f4066470 0x7fe6f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe7067fc640 1 -- 172.21.15.6:0/1277325193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe70c11d660 con 0x7fe6fc003980 2023-11-28T21:08:14.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.327+0000 7fe7154c5640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe6f4066470 0x7fe6f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.331+0000 7fe7154c5640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe6f4066470 0x7fe6f4068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe7101431f0 tx=0x7fe700009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:14.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.331+0000 7fe7067fc640 1 -- 172.21.15.6:0/1277325193 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe70c0eaaf0 con 0x7fe6fc003980 2023-11-28T21:08:14.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.487+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7100674d0 con 0x7fe6f4066470 2023-11-28T21:08:14.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.495+0000 7fe7067fc640 1 -- 172.21.15.6:0/1277325193 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+255592 (secure 0 0 0) 0x7fe7100674d0 con 0x7fe6f4066470 2023-11-28T21:08:14.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-28T21:08:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe6f4066470 msgr2=0x7fe6f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe6f4066470 0x7fe6f4068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe7101431f0 tx=0x7fe700009040 comp rx=0 tx=0).stop 2023-11-28T21:08:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 msgr2=0x7fe710072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe710072110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009ac0 tx=0x7fe70c0197a0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 shutdown_connections 2023-11-28T21:08:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe6f4066470 0x7fe6f4068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe71013d030 0x7fe710143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe71013cbb0 0x7fe7101439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 --2- 172.21.15.6:0/1277325193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc003980 0x7fe710072110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 >> 172.21.15.6:0/1277325193 conn(0x7fe71006ab80 msgr2=0x7fe71015a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 shutdown_connections 2023-11-28T21:08:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.499+0000 7fe717f2a640 1 -- 172.21.15.6:0/1277325193 wait complete. 2023-11-28T21:08:14.525 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-28T21:08:12.653220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":219364,"kb_used_data":2572,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755356,"statfs":{"total":773094113280,"available":772869484544,"internally_reserved":0,"allocated":2633728,"data_stored":1628731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.277230"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193106+0000","last_change":"2023-11-28T21:08:10.219531+0000","last_active":"2023-11-28T21:08:11.193106+0000","last_peered":"2023-11-28T21:08:11.193106+0000","last_clean":"2023-11-28T21:08:11.193106+0000","last_became_active":"2023-11-28T21:08:10.219219+0000","last_became_peered":"2023-11-28T21:08:10.219219+0000","last_unstale":"2023-11-28T21:08:11.193106+0000","last_undegraded":"2023-11-28T21:08:11.193106+0000","last_fullsized":"2023-11-28T21:08:11.193106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426406+0000","last_change":"2023-11-28T21:08:10.214525+0000","last_active":"2023-11-28T21:08:11.426406+0000","last_peered":"2023-11-28T21:08:11.426406+0000","last_clean":"2023-11-28T21:08:11.426406+0000","last_became_active":"2023-11-28T21:08:10.207834+0000","last_became_peered":"2023-11-28T21:08:10.207834+0000","last_unstale":"2023-11-28T21:08:11.426406+0000","last_undegraded":"2023-11-28T21:08:11.426406+0000","last_fullsized":"2023-11-28T21:08:11.426406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:58.849892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426821+0000","last_change":"2023-11-28T21:08:10.219243+0000","last_active":"2023-11-28T21:08:11.426821+0000","last_peered":"2023-11-28T21:08:11.426821+0000","last_clean":"2023-11-28T21:08:11.426821+0000","last_became_active":"2023-11-28T21:08:10.218641+0000","last_became_peered":"2023-11-28T21:08:10.218641+0000","last_unstale":"2023-11-28T21:08:11.426821+0000","last_undegraded":"2023-11-28T21:08:11.426821+0000","last_fullsized":"2023-11-28T21:08:11.426821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:47:10.269501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427310+0000","last_change":"2023-11-28T21:08:10.214392+0000","last_active":"2023-11-28T21:08:11.427310+0000","last_peered":"2023-11-28T21:08:11.427310+0000","last_clean":"2023-11-28T21:08:11.427310+0000","last_became_active":"2023-11-28T21:08:10.214074+0000","last_became_peered":"2023-11-28T21:08:10.214074+0000","last_unstale":"2023-11-28T21:08:11.427310+0000","last_undegraded":"2023-11-28T21:08:11.427310+0000","last_fullsized":"2023-11-28T21:08:11.427310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:58.192436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426020+0000","last_change":"2023-11-28T21:08:10.215067+0000","last_active":"2023-11-28T21:08:11.426020+0000","last_peered":"2023-11-28T21:08:11.426020+0000","last_clean":"2023-11-28T21:08:11.426020+0000","last_became_active":"2023-11-28T21:08:10.209787+0000","last_became_peered":"2023-11-28T21:08:10.209787+0000","last_unstale":"2023-11-28T21:08:11.426020+0000","last_undegraded":"2023-11-28T21:08:11.426020+0000","last_fullsized":"2023-11-28T21:08:11.426020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:25.410328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192859+0000","last_change":"2023-11-28T21:08:10.204388+0000","last_active":"2023-11-28T21:08:11.192859+0000","last_peered":"2023-11-28T21:08:11.192859+0000","last_clean":"2023-11-28T21:08:11.192859+0000","last_became_active":"2023-11-28T21:08:10.204131+0000","last_became_peered":"2023-11-28T21:08:10.204131+0000","last_unstale":"2023-11-28T21:08:11.192859+0000","last_undegraded":"2023-11-28T21:08:11.192859+0000","last_fullsized":"2023-11-28T21:08:11.192859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:44.030281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426278+0000","last_change":"2023-11-28T21:08:10.213322+0000","last_active":"2023-11-28T21:08:11.426278+0000","last_peered":"2023-11-28T21:08:11.426278+0000","last_clean":"2023-11-28T21:08:11.426278+0000","last_became_active":"2023-11-28T21:08:10.212677+0000","last_became_peered":"2023-11-28T21:08:10.212677+0000","last_unstale":"2023-11-28T21:08:11.426278+0000","last_undegraded":"2023-11-28T21:08:11.426278+0000","last_fullsized":"2023-11-28T21:08:11.426278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:47:10.269501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426930+0000","last_change":"2023-11-28T21:08:10.213764+0000","last_active":"2023-11-28T21:08:11.426930+0000","last_peered":"2023-11-28T21:08:11.426930+0000","last_clean":"2023-11-28T21:08:11.426930+0000","last_became_active":"2023-11-28T21:08:10.213514+0000","last_became_peered":"2023-11-28T21:08:10.213514+0000","last_unstale":"2023-11-28T21:08:11.426930+0000","last_undegraded":"2023-11-28T21:08:11.426930+0000","last_fullsized":"2023-11-28T21:08:11.426930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:58.849892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427556+0000","last_change":"2023-11-28T21:08:10.225157+0000","last_active":"2023-11-28T21:08:11.427556+0000","last_peered":"2023-11-28T21:08:11.427556+0000","last_clean":"2023-11-28T21:08:11.427556+0000","last_became_active":"2023-11-28T21:08:10.224943+0000","last_became_peered":"2023-11-28T21:08:10.224943+0000","last_unstale":"2023-11-28T21:08:11.427556+0000","last_undegraded":"2023-11-28T21:08:11.427556+0000","last_fullsized":"2023-11-28T21:08:11.427556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:39.372238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193012+0000","last_change":"2023-11-28T21:08:10.211086+0000","last_active":"2023-11-28T21:08:11.193012+0000","last_peered":"2023-11-28T21:08:11.193012+0000","last_clean":"2023-11-28T21:08:11.193012+0000","last_became_active":"2023-11-28T21:08:10.210680+0000","last_became_peered":"2023-11-28T21:08:10.210680+0000","last_unstale":"2023-11-28T21:08:11.193012+0000","last_undegraded":"2023-11-28T21:08:11.193012+0000","last_fullsized":"2023-11-28T21:08:11.193012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:07.366435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427688+0000","last_change":"2023-11-28T21:08:10.222999+0000","last_active":"2023-11-28T21:08:11.427688+0000","last_peered":"2023-11-28T21:08:11.427688+0000","last_clean":"2023-11-28T21:08:11.427688+0000","last_became_active":"2023-11-28T21:08:10.222686+0000","last_became_peered":"2023-11-28T21:08:10.222686+0000","last_unstale":"2023-11-28T21:08:11.427688+0000","last_undegraded":"2023-11-28T21:08:11.427688+0000","last_fullsized":"2023-11-28T21:08:11.427688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:15.263435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426287+0000","last_change":"2023-11-28T21:08:10.208621+0000","last_active":"2023-11-28T21:08:11.426287+0000","last_peered":"2023-11-28T21:08:11.426287+0000","last_clean":"2023-11-28T21:08:11.426287+0000","last_became_active":"2023-11-28T21:08:10.206992+0000","last_became_peered":"2023-11-28T21:08:10.206992+0000","last_unstale":"2023-11-28T21:08:11.426287+0000","last_undegraded":"2023-11-28T21:08:11.426287+0000","last_fullsized":"2023-11-28T21:08:11.426287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:58.131504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427403+0000","last_change":"2023-11-28T21:08:09.408970+0000","last_active":"2023-11-28T21:08:11.427403+0000","last_peered":"2023-11-28T21:08:11.427403+0000","last_clean":"2023-11-28T21:08:11.427403+0000","last_became_active":"2023-11-28T21:08:09.407594+0000","last_became_peered":"2023-11-28T21:08:09.407594+0000","last_unstale":"2023-11-28T21:08:11.427403+0000","last_undegraded":"2023-11-28T21:08:11.427403+0000","last_fullsized":"2023-11-28T21:08:11.427403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:52.171842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426417+0000","last_change":"2023-11-28T21:08:10.206555+0000","last_active":"2023-11-28T21:08:11.426417+0000","last_peered":"2023-11-28T21:08:11.426417+0000","last_clean":"2023-11-28T21:08:11.426417+0000","last_became_active":"2023-11-28T21:08:10.206199+0000","last_became_peered":"2023-11-28T21:08:10.206199+0000","last_unstale":"2023-11-28T21:08:11.426417+0000","last_undegraded":"2023-11-28T21:08:11.426417+0000","last_fullsized":"2023-11-28T21:08:11.426417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:43:54.997585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427006+0000","last_change":"2023-11-28T21:08:09.411063+0000","last_active":"2023-11-28T21:08:11.427006+0000","last_peered":"2023-11-28T21:08:11.427006+0000","last_clean":"2023-11-28T21:08:11.427006+0000","last_became_active":"2023-11-28T21:08:09.410772+0000","last_became_peered":"2023-11-28T21:08:09.410772+0000","last_unstale":"2023-11-28T21:08:11.427006+0000","last_undegraded":"2023-11-28T21:08:11.427006+0000","last_fullsized":"2023-11-28T21:08:11.427006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:24.407303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426871+0000","last_change":"2023-11-28T21:08:10.218510+0000","last_active":"2023-11-28T21:08:11.426871+0000","last_peered":"2023-11-28T21:08:11.426871+0000","last_clean":"2023-11-28T21:08:11.426871+0000","last_became_active":"2023-11-28T21:08:10.216099+0000","last_became_peered":"2023-11-28T21:08:10.216099+0000","last_unstale":"2023-11-28T21:08:11.426871+0000","last_undegraded":"2023-11-28T21:08:11.426871+0000","last_fullsized":"2023-11-28T21:08:11.426871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:58.131504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192789+0000","last_change":"2023-11-28T21:08:10.208767+0000","last_active":"2023-11-28T21:08:11.192789+0000","last_peered":"2023-11-28T21:08:11.192789+0000","last_clean":"2023-11-28T21:08:11.192789+0000","last_became_active":"2023-11-28T21:08:10.208461+0000","last_became_peered":"2023-11-28T21:08:10.208461+0000","last_unstale":"2023-11-28T21:08:11.192789+0000","last_undegraded":"2023-11-28T21:08:11.192789+0000","last_fullsized":"2023-11-28T21:08:11.192789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:04.311783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426696+0000","last_change":"2023-11-28T21:08:10.220356+0000","last_active":"2023-11-28T21:08:11.426696+0000","last_peered":"2023-11-28T21:08:11.426696+0000","last_clean":"2023-11-28T21:08:11.426696+0000","last_became_active":"2023-11-28T21:08:10.220024+0000","last_became_peered":"2023-11-28T21:08:10.220024+0000","last_unstale":"2023-11-28T21:08:11.426696+0000","last_undegraded":"2023-11-28T21:08:11.426696+0000","last_fullsized":"2023-11-28T21:08:11.426696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:22:29.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193017+0000","last_change":"2023-11-28T21:08:09.414108+0000","last_active":"2023-11-28T21:08:11.193017+0000","last_peered":"2023-11-28T21:08:11.193017+0000","last_clean":"2023-11-28T21:08:11.193017+0000","last_became_active":"2023-11-28T21:08:09.413780+0000","last_became_peered":"2023-11-28T21:08:09.413780+0000","last_unstale":"2023-11-28T21:08:11.193017+0000","last_undegraded":"2023-11-28T21:08:11.193017+0000","last_fullsized":"2023-11-28T21:08:11.193017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426379+0000","last_change":"2023-11-28T21:08:09.417259+0000","last_active":"2023-11-28T21:08:11.426379+0000","last_peered":"2023-11-28T21:08:11.426379+0000","last_clean":"2023-11-28T21:08:11.426379+0000","last_became_active":"2023-11-28T21:08:09.415186+0000","last_became_peered":"2023-11-28T21:08:09.415186+0000","last_unstale":"2023-11-28T21:08:11.426379+0000","last_undegraded":"2023-11-28T21:08:11.426379+0000","last_fullsized":"2023-11-28T21:08:11.426379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:51.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426183+0000","last_change":"2023-11-28T21:08:10.206745+0000","last_active":"2023-11-28T21:08:11.426183+0000","last_peered":"2023-11-28T21:08:11.426183+0000","last_clean":"2023-11-28T21:08:11.426183+0000","last_became_active":"2023-11-28T21:08:10.206444+0000","last_became_peered":"2023-11-28T21:08:10.206444+0000","last_unstale":"2023-11-28T21:08:11.426183+0000","last_undegraded":"2023-11-28T21:08:11.426183+0000","last_fullsized":"2023-11-28T21:08:11.426183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:49.158934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193206+0000","last_change":"2023-11-28T21:08:09.412288+0000","last_active":"2023-11-28T21:08:11.193206+0000","last_peered":"2023-11-28T21:08:11.193206+0000","last_clean":"2023-11-28T21:08:11.193206+0000","last_became_active":"2023-11-28T21:08:09.411979+0000","last_became_peered":"2023-11-28T21:08:09.411979+0000","last_unstale":"2023-11-28T21:08:11.193206+0000","last_undegraded":"2023-11-28T21:08:11.193206+0000","last_fullsized":"2023-11-28T21:08:11.193206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-28T21:08:00.360174+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-28T21:08:00.360174+0000","last_peered":"2023-11-28T21:08:00.360174+0000","last_clean":"2023-11-28T21:08:00.360174+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-28T21:08:00.360174+0000","last_undegraded":"2023-11-28T21:08:00.360174+0000","last_fullsized":"2023-11-28T21:08:00.360174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427140+0000","last_change":"2023-11-28T21:08:10.217383+0000","last_active":"2023-11-28T21:08:11.427140+0000","last_peered":"2023-11-28T21:08:11.427140+0000","last_clean":"2023-11-28T21:08:11.427140+0000","last_became_active":"2023-11-28T21:08:10.216734+0000","last_became_peered":"2023-11-28T21:08:10.216734+0000","last_unstale":"2023-11-28T21:08:11.427140+0000","last_undegraded":"2023-11-28T21:08:11.427140+0000","last_fullsized":"2023-11-28T21:08:11.427140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:01.305338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425829+0000","last_change":"2023-11-28T21:08:10.204009+0000","last_active":"2023-11-28T21:08:11.425829+0000","last_peered":"2023-11-28T21:08:11.425829+0000","last_clean":"2023-11-28T21:08:11.425829+0000","last_became_active":"2023-11-28T21:08:10.203603+0000","last_became_peered":"2023-11-28T21:08:10.203603+0000","last_unstale":"2023-11-28T21:08:11.425829+0000","last_undegraded":"2023-11-28T21:08:11.425829+0000","last_fullsized":"2023-11-28T21:08:11.425829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:53.174867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192833+0000","last_change":"2023-11-28T21:08:10.209590+0000","last_active":"2023-11-28T21:08:11.192833+0000","last_peered":"2023-11-28T21:08:11.192833+0000","last_clean":"2023-11-28T21:08:11.192833+0000","last_became_active":"2023-11-28T21:08:10.209147+0000","last_became_peered":"2023-11-28T21:08:10.209147+0000","last_unstale":"2023-11-28T21:08:11.192833+0000","last_undegraded":"2023-11-28T21:08:11.192833+0000","last_fullsized":"2023-11-28T21:08:11.192833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:31.482317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193185+0000","last_change":"2023-11-28T21:08:09.409041+0000","last_active":"2023-11-28T21:08:11.193185+0000","last_peered":"2023-11-28T21:08:11.193185+0000","last_clean":"2023-11-28T21:08:11.193185+0000","last_became_active":"2023-11-28T21:08:09.408341+0000","last_became_peered":"2023-11-28T21:08:09.408341+0000","last_unstale":"2023-11-28T21:08:11.193185+0000","last_undegraded":"2023-11-28T21:08:11.193185+0000","last_fullsized":"2023-11-28T21:08:11.193185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:00.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193010+0000","last_change":"2023-11-28T21:08:10.210874+0000","last_active":"2023-11-28T21:08:11.193010+0000","last_peered":"2023-11-28T21:08:11.193010+0000","last_clean":"2023-11-28T21:08:11.193010+0000","last_became_active":"2023-11-28T21:08:10.210568+0000","last_became_peered":"2023-11-28T21:08:10.210568+0000","last_unstale":"2023-11-28T21:08:11.193010+0000","last_undegraded":"2023-11-28T21:08:11.193010+0000","last_fullsized":"2023-11-28T21:08:11.193010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:44.204323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193235+0000","last_change":"2023-11-28T21:08:09.401418+0000","last_active":"2023-11-28T21:08:11.193235+0000","last_peered":"2023-11-28T21:08:11.193235+0000","last_clean":"2023-11-28T21:08:11.193235+0000","last_became_active":"2023-11-28T21:08:09.400985+0000","last_became_peered":"2023-11-28T21:08:09.400985+0000","last_unstale":"2023-11-28T21:08:11.193235+0000","last_undegraded":"2023-11-28T21:08:11.193235+0000","last_fullsized":"2023-11-28T21:08:11.193235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:37.553726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427625+0000","last_change":"2023-11-28T21:08:10.226340+0000","last_active":"2023-11-28T21:08:11.427625+0000","last_peered":"2023-11-28T21:08:11.427625+0000","last_clean":"2023-11-28T21:08:11.427625+0000","last_became_active":"2023-11-28T21:08:10.226076+0000","last_became_peered":"2023-11-28T21:08:10.226076+0000","last_unstale":"2023-11-28T21:08:11.427625+0000","last_undegraded":"2023-11-28T21:08:11.427625+0000","last_fullsized":"2023-11-28T21:08:11.427625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:55:43.036114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426552+0000","last_change":"2023-11-28T21:08:10.212660+0000","last_active":"2023-11-28T21:08:11.426552+0000","last_peered":"2023-11-28T21:08:11.426552+0000","last_clean":"2023-11-28T21:08:11.426552+0000","last_became_active":"2023-11-28T21:08:10.212355+0000","last_became_peered":"2023-11-28T21:08:10.212355+0000","last_unstale":"2023-11-28T21:08:11.426552+0000","last_undegraded":"2023-11-28T21:08:11.426552+0000","last_fullsized":"2023-11-28T21:08:11.426552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:01.305338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192883+0000","last_change":"2023-11-28T21:08:09.405284+0000","last_active":"2023-11-28T21:08:11.192883+0000","last_peered":"2023-11-28T21:08:11.192883+0000","last_clean":"2023-11-28T21:08:11.192883+0000","last_became_active":"2023-11-28T21:08:09.404853+0000","last_became_peered":"2023-11-28T21:08:09.404853+0000","last_unstale":"2023-11-28T21:08:11.192883+0000","last_undegraded":"2023-11-28T21:08:11.192883+0000","last_fullsized":"2023-11-28T21:08:11.192883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:41:22.294086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426947+0000","last_change":"2023-11-28T21:08:10.214946+0000","last_active":"2023-11-28T21:08:11.426947+0000","last_peered":"2023-11-28T21:08:11.426947+0000","last_clean":"2023-11-28T21:08:11.426947+0000","last_became_active":"2023-11-28T21:08:10.214613+0000","last_became_peered":"2023-11-28T21:08:10.214613+0000","last_unstale":"2023-11-28T21:08:11.426947+0000","last_undegraded":"2023-11-28T21:08:11.426947+0000","last_fullsized":"2023-11-28T21:08:11.426947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:43:54.997585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193073+0000","last_change":"2023-11-28T21:08:09.414632+0000","last_active":"2023-11-28T21:08:11.193073+0000","last_peered":"2023-11-28T21:08:11.193073+0000","last_clean":"2023-11-28T21:08:11.193073+0000","last_became_active":"2023-11-28T21:08:09.414302+0000","last_became_peered":"2023-11-28T21:08:09.414302+0000","last_unstale":"2023-11-28T21:08:11.193073+0000","last_undegraded":"2023-11-28T21:08:11.193073+0000","last_fullsized":"2023-11-28T21:08:11.193073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:41.385513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427365+0000","last_change":"2023-11-28T21:08:10.215986+0000","last_active":"2023-11-28T21:08:11.427365+0000","last_peered":"2023-11-28T21:08:11.427365+0000","last_clean":"2023-11-28T21:08:11.427365+0000","last_became_active":"2023-11-28T21:08:10.215655+0000","last_became_peered":"2023-11-28T21:08:10.215655+0000","last_unstale":"2023-11-28T21:08:11.427365+0000","last_undegraded":"2023-11-28T21:08:11.427365+0000","last_fullsized":"2023-11-28T21:08:11.427365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:22:29.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:09.374791+0000","last_change":"2023-11-28T21:08:09.374791+0000","last_active":"2023-11-28T21:08:09.374791+0000","last_peered":"2023-11-28T21:08:09.374791+0000","last_clean":"2023-11-28T21:08:09.374791+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:09.374791+0000","last_undegraded":"2023-11-28T21:08:09.374791+0000","last_fullsized":"2023-11-28T21:08:09.374791+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:08:08.371766+0000","last_change":"2023-11-28T21:08:08.371766+0000","last_active":"2023-11-28T21:08:08.371766+0000","last_peered":"2023-11-28T21:08:08.371766+0000","last_clean":"2023-11-28T21:08:08.371766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:08:08.371766+0000","last_undegraded":"2023-11-28T21:08:08.371766+0000","last_fullsized":"2023-11-28T21:08:08.371766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426640+0000","last_change":"2023-11-28T21:08:10.220292+0000","last_active":"2023-11-28T21:08:11.426640+0000","last_peered":"2023-11-28T21:08:11.426640+0000","last_clean":"2023-11-28T21:08:11.426640+0000","last_became_active":"2023-11-28T21:08:10.219942+0000","last_became_peered":"2023-11-28T21:08:10.219942+0000","last_unstale":"2023-11-28T21:08:11.426640+0000","last_undegraded":"2023-11-28T21:08:11.426640+0000","last_fullsized":"2023-11-28T21:08:11.426640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:58.192436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427644+0000","last_change":"2023-11-28T21:08:09.412597+0000","last_active":"2023-11-28T21:08:11.427644+0000","last_peered":"2023-11-28T21:08:11.427644+0000","last_clean":"2023-11-28T21:08:11.427644+0000","last_became_active":"2023-11-28T21:08:09.412283+0000","last_became_peered":"2023-11-28T21:08:09.412283+0000","last_unstale":"2023-11-28T21:08:11.427644+0000","last_undegraded":"2023-11-28T21:08:11.427644+0000","last_fullsized":"2023-11-28T21:08:11.427644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:48.155910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427484+0000","last_change":"2023-11-28T21:08:10.213534+0000","last_active":"2023-11-28T21:08:11.427484+0000","last_peered":"2023-11-28T21:08:11.427484+0000","last_clean":"2023-11-28T21:08:11.427484+0000","last_became_active":"2023-11-28T21:08:10.213241+0000","last_became_peered":"2023-11-28T21:08:10.213241+0000","last_unstale":"2023-11-28T21:08:11.427484+0000","last_undegraded":"2023-11-28T21:08:11.427484+0000","last_fullsized":"2023-11-28T21:08:11.427484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426727+0000","last_change":"2023-11-28T21:08:09.410083+0000","last_active":"2023-11-28T21:08:11.426727+0000","last_peered":"2023-11-28T21:08:11.426727+0000","last_clean":"2023-11-28T21:08:11.426727+0000","last_became_active":"2023-11-28T21:08:09.409731+0000","last_became_peered":"2023-11-28T21:08:09.409731+0000","last_unstale":"2023-11-28T21:08:11.426727+0000","last_undegraded":"2023-11-28T21:08:11.426727+0000","last_fullsized":"2023-11-28T21:08:11.426727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.177983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":22,"acting":22,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28380,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343460,"statfs":{"total":96636764160,"available":96607703040,"internally_reserved":0,"allocated":753664,"data_stored":637416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":159744,"data_stored":47048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":663221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:08:14.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:08:14.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4fe91640 1 Processor -- start 2023-11-28T21:08:14.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4fe91640 1 -- start start 2023-11-28T21:08:14.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4fe91640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a4815f230 0x7f6a480b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4fe91640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48162890 0x7f6a480705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4fe91640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6a48070b20 0x7f6a481651e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4fe91640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a48070f90 con 0x7f6a4815f230 2023-11-28T21:08:14.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4fe91640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a480b32c0 con 0x7f6a48070b20 2023-11-28T21:08:14.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4fe91640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4815f610 con 0x7f6a48162890 2023-11-28T21:08:14.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4dc2d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a4815f230 0x7f6a480b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4dc2d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a4815f230 0x7f6a480b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44474/0 (socket says 172.21.15.6:44474) 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4dc2d640 1 -- 172.21.15.6:0/3686204466 learned_addr learned my addr 172.21.15.6:0/3686204466 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4e42e640 1 --2- 172.21.15.6:0/3686204466 >> v2:172.21.15.31:3300/0 conn(0x7f6a48070b20 0x7f6a481651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4dc2d640 1 -- 172.21.15.6:0/3686204466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48162890 msgr2=0x7f6a480705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.703+0000 7f6a4d42c640 1 --2- 172.21.15.6:0/3686204466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48162890 0x7f6a480705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4dc2d640 1 --2- 172.21.15.6:0/3686204466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48162890 0x7f6a480705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4dc2d640 1 -- 172.21.15.6:0/3686204466 >> v2:172.21.15.31:3300/0 conn(0x7f6a48070b20 msgr2=0x7f6a481651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4dc2d640 1 --2- 172.21.15.6:0/3686204466 >> v2:172.21.15.31:3300/0 conn(0x7f6a48070b20 0x7f6a481651e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4dc2d640 1 -- 172.21.15.6:0/3686204466 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480b26f0 con 0x7f6a4815f230 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4e42e640 1 --2- 172.21.15.6:0/3686204466 >> v2:172.21.15.31:3300/0 conn(0x7f6a48070b20 0x7f6a481651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4d42c640 1 --2- 172.21.15.6:0/3686204466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48162890 0x7f6a480705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:14.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4dc2d640 1 --2- 172.21.15.6:0/3686204466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a4815f230 0x7f6a480b1d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a48070360 tx=0x7f6a4401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95354c556779b29 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4cc2b640 1 -- 172.21.15.6:0/3686204466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440ab600 con 0x7f6a4815f230 2023-11-28T21:08:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4cc2b640 1 -- 172.21.15.6:0/3686204466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a440a7050 con 0x7f6a4815f230 2023-11-28T21:08:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4cc2b640 1 -- 172.21.15.6:0/3686204466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440ab980 con 0x7f6a4815f230 2023-11-28T21:08:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3686204466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a4815f230 msgr2=0x7f6a480b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3686204466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a4815f230 0x7f6a480b1d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a48070360 tx=0x7f6a4401c210 comp rx=0 tx=0).stop 2023-11-28T21:08:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3686204466 shutdown_connections 2023-11-28T21:08:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3686204466 >> v2:172.21.15.31:3300/0 conn(0x7f6a48070b20 0x7f6a481651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3686204466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48162890 0x7f6a480705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3686204466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a4815f230 0x7f6a480b1d90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.707+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3686204466 >> 172.21.15.6:0/3686204466 conn(0x7f6a4806ab80 msgr2=0x7f6a480b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:14.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3686204466 shutdown_connections 2023-11-28T21:08:14.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3686204466 wait complete. 2023-11-28T21:08:14.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 Processor -- start 2023-11-28T21:08:14.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 -- start start 2023-11-28T21:08:14.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48070b20 0x7f6a48143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a4815f230 0x7f6a48157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a48162890 0x7f6a481582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4815b4a0 con 0x7f6a48162890 2023-11-28T21:08:14.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4815b780 con 0x7f6a4815f230 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4815ba60 con 0x7f6a48070b20 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4e42e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a48162890 0x7f6a481582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4e42e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a48162890 0x7f6a481582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44482/0 (socket says 172.21.15.6:44482) 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4e42e640 1 -- 172.21.15.6:0/3208369816 learned_addr learned my addr 172.21.15.6:0/3208369816 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4e42e640 1 -- 172.21.15.6:0/3208369816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48070b20 msgr2=0x7f6a48143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4e42e640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48070b20 0x7f6a48143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4e42e640 1 -- 172.21.15.6:0/3208369816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a4815f230 msgr2=0x7f6a48157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4e42e640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a4815f230 0x7f6a48157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4e42e640 1 -- 172.21.15.6:0/3208369816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440094d0 con 0x7f6a48162890 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4e42e640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a48162890 0x7f6a481582d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000cd10 tx=0x7f6a4000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a3e7fc640 1 -- 172.21.15.6:0/3208369816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000f680 con 0x7f6a48162890 2023-11-28T21:08:14.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a3e7fc640 1 -- 172.21.15.6:0/3208369816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4000f800 con 0x7f6a48162890 2023-11-28T21:08:14.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a3e7fc640 1 -- 172.21.15.6:0/3208369816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000fbb0 con 0x7f6a48162890 2023-11-28T21:08:14.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4815bd40 con 0x7f6a48162890 2023-11-28T21:08:14.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.711+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4815c300 con 0x7f6a48162890 2023-11-28T21:08:14.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.715+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a480b3730 con 0x7f6a48162890 2023-11-28T21:08:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.715+0000 7f6a3e7fc640 1 -- 172.21.15.6:0/3208369816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6a4000b040 con 0x7f6a48162890 2023-11-28T21:08:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.715+0000 7f6a3e7fc640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6a2c066470 0x7f6a2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.715+0000 7f6a3e7fc640 1 -- 172.21.15.6:0/3208369816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a40084840 con 0x7f6a48162890 2023-11-28T21:08:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.715+0000 7f6a4dc2d640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6a2c066470 0x7f6a2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.715+0000 7f6a4dc2d640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6a2c066470 0x7f6a2c068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a440ad000 tx=0x7f6a44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.719+0000 7f6a3e7fc640 1 -- 172.21.15.6:0/3208369816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6a480b3730 con 0x7f6a48162890 2023-11-28T21:08:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.875+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a48072830 con 0x7f6a2c066470 2023-11-28T21:08:14.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.883+0000 7f6a3e7fc640 1 -- 172.21.15.6:0/3208369816 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264741 (secure 0 0 0) 0x7f6a48072830 con 0x7f6a2c066470 2023-11-28T21:08:14.891 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:14.893 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-28T21:08:14.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6a2c066470 msgr2=0x7f6a2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6a2c066470 0x7f6a2c068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a440ad000 tx=0x7f6a44008040 comp rx=0 tx=0).stop 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a48162890 msgr2=0x7f6a481582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a48162890 0x7f6a481582d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000cd10 tx=0x7f6a4000a650 comp rx=0 tx=0).stop 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 shutdown_connections 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6a2c066470 0x7f6a2c068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a48162890 0x7f6a481582d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a4815f230 0x7f6a48157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 --2- 172.21.15.6:0/3208369816 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6a48070b20 0x7f6a48143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 >> 172.21.15.6:0/3208369816 conn(0x7f6a4806ab80 msgr2=0x7f6a480caf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 shutdown_connections 2023-11-28T21:08:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:14.887+0000 7f6a4fe91640 1 -- 172.21.15.6:0/3208369816 wait complete. 2023-11-28T21:08:14.910 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-28T21:08:14.653633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2844,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2912256,"data_stored":1756976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001017"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428684+0000","last_change":"2023-11-28T21:08:10.226585+0000","last_active":"2023-11-28T21:08:11.428684+0000","last_peered":"2023-11-28T21:08:11.428684+0000","last_clean":"2023-11-28T21:08:11.428684+0000","last_became_active":"2023-11-28T21:08:10.223076+0000","last_became_peered":"2023-11-28T21:08:10.223076+0000","last_unstale":"2023-11-28T21:08:11.428684+0000","last_undegraded":"2023-11-28T21:08:11.428684+0000","last_fullsized":"2023-11-28T21:08:11.428684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:01.331246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193106+0000","last_change":"2023-11-28T21:08:10.219531+0000","last_active":"2023-11-28T21:08:11.193106+0000","last_peered":"2023-11-28T21:08:11.193106+0000","last_clean":"2023-11-28T21:08:11.193106+0000","last_became_active":"2023-11-28T21:08:10.219219+0000","last_became_peered":"2023-11-28T21:08:10.219219+0000","last_unstale":"2023-11-28T21:08:11.193106+0000","last_undegraded":"2023-11-28T21:08:11.193106+0000","last_fullsized":"2023-11-28T21:08:11.193106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426406+0000","last_change":"2023-11-28T21:08:10.214525+0000","last_active":"2023-11-28T21:08:11.426406+0000","last_peered":"2023-11-28T21:08:11.426406+0000","last_clean":"2023-11-28T21:08:11.426406+0000","last_became_active":"2023-11-28T21:08:10.207834+0000","last_became_peered":"2023-11-28T21:08:10.207834+0000","last_unstale":"2023-11-28T21:08:11.426406+0000","last_undegraded":"2023-11-28T21:08:11.426406+0000","last_fullsized":"2023-11-28T21:08:11.426406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:58.849892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427963+0000","last_change":"2023-11-28T21:08:10.218249+0000","last_active":"2023-11-28T21:08:11.427963+0000","last_peered":"2023-11-28T21:08:11.427963+0000","last_clean":"2023-11-28T21:08:11.427963+0000","last_became_active":"2023-11-28T21:08:10.217753+0000","last_became_peered":"2023-11-28T21:08:10.217753+0000","last_unstale":"2023-11-28T21:08:11.427963+0000","last_undegraded":"2023-11-28T21:08:11.427963+0000","last_fullsized":"2023-11-28T21:08:11.427963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:22.626652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428006+0000","last_change":"2023-11-28T21:08:10.226231+0000","last_active":"2023-11-28T21:08:11.428006+0000","last_peered":"2023-11-28T21:08:11.428006+0000","last_clean":"2023-11-28T21:08:11.428006+0000","last_became_active":"2023-11-28T21:08:10.222935+0000","last_became_peered":"2023-11-28T21:08:10.222935+0000","last_unstale":"2023-11-28T21:08:11.428006+0000","last_undegraded":"2023-11-28T21:08:11.428006+0000","last_fullsized":"2023-11-28T21:08:11.428006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:52.316215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428380+0000","last_change":"2023-11-28T21:08:10.221517+0000","last_active":"2023-11-28T21:08:11.428380+0000","last_peered":"2023-11-28T21:08:11.428380+0000","last_clean":"2023-11-28T21:08:11.428380+0000","last_became_active":"2023-11-28T21:08:10.221308+0000","last_became_peered":"2023-11-28T21:08:10.221308+0000","last_unstale":"2023-11-28T21:08:11.428380+0000","last_undegraded":"2023-11-28T21:08:11.428380+0000","last_fullsized":"2023-11-28T21:08:11.428380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:52.862412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427554+0000","last_change":"2023-11-28T21:08:10.224411+0000","last_active":"2023-11-28T21:08:11.427554+0000","last_peered":"2023-11-28T21:08:11.427554+0000","last_clean":"2023-11-28T21:08:11.427554+0000","last_became_active":"2023-11-28T21:08:10.222988+0000","last_became_peered":"2023-11-28T21:08:10.222988+0000","last_unstale":"2023-11-28T21:08:11.427554+0000","last_undegraded":"2023-11-28T21:08:11.427554+0000","last_fullsized":"2023-11-28T21:08:11.427554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:04.834063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426821+0000","last_change":"2023-11-28T21:08:10.219243+0000","last_active":"2023-11-28T21:08:11.426821+0000","last_peered":"2023-11-28T21:08:11.426821+0000","last_clean":"2023-11-28T21:08:11.426821+0000","last_became_active":"2023-11-28T21:08:10.218641+0000","last_became_peered":"2023-11-28T21:08:10.218641+0000","last_unstale":"2023-11-28T21:08:11.426821+0000","last_undegraded":"2023-11-28T21:08:11.426821+0000","last_fullsized":"2023-11-28T21:08:11.426821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:47:10.269501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428832+0000","last_change":"2023-11-28T21:08:10.226553+0000","last_active":"2023-11-28T21:08:11.428832+0000","last_peered":"2023-11-28T21:08:11.428832+0000","last_clean":"2023-11-28T21:08:11.428832+0000","last_became_active":"2023-11-28T21:08:10.224176+0000","last_became_peered":"2023-11-28T21:08:10.224176+0000","last_unstale":"2023-11-28T21:08:11.428832+0000","last_undegraded":"2023-11-28T21:08:11.428832+0000","last_fullsized":"2023-11-28T21:08:11.428832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:32:56.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198381+0000","last_change":"2023-11-28T21:08:10.221489+0000","last_active":"2023-11-28T21:08:11.198381+0000","last_peered":"2023-11-28T21:08:11.198381+0000","last_clean":"2023-11-28T21:08:11.198381+0000","last_became_active":"2023-11-28T21:08:10.221213+0000","last_became_peered":"2023-11-28T21:08:10.221213+0000","last_unstale":"2023-11-28T21:08:11.198381+0000","last_undegraded":"2023-11-28T21:08:11.198381+0000","last_fullsized":"2023-11-28T21:08:11.198381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:07.366435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198075+0000","last_change":"2023-11-28T21:08:10.220463+0000","last_active":"2023-11-28T21:08:11.198075+0000","last_peered":"2023-11-28T21:08:11.198075+0000","last_clean":"2023-11-28T21:08:11.198075+0000","last_became_active":"2023-11-28T21:08:10.220156+0000","last_became_peered":"2023-11-28T21:08:10.220156+0000","last_unstale":"2023-11-28T21:08:11.198075+0000","last_undegraded":"2023-11-28T21:08:11.198075+0000","last_fullsized":"2023-11-28T21:08:11.198075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:44.030281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197586+0000","last_change":"2023-11-28T21:08:10.199948+0000","last_active":"2023-11-28T21:08:11.197586+0000","last_peered":"2023-11-28T21:08:11.197586+0000","last_clean":"2023-11-28T21:08:11.197586+0000","last_became_active":"2023-11-28T21:08:10.199532+0000","last_became_peered":"2023-11-28T21:08:10.199532+0000","last_unstale":"2023-11-28T21:08:11.197586+0000","last_undegraded":"2023-11-28T21:08:11.197586+0000","last_fullsized":"2023-11-28T21:08:11.197586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:27.044594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427310+0000","last_change":"2023-11-28T21:08:10.214392+0000","last_active":"2023-11-28T21:08:11.427310+0000","last_peered":"2023-11-28T21:08:11.427310+0000","last_clean":"2023-11-28T21:08:11.427310+0000","last_became_active":"2023-11-28T21:08:10.214074+0000","last_became_peered":"2023-11-28T21:08:10.214074+0000","last_unstale":"2023-11-28T21:08:11.427310+0000","last_undegraded":"2023-11-28T21:08:11.427310+0000","last_fullsized":"2023-11-28T21:08:11.427310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:58.192436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426020+0000","last_change":"2023-11-28T21:08:10.215067+0000","last_active":"2023-11-28T21:08:11.426020+0000","last_peered":"2023-11-28T21:08:11.426020+0000","last_clean":"2023-11-28T21:08:11.426020+0000","last_became_active":"2023-11-28T21:08:10.209787+0000","last_became_peered":"2023-11-28T21:08:10.209787+0000","last_unstale":"2023-11-28T21:08:11.426020+0000","last_undegraded":"2023-11-28T21:08:11.426020+0000","last_fullsized":"2023-11-28T21:08:11.426020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:25.410328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192859+0000","last_change":"2023-11-28T21:08:10.204388+0000","last_active":"2023-11-28T21:08:11.192859+0000","last_peered":"2023-11-28T21:08:11.192859+0000","last_clean":"2023-11-28T21:08:11.192859+0000","last_became_active":"2023-11-28T21:08:10.204131+0000","last_became_peered":"2023-11-28T21:08:10.204131+0000","last_unstale":"2023-11-28T21:08:11.192859+0000","last_undegraded":"2023-11-28T21:08:11.192859+0000","last_fullsized":"2023-11-28T21:08:11.192859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:44.030281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427959+0000","last_change":"2023-11-28T21:08:10.221483+0000","last_active":"2023-11-28T21:08:11.427959+0000","last_peered":"2023-11-28T21:08:11.427959+0000","last_clean":"2023-11-28T21:08:11.427959+0000","last_became_active":"2023-11-28T21:08:10.220760+0000","last_became_peered":"2023-11-28T21:08:10.220760+0000","last_unstale":"2023-11-28T21:08:11.427959+0000","last_undegraded":"2023-11-28T21:08:11.427959+0000","last_fullsized":"2023-11-28T21:08:11.427959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428971+0000","last_change":"2023-11-28T21:08:10.225874+0000","last_active":"2023-11-28T21:08:11.428971+0000","last_peered":"2023-11-28T21:08:11.428971+0000","last_clean":"2023-11-28T21:08:11.428971+0000","last_became_active":"2023-11-28T21:08:10.225479+0000","last_became_peered":"2023-11-28T21:08:10.225479+0000","last_unstale":"2023-11-28T21:08:11.428971+0000","last_undegraded":"2023-11-28T21:08:11.428971+0000","last_fullsized":"2023-11-28T21:08:11.428971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:28.425251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425760+0000","last_change":"2023-11-28T21:08:10.211031+0000","last_active":"2023-11-28T21:08:11.425760+0000","last_peered":"2023-11-28T21:08:11.425760+0000","last_clean":"2023-11-28T21:08:11.425760+0000","last_became_active":"2023-11-28T21:08:10.210800+0000","last_became_peered":"2023-11-28T21:08:10.210800+0000","last_unstale":"2023-11-28T21:08:11.425760+0000","last_undegraded":"2023-11-28T21:08:11.425760+0000","last_fullsized":"2023-11-28T21:08:11.425760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:38.556751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429133+0000","last_change":"2023-11-28T21:08:10.227036+0000","last_active":"2023-11-28T21:08:11.429133+0000","last_peered":"2023-11-28T21:08:11.429133+0000","last_clean":"2023-11-28T21:08:11.429133+0000","last_became_active":"2023-11-28T21:08:10.225399+0000","last_became_peered":"2023-11-28T21:08:10.225399+0000","last_unstale":"2023-11-28T21:08:11.429133+0000","last_undegraded":"2023-11-28T21:08:11.429133+0000","last_fullsized":"2023-11-28T21:08:11.429133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:18.468892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198186+0000","last_change":"2023-11-28T21:08:10.203332+0000","last_active":"2023-11-28T21:08:11.198186+0000","last_peered":"2023-11-28T21:08:11.198186+0000","last_clean":"2023-11-28T21:08:11.198186+0000","last_became_active":"2023-11-28T21:08:10.202618+0000","last_became_peered":"2023-11-28T21:08:10.202618+0000","last_unstale":"2023-11-28T21:08:11.198186+0000","last_undegraded":"2023-11-28T21:08:11.198186+0000","last_fullsized":"2023-11-28T21:08:11.198186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:44.204323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426278+0000","last_change":"2023-11-28T21:08:10.213322+0000","last_active":"2023-11-28T21:08:11.426278+0000","last_peered":"2023-11-28T21:08:11.426278+0000","last_clean":"2023-11-28T21:08:11.426278+0000","last_became_active":"2023-11-28T21:08:10.212677+0000","last_became_peered":"2023-11-28T21:08:10.212677+0000","last_unstale":"2023-11-28T21:08:11.426278+0000","last_undegraded":"2023-11-28T21:08:11.426278+0000","last_fullsized":"2023-11-28T21:08:11.426278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:47:10.269501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428778+0000","last_change":"2023-11-28T21:08:10.232806+0000","last_active":"2023-11-28T21:08:11.428778+0000","last_peered":"2023-11-28T21:08:11.428778+0000","last_clean":"2023-11-28T21:08:11.428778+0000","last_became_active":"2023-11-28T21:08:10.232447+0000","last_became_peered":"2023-11-28T21:08:10.232447+0000","last_unstale":"2023-11-28T21:08:11.428778+0000","last_undegraded":"2023-11-28T21:08:11.428778+0000","last_fullsized":"2023-11-28T21:08:11.428778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:03.816068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426930+0000","last_change":"2023-11-28T21:08:10.213764+0000","last_active":"2023-11-28T21:08:11.426930+0000","last_peered":"2023-11-28T21:08:11.426930+0000","last_clean":"2023-11-28T21:08:11.426930+0000","last_became_active":"2023-11-28T21:08:10.213514+0000","last_became_peered":"2023-11-28T21:08:10.213514+0000","last_unstale":"2023-11-28T21:08:11.426930+0000","last_undegraded":"2023-11-28T21:08:11.426930+0000","last_fullsized":"2023-11-28T21:08:11.426930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:58.849892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428091+0000","last_change":"2023-11-28T21:08:10.216604+0000","last_active":"2023-11-28T21:08:11.428091+0000","last_peered":"2023-11-28T21:08:11.428091+0000","last_clean":"2023-11-28T21:08:11.428091+0000","last_became_active":"2023-11-28T21:08:10.216256+0000","last_became_peered":"2023-11-28T21:08:10.216256+0000","last_unstale":"2023-11-28T21:08:11.428091+0000","last_undegraded":"2023-11-28T21:08:11.428091+0000","last_fullsized":"2023-11-28T21:08:11.428091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:49:34.820109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427556+0000","last_change":"2023-11-28T21:08:10.225157+0000","last_active":"2023-11-28T21:08:11.427556+0000","last_peered":"2023-11-28T21:08:11.427556+0000","last_clean":"2023-11-28T21:08:11.427556+0000","last_became_active":"2023-11-28T21:08:10.224943+0000","last_became_peered":"2023-11-28T21:08:10.224943+0000","last_unstale":"2023-11-28T21:08:11.427556+0000","last_undegraded":"2023-11-28T21:08:11.427556+0000","last_fullsized":"2023-11-28T21:08:11.427556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:39.372238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198391+0000","last_change":"2023-11-28T21:08:10.213317+0000","last_active":"2023-11-28T21:08:11.198391+0000","last_peered":"2023-11-28T21:08:11.198391+0000","last_clean":"2023-11-28T21:08:11.198391+0000","last_became_active":"2023-11-28T21:08:10.212825+0000","last_became_peered":"2023-11-28T21:08:10.212825+0000","last_unstale":"2023-11-28T21:08:11.198391+0000","last_undegraded":"2023-11-28T21:08:11.198391+0000","last_fullsized":"2023-11-28T21:08:11.198391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193012+0000","last_change":"2023-11-28T21:08:10.211086+0000","last_active":"2023-11-28T21:08:11.193012+0000","last_peered":"2023-11-28T21:08:11.193012+0000","last_clean":"2023-11-28T21:08:11.193012+0000","last_became_active":"2023-11-28T21:08:10.210680+0000","last_became_peered":"2023-11-28T21:08:10.210680+0000","last_unstale":"2023-11-28T21:08:11.193012+0000","last_undegraded":"2023-11-28T21:08:11.193012+0000","last_fullsized":"2023-11-28T21:08:11.193012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:07.366435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427688+0000","last_change":"2023-11-28T21:08:10.222999+0000","last_active":"2023-11-28T21:08:11.427688+0000","last_peered":"2023-11-28T21:08:11.427688+0000","last_clean":"2023-11-28T21:08:11.427688+0000","last_became_active":"2023-11-28T21:08:10.222686+0000","last_became_peered":"2023-11-28T21:08:10.222686+0000","last_unstale":"2023-11-28T21:08:11.427688+0000","last_undegraded":"2023-11-28T21:08:11.427688+0000","last_fullsized":"2023-11-28T21:08:11.427688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:15.263435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426287+0000","last_change":"2023-11-28T21:08:10.208621+0000","last_active":"2023-11-28T21:08:11.426287+0000","last_peered":"2023-11-28T21:08:11.426287+0000","last_clean":"2023-11-28T21:08:11.426287+0000","last_became_active":"2023-11-28T21:08:10.206992+0000","last_became_peered":"2023-11-28T21:08:10.206992+0000","last_unstale":"2023-11-28T21:08:11.426287+0000","last_undegraded":"2023-11-28T21:08:11.426287+0000","last_fullsized":"2023-11-28T21:08:11.426287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:58.131504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428613+0000","last_change":"2023-11-28T21:08:10.217326+0000","last_active":"2023-11-28T21:08:11.428613+0000","last_peered":"2023-11-28T21:08:11.428613+0000","last_clean":"2023-11-28T21:08:11.428613+0000","last_became_active":"2023-11-28T21:08:10.216919+0000","last_became_peered":"2023-11-28T21:08:10.216919+0000","last_unstale":"2023-11-28T21:08:11.428613+0000","last_undegraded":"2023-11-28T21:08:11.428613+0000","last_fullsized":"2023-11-28T21:08:11.428613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:52.316215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425834+0000","last_change":"2023-11-28T21:08:10.227414+0000","last_active":"2023-11-28T21:08:11.425834+0000","last_peered":"2023-11-28T21:08:11.425834+0000","last_clean":"2023-11-28T21:08:11.425834+0000","last_became_active":"2023-11-28T21:08:10.227158+0000","last_became_peered":"2023-11-28T21:08:10.227158+0000","last_unstale":"2023-11-28T21:08:11.425834+0000","last_undegraded":"2023-11-28T21:08:11.425834+0000","last_fullsized":"2023-11-28T21:08:11.425834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:36:09.278216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.196935+0000","last_change":"2023-11-28T21:08:10.202982+0000","last_active":"2023-11-28T21:08:11.196935+0000","last_peered":"2023-11-28T21:08:11.196935+0000","last_clean":"2023-11-28T21:08:11.196935+0000","last_became_active":"2023-11-28T21:08:10.202638+0000","last_became_peered":"2023-11-28T21:08:10.202638+0000","last_unstale":"2023-11-28T21:08:11.196935+0000","last_undegraded":"2023-11-28T21:08:11.196935+0000","last_fullsized":"2023-11-28T21:08:11.196935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:20:14.317884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197295+0000","last_change":"2023-11-28T21:08:10.214194+0000","last_active":"2023-11-28T21:08:11.197295+0000","last_peered":"2023-11-28T21:08:11.197295+0000","last_clean":"2023-11-28T21:08:11.197295+0000","last_became_active":"2023-11-28T21:08:10.213046+0000","last_became_peered":"2023-11-28T21:08:10.213046+0000","last_unstale":"2023-11-28T21:08:11.197295+0000","last_undegraded":"2023-11-28T21:08:11.197295+0000","last_fullsized":"2023-11-28T21:08:11.197295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:23.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427403+0000","last_change":"2023-11-28T21:08:09.408970+0000","last_active":"2023-11-28T21:08:11.427403+0000","last_peered":"2023-11-28T21:08:11.427403+0000","last_clean":"2023-11-28T21:08:11.427403+0000","last_became_active":"2023-11-28T21:08:09.407594+0000","last_became_peered":"2023-11-28T21:08:09.407594+0000","last_unstale":"2023-11-28T21:08:11.427403+0000","last_undegraded":"2023-11-28T21:08:11.427403+0000","last_fullsized":"2023-11-28T21:08:11.427403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:52.171842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426417+0000","last_change":"2023-11-28T21:08:10.206555+0000","last_active":"2023-11-28T21:08:11.426417+0000","last_peered":"2023-11-28T21:08:11.426417+0000","last_clean":"2023-11-28T21:08:11.426417+0000","last_became_active":"2023-11-28T21:08:10.206199+0000","last_became_peered":"2023-11-28T21:08:10.206199+0000","last_unstale":"2023-11-28T21:08:11.426417+0000","last_undegraded":"2023-11-28T21:08:11.426417+0000","last_fullsized":"2023-11-28T21:08:11.426417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:43:54.997585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197850+0000","last_change":"2023-11-28T21:08:09.409806+0000","last_active":"2023-11-28T21:08:11.197850+0000","last_peered":"2023-11-28T21:08:11.197850+0000","last_clean":"2023-11-28T21:08:11.197850+0000","last_became_active":"2023-11-28T21:08:09.409409+0000","last_became_peered":"2023-11-28T21:08:09.409409+0000","last_unstale":"2023-11-28T21:08:11.197850+0000","last_undegraded":"2023-11-28T21:08:11.197850+0000","last_fullsized":"2023-11-28T21:08:11.197850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:00.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427006+0000","last_change":"2023-11-28T21:08:09.411063+0000","last_active":"2023-11-28T21:08:11.427006+0000","last_peered":"2023-11-28T21:08:11.427006+0000","last_clean":"2023-11-28T21:08:11.427006+0000","last_became_active":"2023-11-28T21:08:09.410772+0000","last_became_peered":"2023-11-28T21:08:09.410772+0000","last_unstale":"2023-11-28T21:08:11.427006+0000","last_undegraded":"2023-11-28T21:08:11.427006+0000","last_fullsized":"2023-11-28T21:08:11.427006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:24.407303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426871+0000","last_change":"2023-11-28T21:08:10.218510+0000","last_active":"2023-11-28T21:08:11.426871+0000","last_peered":"2023-11-28T21:08:11.426871+0000","last_clean":"2023-11-28T21:08:11.426871+0000","last_became_active":"2023-11-28T21:08:10.216099+0000","last_became_peered":"2023-11-28T21:08:10.216099+0000","last_unstale":"2023-11-28T21:08:11.426871+0000","last_undegraded":"2023-11-28T21:08:11.426871+0000","last_fullsized":"2023-11-28T21:08:11.426871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:58.131504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428208+0000","last_change":"2023-11-28T21:08:09.411506+0000","last_active":"2023-11-28T21:08:11.428208+0000","last_peered":"2023-11-28T21:08:11.428208+0000","last_clean":"2023-11-28T21:08:11.428208+0000","last_became_active":"2023-11-28T21:08:09.411121+0000","last_became_peered":"2023-11-28T21:08:09.411121+0000","last_unstale":"2023-11-28T21:08:11.428208+0000","last_undegraded":"2023-11-28T21:08:11.428208+0000","last_fullsized":"2023-11-28T21:08:11.428208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:20:13.314859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192789+0000","last_change":"2023-11-28T21:08:10.208767+0000","last_active":"2023-11-28T21:08:11.192789+0000","last_peered":"2023-11-28T21:08:11.192789+0000","last_clean":"2023-11-28T21:08:11.192789+0000","last_became_active":"2023-11-28T21:08:10.208461+0000","last_became_peered":"2023-11-28T21:08:10.208461+0000","last_unstale":"2023-11-28T21:08:11.192789+0000","last_undegraded":"2023-11-28T21:08:11.192789+0000","last_fullsized":"2023-11-28T21:08:11.192789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:04.311783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198365+0000","last_change":"2023-11-28T21:08:09.413726+0000","last_active":"2023-11-28T21:08:11.198365+0000","last_peered":"2023-11-28T21:08:11.198365+0000","last_clean":"2023-11-28T21:08:11.198365+0000","last_became_active":"2023-11-28T21:08:09.413416+0000","last_became_peered":"2023-11-28T21:08:09.413416+0000","last_unstale":"2023-11-28T21:08:11.198365+0000","last_undegraded":"2023-11-28T21:08:11.198365+0000","last_fullsized":"2023-11-28T21:08:11.198365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:41:22.294086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429381+0000","last_change":"2023-11-28T21:08:10.226078+0000","last_active":"2023-11-28T21:08:11.429381+0000","last_peered":"2023-11-28T21:08:11.429381+0000","last_clean":"2023-11-28T21:08:11.429381+0000","last_became_active":"2023-11-28T21:08:10.225785+0000","last_became_peered":"2023-11-28T21:08:10.225785+0000","last_unstale":"2023-11-28T21:08:11.429381+0000","last_undegraded":"2023-11-28T21:08:11.429381+0000","last_fullsized":"2023-11-28T21:08:11.429381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:44.649741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429363+0000","last_change":"2023-11-28T21:08:09.405377+0000","last_active":"2023-11-28T21:08:11.429363+0000","last_peered":"2023-11-28T21:08:11.429363+0000","last_clean":"2023-11-28T21:08:11.429363+0000","last_became_active":"2023-11-28T21:08:09.405079+0000","last_became_peered":"2023-11-28T21:08:09.405079+0000","last_unstale":"2023-11-28T21:08:11.429363+0000","last_undegraded":"2023-11-28T21:08:11.429363+0000","last_fullsized":"2023-11-28T21:08:11.429363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:03.308758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426696+0000","last_change":"2023-11-28T21:08:10.220356+0000","last_active":"2023-11-28T21:08:11.426696+0000","last_peered":"2023-11-28T21:08:11.426696+0000","last_clean":"2023-11-28T21:08:11.426696+0000","last_became_active":"2023-11-28T21:08:10.220024+0000","last_became_peered":"2023-11-28T21:08:10.220024+0000","last_unstale":"2023-11-28T21:08:11.426696+0000","last_undegraded":"2023-11-28T21:08:11.426696+0000","last_fullsized":"2023-11-28T21:08:11.426696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:22:29.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193017+0000","last_change":"2023-11-28T21:08:09.414108+0000","last_active":"2023-11-28T21:08:11.193017+0000","last_peered":"2023-11-28T21:08:11.193017+0000","last_clean":"2023-11-28T21:08:11.193017+0000","last_became_active":"2023-11-28T21:08:09.413780+0000","last_became_peered":"2023-11-28T21:08:09.413780+0000","last_unstale":"2023-11-28T21:08:11.193017+0000","last_undegraded":"2023-11-28T21:08:11.193017+0000","last_fullsized":"2023-11-28T21:08:11.193017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197987+0000","last_change":"2023-11-28T21:08:10.218932+0000","last_active":"2023-11-28T21:08:11.197987+0000","last_peered":"2023-11-28T21:08:11.197987+0000","last_clean":"2023-11-28T21:08:11.197987+0000","last_became_active":"2023-11-28T21:08:10.218621+0000","last_became_peered":"2023-11-28T21:08:10.218621+0000","last_unstale":"2023-11-28T21:08:11.197987+0000","last_undegraded":"2023-11-28T21:08:11.197987+0000","last_fullsized":"2023-11-28T21:08:11.197987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:38.556751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198214+0000","last_change":"2023-11-28T21:08:09.416708+0000","last_active":"2023-11-28T21:08:11.198214+0000","last_peered":"2023-11-28T21:08:11.198214+0000","last_clean":"2023-11-28T21:08:11.198214+0000","last_became_active":"2023-11-28T21:08:09.416209+0000","last_became_peered":"2023-11-28T21:08:09.416209+0000","last_unstale":"2023-11-28T21:08:11.198214+0000","last_undegraded":"2023-11-28T21:08:11.198214+0000","last_fullsized":"2023-11-28T21:08:11.198214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428761+0000","last_change":"2023-11-28T21:08:10.226709+0000","last_active":"2023-11-28T21:08:11.428761+0000","last_peered":"2023-11-28T21:08:11.428761+0000","last_clean":"2023-11-28T21:08:11.428761+0000","last_became_active":"2023-11-28T21:08:10.223145+0000","last_became_peered":"2023-11-28T21:08:10.223145+0000","last_unstale":"2023-11-28T21:08:11.428761+0000","last_undegraded":"2023-11-28T21:08:11.428761+0000","last_fullsized":"2023-11-28T21:08:11.428761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:28.425251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426379+0000","last_change":"2023-11-28T21:08:09.417259+0000","last_active":"2023-11-28T21:08:11.426379+0000","last_peered":"2023-11-28T21:08:11.426379+0000","last_clean":"2023-11-28T21:08:11.426379+0000","last_became_active":"2023-11-28T21:08:09.415186+0000","last_became_peered":"2023-11-28T21:08:09.415186+0000","last_unstale":"2023-11-28T21:08:11.426379+0000","last_undegraded":"2023-11-28T21:08:11.426379+0000","last_fullsized":"2023-11-28T21:08:11.426379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:51.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426183+0000","last_change":"2023-11-28T21:08:10.206745+0000","last_active":"2023-11-28T21:08:11.426183+0000","last_peered":"2023-11-28T21:08:11.426183+0000","last_clean":"2023-11-28T21:08:11.426183+0000","last_became_active":"2023-11-28T21:08:10.206444+0000","last_became_peered":"2023-11-28T21:08:10.206444+0000","last_unstale":"2023-11-28T21:08:11.426183+0000","last_undegraded":"2023-11-28T21:08:11.426183+0000","last_fullsized":"2023-11-28T21:08:11.426183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:49.158934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428881+0000","last_change":"2023-11-28T21:08:09.411244+0000","last_active":"2023-11-28T21:08:11.428881+0000","last_peered":"2023-11-28T21:08:11.428881+0000","last_clean":"2023-11-28T21:08:11.428881+0000","last_became_active":"2023-11-28T21:08:09.410896+0000","last_became_peered":"2023-11-28T21:08:09.410896+0000","last_unstale":"2023-11-28T21:08:11.428881+0000","last_undegraded":"2023-11-28T21:08:11.428881+0000","last_fullsized":"2023-11-28T21:08:11.428881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.027257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428127+0000","last_change":"2023-11-28T21:08:10.228561+0000","last_active":"2023-11-28T21:08:11.428127+0000","last_peered":"2023-11-28T21:08:11.428127+0000","last_clean":"2023-11-28T21:08:11.428127+0000","last_became_active":"2023-11-28T21:08:10.228150+0000","last_became_peered":"2023-11-28T21:08:10.228150+0000","last_unstale":"2023-11-28T21:08:11.428127+0000","last_undegraded":"2023-11-28T21:08:11.428127+0000","last_fullsized":"2023-11-28T21:08:11.428127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:22.992496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197207+0000","last_change":"2023-11-28T21:08:09.411127+0000","last_active":"2023-11-28T21:08:11.197207+0000","last_peered":"2023-11-28T21:08:11.197207+0000","last_clean":"2023-11-28T21:08:11.197207+0000","last_became_active":"2023-11-28T21:08:09.410838+0000","last_became_peered":"2023-11-28T21:08:09.410838+0000","last_unstale":"2023-11-28T21:08:11.197207+0000","last_undegraded":"2023-11-28T21:08:11.197207+0000","last_fullsized":"2023-11-28T21:08:11.197207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:36:08.275191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.196958+0000","last_change":"2023-11-28T21:08:10.204504+0000","last_active":"2023-11-28T21:08:11.196958+0000","last_peered":"2023-11-28T21:08:11.196958+0000","last_clean":"2023-11-28T21:08:11.196958+0000","last_became_active":"2023-11-28T21:08:10.204189+0000","last_became_peered":"2023-11-28T21:08:10.204189+0000","last_unstale":"2023-11-28T21:08:11.196958+0000","last_undegraded":"2023-11-28T21:08:11.196958+0000","last_fullsized":"2023-11-28T21:08:11.196958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:04.311783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425946+0000","last_change":"2023-11-28T21:08:09.400060+0000","last_active":"2023-11-28T21:08:11.425946+0000","last_peered":"2023-11-28T21:08:11.425946+0000","last_clean":"2023-11-28T21:08:11.425946+0000","last_became_active":"2023-11-28T21:08:09.399648+0000","last_became_peered":"2023-11-28T21:08:09.399648+0000","last_unstale":"2023-11-28T21:08:11.425946+0000","last_undegraded":"2023-11-28T21:08:11.425946+0000","last_fullsized":"2023-11-28T21:08:11.425946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:50.664387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427688+0000","last_change":"2023-11-28T21:08:10.228574+0000","last_active":"2023-11-28T21:08:11.427688+0000","last_peered":"2023-11-28T21:08:11.427688+0000","last_clean":"2023-11-28T21:08:11.427688+0000","last_became_active":"2023-11-28T21:08:10.228233+0000","last_became_peered":"2023-11-28T21:08:10.228233+0000","last_unstale":"2023-11-28T21:08:11.427688+0000","last_undegraded":"2023-11-28T21:08:11.427688+0000","last_fullsized":"2023-11-28T21:08:11.427688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:52.862412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197974+0000","last_change":"2023-11-28T21:08:09.412110+0000","last_active":"2023-11-28T21:08:11.197974+0000","last_peered":"2023-11-28T21:08:11.197974+0000","last_clean":"2023-11-28T21:08:11.197974+0000","last_became_active":"2023-11-28T21:08:09.411775+0000","last_became_peered":"2023-11-28T21:08:09.411775+0000","last_unstale":"2023-11-28T21:08:11.197974+0000","last_undegraded":"2023-11-28T21:08:11.197974+0000","last_fullsized":"2023-11-28T21:08:11.197974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:51.690241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428422+0000","last_change":"2023-11-28T21:08:10.226232+0000","last_active":"2023-11-28T21:08:11.428422+0000","last_peered":"2023-11-28T21:08:11.428422+0000","last_clean":"2023-11-28T21:08:11.428422+0000","last_became_active":"2023-11-28T21:08:10.225427+0000","last_became_peered":"2023-11-28T21:08:10.225427+0000","last_unstale":"2023-11-28T21:08:11.428422+0000","last_undegraded":"2023-11-28T21:08:11.428422+0000","last_fullsized":"2023-11-28T21:08:11.428422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:03.816068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425869+0000","last_change":"2023-11-28T21:08:09.414676+0000","last_active":"2023-11-28T21:08:11.425869+0000","last_peered":"2023-11-28T21:08:11.425869+0000","last_clean":"2023-11-28T21:08:11.425869+0000","last_became_active":"2023-11-28T21:08:09.414376+0000","last_became_peered":"2023-11-28T21:08:09.414376+0000","last_unstale":"2023-11-28T21:08:11.425869+0000","last_undegraded":"2023-11-28T21:08:11.425869+0000","last_fullsized":"2023-11-28T21:08:11.425869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:25.360796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428963+0000","last_change":"2023-11-28T21:08:10.228599+0000","last_active":"2023-11-28T21:08:11.428963+0000","last_peered":"2023-11-28T21:08:11.428963+0000","last_clean":"2023-11-28T21:08:11.428963+0000","last_became_active":"2023-11-28T21:08:10.228211+0000","last_became_peered":"2023-11-28T21:08:10.228211+0000","last_unstale":"2023-11-28T21:08:11.428963+0000","last_undegraded":"2023-11-28T21:08:11.428963+0000","last_fullsized":"2023-11-28T21:08:11.428963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:06:10.717892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193206+0000","last_change":"2023-11-28T21:08:09.412288+0000","last_active":"2023-11-28T21:08:11.193206+0000","last_peered":"2023-11-28T21:08:11.193206+0000","last_clean":"2023-11-28T21:08:11.193206+0000","last_became_active":"2023-11-28T21:08:09.411979+0000","last_became_peered":"2023-11-28T21:08:09.411979+0000","last_unstale":"2023-11-28T21:08:11.193206+0000","last_undegraded":"2023-11-28T21:08:11.193206+0000","last_fullsized":"2023-11-28T21:08:11.193206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429188+0000","last_change":"2023-11-28T21:08:10.217612+0000","last_active":"2023-11-28T21:08:11.429188+0000","last_peered":"2023-11-28T21:08:11.429188+0000","last_clean":"2023-11-28T21:08:11.429188+0000","last_became_active":"2023-11-28T21:08:10.217135+0000","last_became_peered":"2023-11-28T21:08:10.217135+0000","last_unstale":"2023-11-28T21:08:11.429188+0000","last_undegraded":"2023-11-28T21:08:11.429188+0000","last_fullsized":"2023-11-28T21:08:11.429188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:32:56.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425780+0000","last_change":"2023-11-28T21:08:09.412915+0000","last_active":"2023-11-28T21:08:11.425780+0000","last_peered":"2023-11-28T21:08:11.425780+0000","last_clean":"2023-11-28T21:08:11.425780+0000","last_became_active":"2023-11-28T21:08:09.412526+0000","last_became_peered":"2023-11-28T21:08:09.412526+0000","last_unstale":"2023-11-28T21:08:11.425780+0000","last_undegraded":"2023-11-28T21:08:11.425780+0000","last_fullsized":"2023-11-28T21:08:11.425780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:22.819533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428899+0000","last_change":"2023-11-28T21:08:10.224859+0000","last_active":"2023-11-28T21:08:11.428899+0000","last_peered":"2023-11-28T21:08:11.428899+0000","last_clean":"2023-11-28T21:08:11.428899+0000","last_became_active":"2023-11-28T21:08:10.223472+0000","last_became_peered":"2023-11-28T21:08:10.223472+0000","last_unstale":"2023-11-28T21:08:11.428899+0000","last_undegraded":"2023-11-28T21:08:11.428899+0000","last_fullsized":"2023-11-28T21:08:11.428899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:44.649741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T21:08:10.207024+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-28T21:08:10.207024+0000","last_peered":"2023-11-28T21:08:10.207024+0000","last_clean":"2023-11-28T21:08:10.207024+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-28T21:08:10.207024+0000","last_undegraded":"2023-11-28T21:08:10.207024+0000","last_fullsized":"2023-11-28T21:08:10.207024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427645+0000","last_change":"2023-11-28T21:08:09.410476+0000","last_active":"2023-11-28T21:08:11.427645+0000","last_peered":"2023-11-28T21:08:11.427645+0000","last_clean":"2023-11-28T21:08:11.427645+0000","last_became_active":"2023-11-28T21:08:09.410187+0000","last_became_peered":"2023-11-28T21:08:09.410187+0000","last_unstale":"2023-11-28T21:08:11.427645+0000","last_undegraded":"2023-11-28T21:08:11.427645+0000","last_fullsized":"2023-11-28T21:08:11.427645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:30.479292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427140+0000","last_change":"2023-11-28T21:08:10.217383+0000","last_active":"2023-11-28T21:08:11.427140+0000","last_peered":"2023-11-28T21:08:11.427140+0000","last_clean":"2023-11-28T21:08:11.427140+0000","last_became_active":"2023-11-28T21:08:10.216734+0000","last_became_peered":"2023-11-28T21:08:10.216734+0000","last_unstale":"2023-11-28T21:08:11.427140+0000","last_undegraded":"2023-11-28T21:08:11.427140+0000","last_fullsized":"2023-11-28T21:08:11.427140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:01.305338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427737+0000","last_change":"2023-11-28T21:08:09.420964+0000","last_active":"2023-11-28T21:08:11.427737+0000","last_peered":"2023-11-28T21:08:11.427737+0000","last_clean":"2023-11-28T21:08:11.427737+0000","last_became_active":"2023-11-28T21:08:09.420579+0000","last_became_peered":"2023-11-28T21:08:09.420579+0000","last_unstale":"2023-11-28T21:08:11.427737+0000","last_undegraded":"2023-11-28T21:08:11.427737+0000","last_fullsized":"2023-11-28T21:08:11.427737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425829+0000","last_change":"2023-11-28T21:08:10.204009+0000","last_active":"2023-11-28T21:08:11.425829+0000","last_peered":"2023-11-28T21:08:11.425829+0000","last_clean":"2023-11-28T21:08:11.425829+0000","last_became_active":"2023-11-28T21:08:10.203603+0000","last_became_peered":"2023-11-28T21:08:10.203603+0000","last_unstale":"2023-11-28T21:08:11.425829+0000","last_undegraded":"2023-11-28T21:08:11.425829+0000","last_fullsized":"2023-11-28T21:08:11.425829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:53.174867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425911+0000","last_change":"2023-11-28T21:08:09.411899+0000","last_active":"2023-11-28T21:08:11.425911+0000","last_peered":"2023-11-28T21:08:11.425911+0000","last_clean":"2023-11-28T21:08:11.425911+0000","last_became_active":"2023-11-28T21:08:09.411555+0000","last_became_peered":"2023-11-28T21:08:09.411555+0000","last_unstale":"2023-11-28T21:08:11.425911+0000","last_undegraded":"2023-11-28T21:08:11.425911+0000","last_fullsized":"2023-11-28T21:08:11.425911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:41.385513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192833+0000","last_change":"2023-11-28T21:08:10.209590+0000","last_active":"2023-11-28T21:08:11.192833+0000","last_peered":"2023-11-28T21:08:11.192833+0000","last_clean":"2023-11-28T21:08:11.192833+0000","last_became_active":"2023-11-28T21:08:10.209147+0000","last_became_peered":"2023-11-28T21:08:10.209147+0000","last_unstale":"2023-11-28T21:08:11.192833+0000","last_undegraded":"2023-11-28T21:08:11.192833+0000","last_fullsized":"2023-11-28T21:08:11.192833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:31.482317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428982+0000","last_change":"2023-11-28T21:08:09.410466+0000","last_active":"2023-11-28T21:08:11.428982+0000","last_peered":"2023-11-28T21:08:11.428982+0000","last_clean":"2023-11-28T21:08:11.428982+0000","last_became_active":"2023-11-28T21:08:09.407914+0000","last_became_peered":"2023-11-28T21:08:09.407914+0000","last_unstale":"2023-11-28T21:08:11.428982+0000","last_undegraded":"2023-11-28T21:08:11.428982+0000","last_fullsized":"2023-11-28T21:08:11.428982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:43.201299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197885+0000","last_change":"2023-11-28T21:08:10.207622+0000","last_active":"2023-11-28T21:08:11.197885+0000","last_peered":"2023-11-28T21:08:11.197885+0000","last_clean":"2023-11-28T21:08:11.197885+0000","last_became_active":"2023-11-28T21:08:10.207211+0000","last_became_peered":"2023-11-28T21:08:10.207211+0000","last_unstale":"2023-11-28T21:08:11.197885+0000","last_undegraded":"2023-11-28T21:08:11.197885+0000","last_fullsized":"2023-11-28T21:08:11.197885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:19.158104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193185+0000","last_change":"2023-11-28T21:08:09.409041+0000","last_active":"2023-11-28T21:08:11.193185+0000","last_peered":"2023-11-28T21:08:11.193185+0000","last_clean":"2023-11-28T21:08:11.193185+0000","last_became_active":"2023-11-28T21:08:09.408341+0000","last_became_peered":"2023-11-28T21:08:09.408341+0000","last_unstale":"2023-11-28T21:08:11.193185+0000","last_undegraded":"2023-11-28T21:08:11.193185+0000","last_fullsized":"2023-11-28T21:08:11.193185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:00.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428794+0000","last_change":"2023-11-28T21:08:10.214773+0000","last_active":"2023-11-28T21:08:11.428794+0000","last_peered":"2023-11-28T21:08:11.428794+0000","last_clean":"2023-11-28T21:08:11.428794+0000","last_became_active":"2023-11-28T21:08:10.213536+0000","last_became_peered":"2023-11-28T21:08:10.213536+0000","last_unstale":"2023-11-28T21:08:11.428794+0000","last_undegraded":"2023-11-28T21:08:11.428794+0000","last_fullsized":"2023-11-28T21:08:11.428794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:01.331246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429147+0000","last_change":"2023-11-28T21:08:09.420838+0000","last_active":"2023-11-28T21:08:11.429147+0000","last_peered":"2023-11-28T21:08:11.429147+0000","last_clean":"2023-11-28T21:08:11.429147+0000","last_became_active":"2023-11-28T21:08:09.420573+0000","last_became_peered":"2023-11-28T21:08:09.420573+0000","last_unstale":"2023-11-28T21:08:11.429147+0000","last_undegraded":"2023-11-28T21:08:11.429147+0000","last_fullsized":"2023-11-28T21:08:11.429147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:21.623627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193010+0000","last_change":"2023-11-28T21:08:10.210874+0000","last_active":"2023-11-28T21:08:11.193010+0000","last_peered":"2023-11-28T21:08:11.193010+0000","last_clean":"2023-11-28T21:08:11.193010+0000","last_became_active":"2023-11-28T21:08:10.210568+0000","last_became_peered":"2023-11-28T21:08:10.210568+0000","last_unstale":"2023-11-28T21:08:11.193010+0000","last_undegraded":"2023-11-28T21:08:11.193010+0000","last_fullsized":"2023-11-28T21:08:11.193010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:44.204323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193235+0000","last_change":"2023-11-28T21:08:09.401418+0000","last_active":"2023-11-28T21:08:11.193235+0000","last_peered":"2023-11-28T21:08:11.193235+0000","last_clean":"2023-11-28T21:08:11.193235+0000","last_became_active":"2023-11-28T21:08:09.400985+0000","last_became_peered":"2023-11-28T21:08:09.400985+0000","last_unstale":"2023-11-28T21:08:11.193235+0000","last_undegraded":"2023-11-28T21:08:11.193235+0000","last_fullsized":"2023-11-28T21:08:11.193235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:37.553726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427625+0000","last_change":"2023-11-28T21:08:10.226340+0000","last_active":"2023-11-28T21:08:11.427625+0000","last_peered":"2023-11-28T21:08:11.427625+0000","last_clean":"2023-11-28T21:08:11.427625+0000","last_became_active":"2023-11-28T21:08:10.226076+0000","last_became_peered":"2023-11-28T21:08:10.226076+0000","last_unstale":"2023-11-28T21:08:11.427625+0000","last_undegraded":"2023-11-28T21:08:11.427625+0000","last_fullsized":"2023-11-28T21:08:11.427625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:55:43.036114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198424+0000","last_change":"2023-11-28T21:08:09.412010+0000","last_active":"2023-11-28T21:08:11.198424+0000","last_peered":"2023-11-28T21:08:11.198424+0000","last_clean":"2023-11-28T21:08:11.198424+0000","last_became_active":"2023-11-28T21:08:09.411717+0000","last_became_peered":"2023-11-28T21:08:09.411717+0000","last_unstale":"2023-11-28T21:08:11.198424+0000","last_undegraded":"2023-11-28T21:08:11.198424+0000","last_fullsized":"2023-11-28T21:08:11.198424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426552+0000","last_change":"2023-11-28T21:08:10.212660+0000","last_active":"2023-11-28T21:08:11.426552+0000","last_peered":"2023-11-28T21:08:11.426552+0000","last_clean":"2023-11-28T21:08:11.426552+0000","last_became_active":"2023-11-28T21:08:10.212355+0000","last_became_peered":"2023-11-28T21:08:10.212355+0000","last_unstale":"2023-11-28T21:08:11.426552+0000","last_undegraded":"2023-11-28T21:08:11.426552+0000","last_fullsized":"2023-11-28T21:08:11.426552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:01.305338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427462+0000","last_change":"2023-11-28T21:08:09.419375+0000","last_active":"2023-11-28T21:08:11.427462+0000","last_peered":"2023-11-28T21:08:11.427462+0000","last_clean":"2023-11-28T21:08:11.427462+0000","last_became_active":"2023-11-28T21:08:09.419142+0000","last_became_peered":"2023-11-28T21:08:09.419142+0000","last_unstale":"2023-11-28T21:08:11.427462+0000","last_undegraded":"2023-11-28T21:08:11.427462+0000","last_fullsized":"2023-11-28T21:08:11.427462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197815+0000","last_change":"2023-11-28T21:08:10.214305+0000","last_active":"2023-11-28T21:08:11.197815+0000","last_peered":"2023-11-28T21:08:11.197815+0000","last_clean":"2023-11-28T21:08:11.197815+0000","last_became_active":"2023-11-28T21:08:10.211723+0000","last_became_peered":"2023-11-28T21:08:10.211723+0000","last_unstale":"2023-11-28T21:08:11.197815+0000","last_undegraded":"2023-11-28T21:08:11.197815+0000","last_fullsized":"2023-11-28T21:08:11.197815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:42.388537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192883+0000","last_change":"2023-11-28T21:08:09.405284+0000","last_active":"2023-11-28T21:08:11.192883+0000","last_peered":"2023-11-28T21:08:11.192883+0000","last_clean":"2023-11-28T21:08:11.192883+0000","last_became_active":"2023-11-28T21:08:09.404853+0000","last_became_peered":"2023-11-28T21:08:09.404853+0000","last_unstale":"2023-11-28T21:08:11.192883+0000","last_undegraded":"2023-11-28T21:08:11.192883+0000","last_fullsized":"2023-11-28T21:08:11.192883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:41:22.294086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426947+0000","last_change":"2023-11-28T21:08:10.214946+0000","last_active":"2023-11-28T21:08:11.426947+0000","last_peered":"2023-11-28T21:08:11.426947+0000","last_clean":"2023-11-28T21:08:11.426947+0000","last_became_active":"2023-11-28T21:08:10.214613+0000","last_became_peered":"2023-11-28T21:08:10.214613+0000","last_unstale":"2023-11-28T21:08:11.426947+0000","last_undegraded":"2023-11-28T21:08:11.426947+0000","last_fullsized":"2023-11-28T21:08:11.426947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:43:54.997585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193073+0000","last_change":"2023-11-28T21:08:09.414632+0000","last_active":"2023-11-28T21:08:11.193073+0000","last_peered":"2023-11-28T21:08:11.193073+0000","last_clean":"2023-11-28T21:08:11.193073+0000","last_became_active":"2023-11-28T21:08:09.414302+0000","last_became_peered":"2023-11-28T21:08:09.414302+0000","last_unstale":"2023-11-28T21:08:11.193073+0000","last_undegraded":"2023-11-28T21:08:11.193073+0000","last_fullsized":"2023-11-28T21:08:11.193073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:41.385513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427365+0000","last_change":"2023-11-28T21:08:10.215986+0000","last_active":"2023-11-28T21:08:11.427365+0000","last_peered":"2023-11-28T21:08:11.427365+0000","last_clean":"2023-11-28T21:08:11.427365+0000","last_became_active":"2023-11-28T21:08:10.215655+0000","last_became_peered":"2023-11-28T21:08:10.215655+0000","last_unstale":"2023-11-28T21:08:11.427365+0000","last_undegraded":"2023-11-28T21:08:11.427365+0000","last_fullsized":"2023-11-28T21:08:11.427365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:22:29.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428073+0000","last_change":"2023-11-28T21:08:09.418940+0000","last_active":"2023-11-28T21:08:11.428073+0000","last_peered":"2023-11-28T21:08:11.428073+0000","last_clean":"2023-11-28T21:08:11.428073+0000","last_became_active":"2023-11-28T21:08:09.418536+0000","last_became_peered":"2023-11-28T21:08:09.418536+0000","last_unstale":"2023-11-28T21:08:11.428073+0000","last_undegraded":"2023-11-28T21:08:11.428073+0000","last_fullsized":"2023-11-28T21:08:11.428073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:37.553726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197420+0000","last_change":"2023-11-28T21:08:10.207057+0000","last_active":"2023-11-28T21:08:11.197420+0000","last_peered":"2023-11-28T21:08:11.197420+0000","last_clean":"2023-11-28T21:08:11.197420+0000","last_became_active":"2023-11-28T21:08:10.206752+0000","last_became_peered":"2023-11-28T21:08:10.206752+0000","last_unstale":"2023-11-28T21:08:11.197420+0000","last_undegraded":"2023-11-28T21:08:11.197420+0000","last_fullsized":"2023-11-28T21:08:11.197420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:31.482317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428649+0000","last_change":"2023-11-28T21:08:10.218700+0000","last_active":"2023-11-28T21:08:11.428649+0000","last_peered":"2023-11-28T21:08:11.428649+0000","last_clean":"2023-11-28T21:08:11.428649+0000","last_became_active":"2023-11-28T21:08:10.218416+0000","last_became_peered":"2023-11-28T21:08:10.218416+0000","last_unstale":"2023-11-28T21:08:11.428649+0000","last_undegraded":"2023-11-28T21:08:11.428649+0000","last_fullsized":"2023-11-28T21:08:11.428649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:22.992496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428489+0000","last_change":"2023-11-28T21:08:09.419949+0000","last_active":"2023-11-28T21:08:11.428489+0000","last_peered":"2023-11-28T21:08:11.428489+0000","last_clean":"2023-11-28T21:08:11.428489+0000","last_became_active":"2023-11-28T21:08:09.419653+0000","last_became_peered":"2023-11-28T21:08:09.419653+0000","last_unstale":"2023-11-28T21:08:11.428489+0000","last_undegraded":"2023-11-28T21:08:11.428489+0000","last_fullsized":"2023-11-28T21:08:11.428489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:26.041569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428123+0000","last_change":"2023-11-28T21:08:10.222142+0000","last_active":"2023-11-28T21:08:11.428123+0000","last_peered":"2023-11-28T21:08:11.428123+0000","last_clean":"2023-11-28T21:08:11.428123+0000","last_became_active":"2023-11-28T21:08:10.221893+0000","last_became_peered":"2023-11-28T21:08:10.221893+0000","last_unstale":"2023-11-28T21:08:11.428123+0000","last_undegraded":"2023-11-28T21:08:11.428123+0000","last_fullsized":"2023-11-28T21:08:11.428123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:04.834063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428997+0000","last_change":"2023-11-28T21:08:09.418923+0000","last_active":"2023-11-28T21:08:11.428997+0000","last_peered":"2023-11-28T21:08:11.428997+0000","last_clean":"2023-11-28T21:08:11.428997+0000","last_became_active":"2023-11-28T21:08:09.418551+0000","last_became_peered":"2023-11-28T21:08:09.418551+0000","last_unstale":"2023-11-28T21:08:11.428997+0000","last_undegraded":"2023-11-28T21:08:11.428997+0000","last_fullsized":"2023-11-28T21:08:11.428997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:06.363411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426640+0000","last_change":"2023-11-28T21:08:10.220292+0000","last_active":"2023-11-28T21:08:11.426640+0000","last_peered":"2023-11-28T21:08:11.426640+0000","last_clean":"2023-11-28T21:08:11.426640+0000","last_became_active":"2023-11-28T21:08:10.219942+0000","last_became_peered":"2023-11-28T21:08:10.219942+0000","last_unstale":"2023-11-28T21:08:11.426640+0000","last_undegraded":"2023-11-28T21:08:11.426640+0000","last_fullsized":"2023-11-28T21:08:11.426640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:58.192436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427644+0000","last_change":"2023-11-28T21:08:09.412597+0000","last_active":"2023-11-28T21:08:11.427644+0000","last_peered":"2023-11-28T21:08:11.427644+0000","last_clean":"2023-11-28T21:08:11.427644+0000","last_became_active":"2023-11-28T21:08:09.412283+0000","last_became_peered":"2023-11-28T21:08:09.412283+0000","last_unstale":"2023-11-28T21:08:11.427644+0000","last_undegraded":"2023-11-28T21:08:11.427644+0000","last_fullsized":"2023-11-28T21:08:11.427644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:48.155910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427484+0000","last_change":"2023-11-28T21:08:10.213534+0000","last_active":"2023-11-28T21:08:11.427484+0000","last_peered":"2023-11-28T21:08:11.427484+0000","last_clean":"2023-11-28T21:08:11.427484+0000","last_became_active":"2023-11-28T21:08:10.213241+0000","last_became_peered":"2023-11-28T21:08:10.213241+0000","last_unstale":"2023-11-28T21:08:11.427484+0000","last_undegraded":"2023-11-28T21:08:11.427484+0000","last_fullsized":"2023-11-28T21:08:11.427484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426727+0000","last_change":"2023-11-28T21:08:09.410083+0000","last_active":"2023-11-28T21:08:11.426727+0000","last_peered":"2023-11-28T21:08:11.426727+0000","last_clean":"2023-11-28T21:08:11.426727+0000","last_became_active":"2023-11-28T21:08:09.409731+0000","last_became_peered":"2023-11-28T21:08:09.409731+0000","last_unstale":"2023-11-28T21:08:11.426727+0000","last_undegraded":"2023-11-28T21:08:11.426727+0000","last_fullsized":"2023-11-28T21:08:11.426727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.177983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":72305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":72341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":663221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:08:14.915 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T21:08:14.915 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T21:08:14.915 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T21:08:14.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T21:08:14.916 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T21:08:15.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f466adb8640 1 Processor -- start 2023-11-28T21:08:15.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f466adb8640 1 -- start start 2023-11-28T21:08:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f466adb8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46640b3e90 0x7f46640b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f466adb8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 0x7f4664071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f466adb8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46640703d0 con 0x7f4664159c20 2023-11-28T21:08:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f466adb8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4664071a70 con 0x7f46640b3e90 2023-11-28T21:08:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f466adb8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46640b4340 con 0x7f4664071100 2023-11-28T21:08:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f4668b54640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4664159c20 0x7f466406c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:60558/0 (socket says 172.21.15.6:60558) 2023-11-28T21:08:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f4668b54640 1 -- 172.21.15.6:0/1282241675 learned_addr learned my addr 172.21.15.6:0/1282241675 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f4663fff640 1 --2- 172.21.15.6:0/1282241675 >> v2:172.21.15.31:3300/0 conn(0x7f46640b3e90 0x7f46640b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f4669355640 1 --2- 172.21.15.6:0/1282241675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 0x7f4664071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f46637fe640 1 -- 172.21.15.6:0/1282241675 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588773729 0 0) 0x7f46640703d0 con 0x7f4664159c20 2023-11-28T21:08:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.091+0000 7f46637fe640 1 -- 172.21.15.6:0/1282241675 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4654003530 con 0x7f4664159c20 2023-11-28T21:08:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f46637fe640 1 -- 172.21.15.6:0/1282241675 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 797495023 0 0) 0x7f4654003530 con 0x7f4664159c20 2023-11-28T21:08:15.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f4663fff640 1 -- 172.21.15.6:0/1282241675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 msgr2=0x7f4664071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:15.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f4663fff640 1 --2- 172.21.15.6:0/1282241675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 0x7f4664071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f4663fff640 1 -- 172.21.15.6:0/1282241675 >> v1:172.21.15.31:6789/0 conn(0x7f4664159c20 legacy=0x7f466406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f4663fff640 1 -- 172.21.15.6:0/1282241675 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46640b3440 con 0x7f46640b3e90 2023-11-28T21:08:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f4663fff640 1 --2- 172.21.15.6:0/1282241675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640b3e90 0x7f46640b2f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46640b4480 tx=0x7f465001c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d77054b6c1d8a33 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f46637fe640 1 -- 172.21.15.6:0/1282241675 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658001680 con 0x7f46640b3e90 2023-11-28T21:08:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f46637fe640 1 -- 172.21.15.6:0/1282241675 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46500a7050 con 0x7f46640b3e90 2023-11-28T21:08:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f46637fe640 1 -- 172.21.15.6:0/1282241675 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500ab620 con 0x7f46640b3e90 2023-11-28T21:08:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f466adb8640 1 -- 172.21.15.6:0/1282241675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640b3e90 msgr2=0x7f46640b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f466adb8640 1 --2- 172.21.15.6:0/1282241675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640b3e90 0x7f46640b2f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f46640b4480 tx=0x7f465001c2e0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f466adb8640 1 -- 172.21.15.6:0/1282241675 shutdown_connections 2023-11-28T21:08:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f466adb8640 1 --2- 172.21.15.6:0/1282241675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 0x7f4664071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f466adb8640 1 --2- 172.21.15.6:0/1282241675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640b3e90 0x7f46640b2f00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.095+0000 7f466adb8640 1 -- 172.21.15.6:0/1282241675 >> 172.21.15.6:0/1282241675 conn(0x7f466406ab80 msgr2=0x7f46640b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 -- 172.21.15.6:0/1282241675 shutdown_connections 2023-11-28T21:08:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 -- 172.21.15.6:0/1282241675 wait complete. 2023-11-28T21:08:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 Processor -- start 2023-11-28T21:08:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 -- start start 2023-11-28T21:08:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 0x7f46641448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640b3e90 0x7f4664151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4664159c20 0x7f46640cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4664152470 con 0x7f4664159c20 2023-11-28T21:08:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4664152750 con 0x7f46640b3e90 2023-11-28T21:08:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f466adb8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4664152a30 con 0x7f4664071100 2023-11-28T21:08:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4669355640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4664159c20 0x7f46640cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4669355640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4664159c20 0x7f46640cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44498/0 (socket says 172.21.15.6:44498) 2023-11-28T21:08:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4669355640 1 -- 172.21.15.6:0/3133314886 learned_addr learned my addr 172.21.15.6:0/3133314886 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4668b54640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 0x7f46641448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4663fff640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640b3e90 0x7f4664151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4669355640 1 -- 172.21.15.6:0/3133314886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 msgr2=0x7f46641448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4669355640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 0x7f46641448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4669355640 1 -- 172.21.15.6:0/3133314886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640b3e90 msgr2=0x7f4664151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4669355640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640b3e90 0x7f4664151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4669355640 1 -- 172.21.15.6:0/3133314886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4650009420 con 0x7f4664159c20 2023-11-28T21:08:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.099+0000 7f4669355640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4664159c20 0x7f46640cf0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f465c00efc0 tx=0x7f465c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f46617fa640 1 -- 172.21.15.6:0/3133314886 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c009ba0 con 0x7f4664159c20 2023-11-28T21:08:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f46617fa640 1 -- 172.21.15.6:0/3133314886 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c00f040 con 0x7f4664159c20 2023-11-28T21:08:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f46617fa640 1 -- 172.21.15.6:0/3133314886 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0146c0 con 0x7f4664159c20 2023-11-28T21:08:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4664152d10 con 0x7f4664159c20 2023-11-28T21:08:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4664144e20 con 0x7f4664159c20 2023-11-28T21:08:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46640674d0 con 0x7f4664159c20 2023-11-28T21:08:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f46617fa640 1 -- 172.21.15.6:0/3133314886 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f465c014820 con 0x7f4664159c20 2023-11-28T21:08:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f46617fa640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4648066470 0x7f4648068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f46617fa640 1 -- 172.21.15.6:0/3133314886 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f465c0848b0 con 0x7f4664159c20 2023-11-28T21:08:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.103+0000 7f4668b54640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4648066470 0x7f4648068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.107+0000 7f4668b54640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4648066470 0x7f4648068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4658001ba0 tx=0x7f4658009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:15.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.107+0000 7f46617fa640 1 -- 172.21.15.6:0/3133314886 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f465c051dc0 con 0x7f4664159c20 2023-11-28T21:08:15.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.303+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f466406e6f0 con 0x7f4664159c20 2023-11-28T21:08:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.307+0000 7f46617fa640 1 -- 172.21.15.6:0/3133314886 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164422 (secure 0 0 0) 0x7f465c018090 con 0x7f4664159c20 2023-11-28T21:08:15.316 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:15.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4648066470 msgr2=0x7f4648068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4648066470 0x7f4648068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4658001ba0 tx=0x7f4658009040 comp rx=0 tx=0).stop 2023-11-28T21:08:15.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4664159c20 msgr2=0x7f46640cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4664159c20 0x7f46640cf0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f465c00efc0 tx=0x7f465c00c490 comp rx=0 tx=0).stop 2023-11-28T21:08:15.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 shutdown_connections 2023-11-28T21:08:15.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4648066470 0x7f4648068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4664159c20 0x7f46640cf0f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640b3e90 0x7f4664151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 --2- 172.21.15.6:0/3133314886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4664071100 0x7f46641448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 >> 172.21.15.6:0/3133314886 conn(0x7f466406ab80 msgr2=0x7f466406c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:15.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 shutdown_connections 2023-11-28T21:08:15.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.311+0000 7f466adb8640 1 -- 172.21.15.6:0/3133314886 wait complete. 2023-11-28T21:08:15.338 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":873281008},{"type":"v1","addr":"172.21.15.6:6833","nonce":873281008}]},"active_addr":"172.21.15.6:6833/873281008","active_change":"2023-11-28T21:07:50.639932+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":4218864413}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":4041619954}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3649384748}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3481915394}]}]} 2023-11-28T21:08:15.342 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T21:08:15.342 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T21:08:15.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd34c9640 1 Processor -- start 2023-11-28T21:08:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd34c9640 1 -- start start 2023-11-28T21:08:15.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd34c9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ccc0ce810 0x7f2ccc0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd34c9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2ccc0cfb10 0x7f2ccc0cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd34c9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc0d4050 con 0x7f2ccc160ac0 2023-11-28T21:08:15.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd34c9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc0d0500 con 0x7f2ccc0ce810 2023-11-28T21:08:15.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd34c9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc0b43b0 con 0x7f2ccc0cfb10 2023-11-28T21:08:15.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd1265640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2ccc160ac0 0x7f2ccc0b5f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58162/0 (socket says 172.21.15.6:58162) 2023-11-28T21:08:15.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd1265640 1 -- 172.21.15.6:0/4222407124 learned_addr learned my addr 172.21.15.6:0/4222407124 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd0a64640 1 --2- 172.21.15.6:0/4222407124 >> v2:172.21.15.6:3300/0 conn(0x7f2ccc0ce810 0x7f2ccc0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd1a66640 1 --2- 172.21.15.6:0/4222407124 >> v2:172.21.15.31:3300/0 conn(0x7f2ccc0cfb10 0x7f2ccc0cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cc3fff640 1 -- 172.21.15.6:0/4222407124 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819244458 0 0) 0x7f2cc8001120 con 0x7f2ccc160ac0 2023-11-28T21:08:15.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd0a64640 1 -- 172.21.15.6:0/4222407124 >> v2:172.21.15.31:3300/0 conn(0x7f2ccc0cfb10 msgr2=0x7f2ccc0cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd0a64640 1 --2- 172.21.15.6:0/4222407124 >> v2:172.21.15.31:3300/0 conn(0x7f2ccc0cfb10 0x7f2ccc0cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd0a64640 1 -- 172.21.15.6:0/4222407124 >> v1:172.21.15.6:6789/0 conn(0x7f2ccc160ac0 legacy=0x7f2ccc0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.479+0000 7f2cd0a64640 1 -- 172.21.15.6:0/4222407124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc0cecf0 con 0x7f2ccc0ce810 2023-11-28T21:08:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cd0a64640 1 --2- 172.21.15.6:0/4222407124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc0ce810 0x7f2ccc0d3b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0d3010 tx=0x7f2cbc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c60b46b7048f166 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cc3fff640 1 -- 172.21.15.6:0/4222407124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc004230 con 0x7f2ccc0ce810 2023-11-28T21:08:15.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cc3fff640 1 -- 172.21.15.6:0/4222407124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc0a7050 con 0x7f2ccc0ce810 2023-11-28T21:08:15.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cc3fff640 1 -- 172.21.15.6:0/4222407124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc003620 con 0x7f2ccc0ce810 2023-11-28T21:08:15.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cd34c9640 1 -- 172.21.15.6:0/4222407124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc0ce810 msgr2=0x7f2ccc0d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cd34c9640 1 --2- 172.21.15.6:0/4222407124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc0ce810 0x7f2ccc0d3b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0d3010 tx=0x7f2cbc01c460 comp rx=0 tx=0).stop 2023-11-28T21:08:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cd34c9640 1 -- 172.21.15.6:0/4222407124 shutdown_connections 2023-11-28T21:08:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cd34c9640 1 --2- 172.21.15.6:0/4222407124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc0ce810 0x7f2ccc0d3b10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cd34c9640 1 --2- 172.21.15.6:0/4222407124 >> v2:172.21.15.31:3300/0 conn(0x7f2ccc0cfb10 0x7f2ccc0cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cd34c9640 1 -- 172.21.15.6:0/4222407124 >> 172.21.15.6:0/4222407124 conn(0x7f2ccc09c480 msgr2=0x7f2ccc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cd34c9640 1 -- 172.21.15.6:0/4222407124 shutdown_connections 2023-11-28T21:08:15.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.483+0000 7f2cd34c9640 1 -- 172.21.15.6:0/4222407124 wait complete. 2023-11-28T21:08:15.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 Processor -- start 2023-11-28T21:08:15.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 -- start start 2023-11-28T21:08:15.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ccc0ce810 0x7f2ccc157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ccc0cfb10 0x7f2ccc0cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc160ac0 0x7f2ccc0c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc161900 con 0x7f2ccc160ac0 2023-11-28T21:08:15.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0cc2e0 con 0x7f2ccc0cfb10 2023-11-28T21:08:15.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0c9920 con 0x7f2ccc0ce810 2023-11-28T21:08:15.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1a66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc160ac0 0x7f2ccc0c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1a66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc160ac0 0x7f2ccc0c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44514/0 (socket says 172.21.15.6:44514) 2023-11-28T21:08:15.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1a66640 1 -- 172.21.15.6:0/743463850 learned_addr learned my addr 172.21.15.6:0/743463850 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:15.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1265640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ccc0ce810 0x7f2ccc157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd0a64640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ccc0cfb10 0x7f2ccc0cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1a66640 1 -- 172.21.15.6:0/743463850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ccc0ce810 msgr2=0x7f2ccc157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1a66640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ccc0ce810 0x7f2ccc157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1a66640 1 -- 172.21.15.6:0/743463850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ccc0cfb10 msgr2=0x7f2ccc0cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1a66640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ccc0cfb10 0x7f2ccc0cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1a66640 1 -- 172.21.15.6:0/743463850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc009420 con 0x7f2ccc160ac0 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd1a66640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc160ac0 0x7f2ccc0c6c70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4007d90 tx=0x7f2cc400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cc1ffb640 1 -- 172.21.15.6:0/743463850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4014420 con 0x7f2ccc160ac0 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cc1ffb640 1 -- 172.21.15.6:0/743463850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc40145a0 con 0x7f2ccc160ac0 2023-11-28T21:08:15.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ccc161b50 con 0x7f2ccc160ac0 2023-11-28T21:08:15.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cc1ffb640 1 -- 172.21.15.6:0/743463850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4014950 con 0x7f2ccc160ac0 2023-11-28T21:08:15.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.487+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc157990 con 0x7f2ccc160ac0 2023-11-28T21:08:15.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.491+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ccc0674d0 con 0x7f2ccc160ac0 2023-11-28T21:08:15.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.491+0000 7f2cc1ffb640 1 -- 172.21.15.6:0/743463850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cc4014ab0 con 0x7f2ccc160ac0 2023-11-28T21:08:15.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.491+0000 7f2cc1ffb640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2cb00664a0 0x7f2cb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.491+0000 7f2cc1ffb640 1 -- 172.21.15.6:0/743463850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cc40846c0 con 0x7f2ccc160ac0 2023-11-28T21:08:15.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.491+0000 7f2cd1265640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2cb00664a0 0x7f2cb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.491+0000 7f2cd1265640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2cb00664a0 0x7f2cb0068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8000f70 tx=0x7f2cc8007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:15.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.495+0000 7f2cc1ffb640 1 -- 172.21.15.6:0/743463850 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2cc4051b50 con 0x7f2ccc160ac0 2023-11-28T21:08:15.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ccc162000 con 0x7f2ccc160ac0 2023-11-28T21:08:15.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cc1ffb640 1 -- 172.21.15.6:0/743463850 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f2cc4055170 con 0x7f2ccc160ac0 2023-11-28T21:08:15.661 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:15.661 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2cb00664a0 msgr2=0x7f2cb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2cb00664a0 0x7f2cb0068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8000f70 tx=0x7f2cc8007df0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc160ac0 msgr2=0x7f2ccc0c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc160ac0 0x7f2ccc0c6c70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4007d90 tx=0x7f2cc400e4b0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 shutdown_connections 2023-11-28T21:08:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2cb00664a0 0x7f2cb0068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ccc160ac0 0x7f2ccc0c6c70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ccc0cfb10 0x7f2ccc0cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 --2- 172.21.15.6:0/743463850 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ccc0ce810 0x7f2ccc157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 >> 172.21.15.6:0/743463850 conn(0x7f2ccc09c480 msgr2=0x7f2ccc06bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:15.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.655+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 shutdown_connections 2023-11-28T21:08:15.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.659+0000 7f2cd34c9640 1 -- 172.21.15.6:0/743463850 wait complete. 2023-11-28T21:08:15.683 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T21:08:15.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:15.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.819+0000 7f909806b640 1 Processor -- start 2023-11-28T21:08:15.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.819+0000 7f909806b640 1 -- start start 2023-11-28T21:08:15.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f909806b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f909806b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f909006dd90 0x7f90900b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f909806b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909015e340 con 0x7f909015e7d0 2023-11-28T21:08:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f909806b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909015dae0 con 0x7f909006dd90 2023-11-28T21:08:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f909806b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900b39b0 con 0x7f9090142da0 2023-11-28T21:08:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f9095e07640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f9095e07640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090071fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51304/0 (socket says 172.21.15.6:51304) 2023-11-28T21:08:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f9095e07640 1 -- 172.21.15.6:0/2562908027 learned_addr learned my addr 172.21.15.6:0/2562908027 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f9096608640 1 --2- 172.21.15.6:0/2562908027 >> v2:172.21.15.31:3300/0 conn(0x7f909006dd90 0x7f90900b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f9095e07640 1 -- 172.21.15.6:0/2562908027 >> v2:172.21.15.31:3300/0 conn(0x7f909006dd90 msgr2=0x7f90900b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:15.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f9095e07640 1 --2- 172.21.15.6:0/2562908027 >> v2:172.21.15.31:3300/0 conn(0x7f909006dd90 0x7f90900b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f9095e07640 1 -- 172.21.15.6:0/2562908027 >> v1:172.21.15.31:6789/0 conn(0x7f909015e7d0 legacy=0x7f909006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.823+0000 7f9095e07640 1 -- 172.21.15.6:0/2562908027 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090143440 con 0x7f9090142da0 2023-11-28T21:08:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f9095e07640 1 --2- 172.21.15.6:0/2562908027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090071fb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f908c0098a0 tx=0x7f908c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3efa56c0cec29ab0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f9094e05640 1 -- 172.21.15.6:0/2562908027 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0aa650 con 0x7f9090142da0 2023-11-28T21:08:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f9094e05640 1 -- 172.21.15.6:0/2562908027 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c0aa7b0 con 0x7f9090142da0 2023-11-28T21:08:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f9094e05640 1 -- 172.21.15.6:0/2562908027 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0aab40 con 0x7f9090142da0 2023-11-28T21:08:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 -- 172.21.15.6:0/2562908027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 msgr2=0x7f9090071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 --2- 172.21.15.6:0/2562908027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090071fb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f908c0098a0 tx=0x7f908c01c4f0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 -- 172.21.15.6:0/2562908027 shutdown_connections 2023-11-28T21:08:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 --2- 172.21.15.6:0/2562908027 >> v2:172.21.15.31:3300/0 conn(0x7f909006dd90 0x7f90900b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 --2- 172.21.15.6:0/2562908027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090071fb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 -- 172.21.15.6:0/2562908027 >> 172.21.15.6:0/2562908027 conn(0x7f909006ab80 msgr2=0x7f90900b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 -- 172.21.15.6:0/2562908027 shutdown_connections 2023-11-28T21:08:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 -- 172.21.15.6:0/2562908027 wait complete. 2023-11-28T21:08:15.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 Processor -- start 2023-11-28T21:08:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 -- start start 2023-11-28T21:08:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006dd90 0x7f9090158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909015e7d0 0x7f9090159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909006d830 con 0x7f909006dd90 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909006d550 con 0x7f909015e7d0 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f909806b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900ad8a0 con 0x7f9090142da0 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f9095e07640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006dd90 0x7f9090158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f9095e07640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006dd90 0x7f9090158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44530/0 (socket says 172.21.15.6:44530) 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.827+0000 7f9095e07640 1 -- 172.21.15.6:0/447395289 learned_addr learned my addr 172.21.15.6:0/447395289 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f9096608640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909015e7d0 0x7f9090159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f9095606640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f9095e07640 1 -- 172.21.15.6:0/447395289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 msgr2=0x7f9090159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f9095e07640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f9095e07640 1 -- 172.21.15.6:0/447395289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909015e7d0 msgr2=0x7f9090159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f9095e07640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909015e7d0 0x7f9090159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f9095e07640 1 -- 172.21.15.6:0/447395289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c0094d0 con 0x7f909006dd90 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f9095606640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f9095e07640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006dd90 0x7f9090158eb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f908c01a120 tx=0x7f908c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f90867fc640 1 -- 172.21.15.6:0/447395289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0b3800 con 0x7f909006dd90 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f90867fc640 1 -- 172.21.15.6:0/447395289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c0b3960 con 0x7f909006dd90 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90900adb80 con 0x7f909006dd90 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f90867fc640 1 -- 172.21.15.6:0/447395289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0b3cf0 con 0x7f909006dd90 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90901593f0 con 0x7f909006dd90 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909015a560 con 0x7f909006dd90 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f90867fc640 1 -- 172.21.15.6:0/447395289 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f908c0b2380 con 0x7f909006dd90 2023-11-28T21:08:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.831+0000 7f90867fc640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.835+0000 7f90867fc640 1 -- 172.21.15.6:0/447395289 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f908c11de90 con 0x7f909006dd90 2023-11-28T21:08:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.835+0000 7f9095606640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.835+0000 7f9095606640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9090071860 tx=0x7f9080009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.839+0000 7f90867fc640 1 -- 172.21.15.6:0/447395289 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f908c0eb320 con 0x7f909006dd90 2023-11-28T21:08:16.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.995+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90900674d0 con 0x7f909006dd90 2023-11-28T21:08:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.995+0000 7f90867fc640 1 -- 172.21.15.6:0/447395289 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f908c0ee940 con 0x7f909006dd90 2023-11-28T21:08:16.003 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:16.003 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 msgr2=0x7f9074068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9090071860 tx=0x7f9080009040 comp rx=0 tx=0).stop 2023-11-28T21:08:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006dd90 msgr2=0x7f9090158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006dd90 0x7f9090158eb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f908c01a120 tx=0x7f908c01ad30 comp rx=0 tx=0).stop 2023-11-28T21:08:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 shutdown_connections 2023-11-28T21:08:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9074066470 0x7f9074068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f909015e7d0 0x7f9090159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9090142da0 0x7f9090159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 --2- 172.21.15.6:0/447395289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f909006dd90 0x7f9090158eb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 >> 172.21.15.6:0/447395289 conn(0x7f909006ab80 msgr2=0x7f90900703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 shutdown_connections 2023-11-28T21:08:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:15.999+0000 7f909806b640 1 -- 172.21.15.6:0/447395289 wait complete. 2023-11-28T21:08:16.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T21:08:16.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T21:08:16.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T21:08:16.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T21:08:16.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T21:08:16.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T21:08:16.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T21:08:16.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T21:08:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.267+0000 7feb99a9c640 1 Processor -- start 2023-11-28T21:08:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.267+0000 7feb99a9c640 1 -- start start 2023-11-28T21:08:16.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7fb3fa89c640 1 Processor -- start 2023-11-28T21:08:16.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb99a9c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb940b1e70 0x7feb9406c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7f208d934640 1 Processor -- start 2023-11-28T21:08:16.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb99a9c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb940b22e0 0x7feb9406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb99a9c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940b2850 con 0x7feb9414b0e0 2023-11-28T21:08:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7f208d934640 1 -- start start 2023-11-28T21:08:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7fb3fa89c640 1 -- start start 2023-11-28T21:08:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb99a9c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9414b4c0 con 0x7feb940b1e70 2023-11-28T21:08:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb99a9c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb940b2b30 con 0x7feb940b22e0 2023-11-28T21:08:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb92ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb940b1e70 0x7feb9406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb92ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb940b1e70 0x7feb9406c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44542/0 (socket says 172.21.15.6:44542) 2023-11-28T21:08:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb92ffd640 1 -- 172.21.15.6:0/1407632743 learned_addr learned my addr 172.21.15.6:0/1407632743 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb93fff640 1 --2- 172.21.15.6:0/1407632743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb940b22e0 0x7feb9406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7f208d934640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f2088071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb92ffd640 1 -- 172.21.15.6:0/1407632743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb940b22e0 msgr2=0x7feb9406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb92ffd640 1 --2- 172.21.15.6:0/1407632743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb940b22e0 0x7feb9406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb92ffd640 1 -- 172.21.15.6:0/1407632743 >> v1:172.21.15.31:6789/0 conn(0x7feb9414b0e0 legacy=0x7feb940b38f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T21:08:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7feb92ffd640 1 -- 172.21.15.6:0/1407632743 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940b2e10 con 0x7feb940b1e70 2023-11-28T21:08:16.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7f208d934640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2088072050 con 0x7f208806c5e0 2023-11-28T21:08:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7f208d934640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2088071650 con 0x7f20880b24b0 2023-11-28T21:08:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.271+0000 7f208d934640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2088072310 con 0x7f20880b19c0 2023-11-28T21:08:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7f208c932640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f2088071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7f208c932640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f2088071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51328/0 (socket says 172.21.15.6:51328) 2023-11-28T21:08:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7f208c932640 1 -- 172.21.15.6:0/1805169298 learned_addr learned my addr 172.21.15.6:0/1805169298 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3fa89c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb3f4160980 0x7fb3f40d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f37fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb3f40ce6b0 0x7fb3f40cf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:60578/0 (socket says 172.21.15.6:60578) 2023-11-28T21:08:16.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3fa89c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3f40cfc50 0x7fb3f40b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f37fe640 1 -- 172.21.15.6:0/2989950438 learned_addr learned my addr 172.21.15.6:0/2989950438 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:16.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3fa89c640 1 -- 172.21.15.6:0/2989950438 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f40b2d40 con 0x7fb3f40ce6b0 2023-11-28T21:08:16.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3fa89c640 1 -- 172.21.15.6:0/2989950438 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f40b27d0 con 0x7fb3f4160980 2023-11-28T21:08:16.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3fa89c640 1 -- 172.21.15.6:0/2989950438 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40cf130 con 0x7fb3f40cfc50 2023-11-28T21:08:16.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f8e39640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3f40cfc50 0x7fb3f40b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f3fff640 1 --2- 172.21.15.6:0/2989950438 >> v2:172.21.15.31:3300/0 conn(0x7fb3f4160980 0x7fb3f40d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352734038 0 0) 0x7fb3f40b2d40 con 0x7fb3f40ce6b0 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3dc003530 con 0x7fb3f40ce6b0 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 269930625 0 0) 0x7fb3dc003530 con 0x7fb3f40ce6b0 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3f40cfc50 msgr2=0x7fb3f40b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3f40cfc50 0x7fb3f40b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 >> v2:172.21.15.31:3300/0 conn(0x7fb3f4160980 msgr2=0x7fb3f40d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 --2- 172.21.15.6:0/2989950438 >> v2:172.21.15.31:3300/0 conn(0x7fb3f4160980 0x7fb3f40d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40ceb70 con 0x7fb3f40ce6b0 2023-11-28T21:08:16.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fb3e8001680 con 0x7fb3f40ce6b0 2023-11-28T21:08:16.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 >> v1:172.21.15.31:6789/0 conn(0x7fb3f40ce6b0 legacy=0x7fb3f40cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3dc003980 0x7fb3dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3dc004370 0x7fb3dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3dc004ec0 0x7fb3dc0141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40b27d0 con 0x7fb3dc004ec0 2023-11-28T21:08:16.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40cf130 con 0x7fb3dc004370 2023-11-28T21:08:16.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0146e0 con 0x7fb3dc003980 2023-11-28T21:08:16.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb92ffd640 1 --2- 172.21.15.6:0/1407632743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb940b1e70 0x7feb9406c950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb8801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ae7816e1e4f01d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7fb3f37fe640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3dc004370 0x7fb3dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7fb3f3fff640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3dc003980 0x7fb3dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb927fc640 1 -- 172.21.15.6:0/1407632743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880aa5f0 con 0x7feb940b1e70 2023-11-28T21:08:16.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7fb3f37fe640 1 -- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3dc003980 msgr2=0x7fb3dc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7fb3f37fe640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3dc003980 0x7fb3dc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7fb3f37fe640 1 -- 172.21.15.6:0/2989950438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3dc004ec0 msgr2=0x7fb3dc0141a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T21:08:16.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7fb3f37fe640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3dc004ec0 0x7fb3dc0141a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7fb3f37fe640 1 -- 172.21.15.6:0/2989950438 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40ceb70 con 0x7fb3dc004370 2023-11-28T21:08:16.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb927fc640 1 -- 172.21.15.6:0/1407632743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880aa750 con 0x7feb940b1e70 2023-11-28T21:08:16.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb927fc640 1 -- 172.21.15.6:0/1407632743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880aaae0 con 0x7feb940b1e70 2023-11-28T21:08:16.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb99a9c640 1 -- 172.21.15.6:0/1407632743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb940b1e70 msgr2=0x7feb9406c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb99a9c640 1 --2- 172.21.15.6:0/1407632743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb940b1e70 0x7feb9406c950 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb8801c4d0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb99a9c640 1 -- 172.21.15.6:0/1407632743 shutdown_connections 2023-11-28T21:08:16.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb99a9c640 1 --2- 172.21.15.6:0/1407632743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb940b22e0 0x7feb9406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb99a9c640 1 --2- 172.21.15.6:0/1407632743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb940b1e70 0x7feb9406c950 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb99a9c640 1 -- 172.21.15.6:0/1407632743 >> 172.21.15.6:0/1407632743 conn(0x7feb9406a980 msgr2=0x7feb9406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb99a9c640 1 -- 172.21.15.6:0/1407632743 shutdown_connections 2023-11-28T21:08:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7feb99a9c640 1 -- 172.21.15.6:0/1407632743 wait complete. 2023-11-28T21:08:16.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7f208c932640 1 -- 172.21.15.6:0/1805169298 >> v1:172.21.15.31:6789/0 conn(0x7f20880b24b0 legacy=0x7f20880ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7f208c932640 1 -- 172.21.15.6:0/1805169298 >> v1:172.21.15.6:6789/0 conn(0x7f208806c5e0 legacy=0x7f20880b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.279+0000 7f208c932640 1 -- 172.21.15.6:0/1805169298 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880ac890 con 0x7f20880b19c0 2023-11-28T21:08:16.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.275+0000 7f20877fe640 1 -- 172.21.15.6:0/1805169298 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613825342 0 0) 0x7f2088071650 con 0x7f20880b24b0 2023-11-28T21:08:16.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7f208c932640 1 --2- 172.21.15.6:0/1805169298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f2088071110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2078009e80 tx=0x7f207801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5acd1c91351da5b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3f37fe640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3dc004370 0x7fb3dc004850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800c290 tx=0x7fb3e801ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b7ebbe14cc7118a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7f20877fe640 1 -- 172.21.15.6:0/1805169298 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780a5720 con 0x7f20880b19c0 2023-11-28T21:08:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80a5910 con 0x7fb3dc004370 2023-11-28T21:08:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e80a5a90 con 0x7fb3dc004370 2023-11-28T21:08:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3f2ffd640 1 -- 172.21.15.6:0/2989950438 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80a5e80 con 0x7fb3dc004370 2023-11-28T21:08:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7f20877fe640 1 -- 172.21.15.6:0/1805169298 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20780a5880 con 0x7f20880b19c0 2023-11-28T21:08:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7f20877fe640 1 -- 172.21.15.6:0/1805169298 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20780a5c10 con 0x7f20880b19c0 2023-11-28T21:08:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7feb99a9c640 1 Processor -- start 2023-11-28T21:08:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3fa89c640 1 -- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3dc004370 msgr2=0x7fb3dc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3fa89c640 1 --2- 172.21.15.6:0/2989950438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3dc004370 0x7fb3dc004850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800c290 tx=0x7fb3e801ccc0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3f8e39640 1 -- 172.21.15.6:0/2989950438 reap_dead start 2023-11-28T21:08:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7f208d934640 1 -- 172.21.15.6:0/1805169298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 msgr2=0x7f2088071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7f208d934640 1 --2- 172.21.15.6:0/1805169298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f2088071110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2078009e80 tx=0x7f207801c8e0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7feb99a9c640 1 -- start start 2023-11-28T21:08:16.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3fa89c640 1 -- 172.21.15.6:0/2989950438 shutdown_connections 2023-11-28T21:08:16.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3fa89c640 1 -- 172.21.15.6:0/2989950438 >> 172.21.15.6:0/2989950438 conn(0x7fb3f40d3000 msgr2=0x7fb3f40d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7f208d934640 1 -- 172.21.15.6:0/1805169298 shutdown_connections 2023-11-28T21:08:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7f208d934640 1 --2- 172.21.15.6:0/1805169298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f2088071110 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fc62a609640 1 Processor -- start 2023-11-28T21:08:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.283+0000 7fb3fa89c640 1 -- 172.21.15.6:0/2989950438 shutdown_connections 2023-11-28T21:08:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7f208d934640 1 -- 172.21.15.6:0/1805169298 >> 172.21.15.6:0/1805169298 conn(0x7f208806a750 msgr2=0x7f208806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fb3fa89c640 1 -- 172.21.15.6:0/2989950438 wait complete. 2023-11-28T21:08:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb99a9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb940b1e70 0x7feb94140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb99a9c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb940b22e0 0x7feb9415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb99a9c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9414b0e0 0x7feb9415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb99a9c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9415bd70 con 0x7feb940b1e70 2023-11-28T21:08:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb99a9c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb94144b20 con 0x7feb940b22e0 2023-11-28T21:08:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb99a9c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb941441f0 con 0x7feb9414b0e0 2023-11-28T21:08:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fc62a609640 1 -- start start 2023-11-28T21:08:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7f208d934640 1 -- 172.21.15.6:0/1805169298 shutdown_connections 2023-11-28T21:08:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7f208d934640 1 -- 172.21.15.6:0/1805169298 wait complete. 2023-11-28T21:08:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb940b1e70 0x7feb94140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb92ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb940b22e0 0x7feb9415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb92ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb940b22e0 0x7feb9415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43304/0 (socket says 172.21.15.6:43304) 2023-11-28T21:08:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb92ffd640 1 -- 172.21.15.6:0/4236370146 learned_addr learned my addr 172.21.15.6:0/4236370146 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb93fff640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9414b0e0 0x7feb9415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb92ffd640 1 -- 172.21.15.6:0/4236370146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9414b0e0 msgr2=0x7feb9415c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb92ffd640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb9414b0e0 0x7feb9415c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb92ffd640 1 -- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb940b1e70 msgr2=0x7feb94140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb92ffd640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb940b1e70 0x7feb94140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb92ffd640 1 -- 172.21.15.6:0/4236370146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880094d0 con 0x7feb940b22e0 2023-11-28T21:08:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb92ffd640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb940b22e0 0x7feb9415bee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb880ac040 tx=0x7feb8801ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fc62a609640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc62414b0e0 0x7fc6240b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fc62a609640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6240b1e70 0x7fc62406c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fc62a609640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6240b3e30 con 0x7fc6240b22d0 2023-11-28T21:08:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fc62a609640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62414b4c0 con 0x7fc6240b1e70 2023-11-28T21:08:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fc62a609640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240b2850 con 0x7fc62414b0e0 2023-11-28T21:08:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fb3fa89c640 1 Processor -- start 2023-11-28T21:08:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb7bfff640 1 -- 172.21.15.6:0/4236370146 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880b3800 con 0x7feb940b22e0 2023-11-28T21:08:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb7bfff640 1 -- 172.21.15.6:0/4236370146 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880b3980 con 0x7feb940b22e0 2023-11-28T21:08:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb7bfff640 1 -- 172.21.15.6:0/4236370146 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880b3d30 con 0x7feb940b22e0 2023-11-28T21:08:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb941444d0 con 0x7feb940b22e0 2023-11-28T21:08:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb94141500 con 0x7feb940b22e0 2023-11-28T21:08:16.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fb3fa89c640 1 -- start start 2023-11-28T21:08:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fc623fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc62414b0e0 0x7fc6240b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fc623fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc62414b0e0 0x7fc6240b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51368/0 (socket says 172.21.15.6:51368) 2023-11-28T21:08:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7fc623fff640 1 -- 172.21.15.6:0/1784275694 learned_addr learned my addr 172.21.15.6:0/1784275694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.287+0000 7facfffff640 1 Processor -- start 2023-11-28T21:08:16.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7facfffff640 1 -- start start 2023-11-28T21:08:16.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb94071bc0 con 0x7feb940b22e0 2023-11-28T21:08:16.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fc6237fe640 1 --2- 172.21.15.6:0/1784275694 >> v2:172.21.15.6:3300/0 conn(0x7fc6240b1e70 0x7fc62406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fc623fff640 1 -- 172.21.15.6:0/1784275694 >> v2:172.21.15.6:3300/0 conn(0x7fc6240b1e70 msgr2=0x7fc62406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fc623fff640 1 --2- 172.21.15.6:0/1784275694 >> v2:172.21.15.6:3300/0 conn(0x7fc6240b1e70 0x7fc62406c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fc623fff640 1 -- 172.21.15.6:0/1784275694 >> v1:172.21.15.6:6789/0 conn(0x7fc6240b22d0 legacy=0x7fc6240cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fc623fff640 1 -- 172.21.15.6:0/1784275694 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240b2b30 con 0x7fc62414b0e0 2023-11-28T21:08:16.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3fa89c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3dc004370 0x7fb3f4147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3fa89c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3f40c8c40 0x7fb3f41ee280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3fa89c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3f4142240 0x7fb3f41448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7f4ff5393640 1 Processor -- start 2023-11-28T21:08:16.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7f4ff5393640 1 -- start start 2023-11-28T21:08:16.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3fa89c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f41561b0 con 0x7fb3dc004370 2023-11-28T21:08:16.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7f67484aa640 1 Processor -- start 2023-11-28T21:08:16.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3fa89c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40c9a70 con 0x7fb3f40c8c40 2023-11-28T21:08:16.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3fa89c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40c91d0 con 0x7fb3f4142240 2023-11-28T21:08:16.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3dc004370 0x7fb3f4147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3dc004370 0x7fb3f4147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44562/0 (socket says 172.21.15.6:44562) 2023-11-28T21:08:16.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f3fff640 1 -- 172.21.15.6:0/4214405659 learned_addr learned my addr 172.21.15.6:0/4214405659 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f8e39640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3f4142240 0x7fb3f41448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f37fe640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3f40c8c40 0x7fb3f41ee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f37fe640 1 -- 172.21.15.6:0/4214405659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3f4142240 msgr2=0x7fb3f41448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f37fe640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3f4142240 0x7fb3f41448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f37fe640 1 -- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3dc004370 msgr2=0x7fb3f4147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f37fe640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3dc004370 0x7fb3f4147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f37fe640 1 -- 172.21.15.6:0/4214405659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40c94b0 con 0x7fb3f40c8c40 2023-11-28T21:08:16.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f37fe640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3f40c8c40 0x7fb3f41ee280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009000 tx=0x7fb3dc005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7facfffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad000cf3b0 0x7fad00070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7feb7bfff640 1 -- 172.21.15.6:0/4236370146 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb880c6390 con 0x7feb940b22e0 2023-11-28T21:08:16.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7facfeffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fad0015bb80 0x7fad000ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:60582/0 (socket says 172.21.15.6:60582) 2023-11-28T21:08:16.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f0ff9640 1 -- 172.21.15.6:0/4214405659 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80070d0 con 0x7fb3f40c8c40 2023-11-28T21:08:16.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f0ff9640 1 -- 172.21.15.6:0/4214405659 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e8007230 con 0x7fb3f40c8c40 2023-11-28T21:08:16.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7fb3f0ff9640 1 -- 172.21.15.6:0/4214405659 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80075a0 con 0x7fb3f40c8c40 2023-11-28T21:08:16.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7f4ff5393640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ff0070520 0x7f4ff00b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7f67484aa640 1 -- start start 2023-11-28T21:08:16.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfe7fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad000cf3b0 0x7fad00070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfe7fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad000cf3b0 0x7fad00070140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51372/0 (socket says 172.21.15.6:51372) 2023-11-28T21:08:16.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfe7fc640 1 -- 172.21.15.6:0/4174590448 learned_addr learned my addr 172.21.15.6:0/4174590448 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.291+0000 7f4ff5393640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ff006c3d0 0x7f4ff00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f67484aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67400714f0 0x7f674015d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f67484aa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f674006ca80 0x7f674006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f67484aa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67400ae8e0 con 0x7f67401591a0 2023-11-28T21:08:16.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f67484aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6740072700 con 0x7f67400714f0 2023-11-28T21:08:16.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f67484aa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674006d430 con 0x7f674006ca80 2023-11-28T21:08:16.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4ff5393640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00b2b40 con 0x7f4ff00adaf0 2023-11-28T21:08:16.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfffff640 1 --2- 172.21.15.6:0/4174590448 >> v2:172.21.15.6:3300/0 conn(0x7fad00070680 0x7fad000b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4ff4b92640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4ff00adaf0 0x7f4ff0070900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:60588/0 (socket says 172.21.15.6:60588) 2023-11-28T21:08:16.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4ff4b92640 1 -- 172.21.15.6:0/2705633044 learned_addr learned my addr 172.21.15.6:0/2705633044 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:16.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4ff5393640 1 -- 172.21.15.6:0/2705633044 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff00ac7f0 con 0x7f4ff0070520 2023-11-28T21:08:16.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f40c9790 con 0x7fb3f40c8c40 2023-11-28T21:08:16.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f4148630 con 0x7fb3f40c8c40 2023-11-28T21:08:16.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7feb7bfff640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7feb80066540 0x7feb80068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7feb7bfff640 1 -- 172.21.15.6:0/4236370146 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb880a7070 con 0x7feb940b22e0 2023-11-28T21:08:16.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f6746a47640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f674006ca80 0x7f674006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4fef7fe640 1 --2- 172.21.15.6:0/2705633044 >> v2:172.21.15.31:3300/0 conn(0x7f4ff006c3d0 0x7f4ff00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7feb7bfff640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7feb8006e760 0x7feb80070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7feb7bfff640 1 -- 172.21.15.6:0/4236370146 --> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb80071230 con 0x7feb8006e760 2023-11-28T21:08:16.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7feb7bfff640 1 -- 172.21.15.6:0/4236370146 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb8811ec10 con 0x7feb940b22e0 2023-11-28T21:08:16.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f6746a47640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f674006ca80 0x7f674006cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43318/0 (socket says 172.21.15.6:43318) 2023-11-28T21:08:16.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4ff5393640 1 -- 172.21.15.6:0/2705633044 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff00acad0 con 0x7f4ff006c3d0 2023-11-28T21:08:16.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f6746246640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f67401591a0 0x7f67400b1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:60590/0 (socket says 172.21.15.6:60590) 2023-11-28T21:08:16.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f6746246640 1 -- 172.21.15.6:0/3007685268 learned_addr learned my addr 172.21.15.6:0/3007685268 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:16.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfffff640 1 -- 172.21.15.6:0/4174590448 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad00162910 con 0x7fad0015bb80 2023-11-28T21:08:16.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3f40b29d0 con 0x7fb3f40c8c40 2023-11-28T21:08:16.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4feffff640 1 --2- 172.21.15.6:0/2705633044 >> v2:172.21.15.6:3300/0 conn(0x7f4ff0070520 0x7f4ff00b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfffff640 1 -- 172.21.15.6:0/4174590448 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad00070b30 con 0x7fad00070680 2023-11-28T21:08:16.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f208d934640 1 Processor -- start 2023-11-28T21:08:16.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfffff640 1 -- 172.21.15.6:0/4174590448 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0006c0f0 con 0x7fad000cf3b0 2023-11-28T21:08:16.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4fef7fe640 1 -- 172.21.15.6:0/2705633044 >> v2:172.21.15.6:3300/0 conn(0x7f4ff0070520 msgr2=0x7f4ff00b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facff7fe640 1 --2- 172.21.15.6:0/4174590448 >> v2:172.21.15.6:3300/0 conn(0x7fad00070680 0x7fad000b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7feb937fe640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7feb80066540 0x7feb80068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f6745a45640 1 --2- 172.21.15.6:0/3007685268 >> v2:172.21.15.6:3300/0 conn(0x7f67400714f0 0x7f674015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfdffb640 1 -- 172.21.15.6:0/4174590448 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907371353 0 0) 0x7fad00162910 con 0x7fad0015bb80 2023-11-28T21:08:16.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfdffb640 1 -- 172.21.15.6:0/4174590448 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face8003530 con 0x7fad0015bb80 2023-11-28T21:08:16.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f6745a45640 1 -- 172.21.15.6:0/3007685268 >> v2:172.21.15.31:3300/0 conn(0x7f674006ca80 msgr2=0x7f674006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f6745a45640 1 --2- 172.21.15.6:0/3007685268 >> v2:172.21.15.31:3300/0 conn(0x7f674006ca80 0x7f674006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f6745a45640 1 -- 172.21.15.6:0/3007685268 >> v1:172.21.15.31:6789/0 conn(0x7f67401591a0 legacy=0x7f67400b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f6745a45640 1 -- 172.21.15.6:0/3007685268 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400cca70 con 0x7f67400714f0 2023-11-28T21:08:16.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4fef7fe640 1 --2- 172.21.15.6:0/2705633044 >> v2:172.21.15.6:3300/0 conn(0x7f4ff0070520 0x7f4ff00b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4fef7fe640 1 -- 172.21.15.6:0/2705633044 >> v1:172.21.15.31:6789/0 conn(0x7f4ff00adaf0 legacy=0x7f4ff0070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4fef7fe640 1 -- 172.21.15.6:0/2705633044 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00acdb0 con 0x7f4ff006c3d0 2023-11-28T21:08:16.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4feeffd640 1 -- 172.21.15.6:0/2705633044 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686081504 0 0) 0x7f4ff00b2b40 con 0x7f4ff00adaf0 2023-11-28T21:08:16.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f4feffff640 1 --2- 172.21.15.6:0/2705633044 >> v2:172.21.15.6:3300/0 conn(0x7f4ff0070520 0x7f4ff00b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:16.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7feb937fe640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7feb80066540 0x7feb80068a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009f60 tx=0x7feb8c0094f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7feb93fff640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7feb8006e760 0x7feb80070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfe7fc640 1 -- 172.21.15.6:0/4174590448 >> v2:172.21.15.6:3300/0 conn(0x7fad00070680 msgr2=0x7fad000b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfe7fc640 1 --2- 172.21.15.6:0/4174590448 >> v2:172.21.15.6:3300/0 conn(0x7fad00070680 0x7fad000b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfe7fc640 1 -- 172.21.15.6:0/4174590448 >> v1:172.21.15.31:6789/0 conn(0x7fad0015bb80 legacy=0x7fad000ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7facfe7fc640 1 -- 172.21.15.6:0/4174590448 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0006c3d0 con 0x7fad000cf3b0 2023-11-28T21:08:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7fb3f0ff9640 1 -- 172.21.15.6:0/4214405659 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3e80b5020 con 0x7fb3f40c8c40 2023-11-28T21:08:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.295+0000 7f208d934640 1 -- start start 2023-11-28T21:08:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208d934640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208806c5e0 0x7f208814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208d934640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f208815c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208d934640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20880b24b0 0x7f20880a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208d934640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208815c4a0 con 0x7f208806c5e0 2023-11-28T21:08:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208d934640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208815b820 con 0x7f20880b24b0 2023-11-28T21:08:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208d934640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208815bb00 con 0x7f20880b19c0 2023-11-28T21:08:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f2087fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f208815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208c932640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208806c5e0 0x7f208814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f2087fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f208815c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51374/0 (socket says 172.21.15.6:51374) 2023-11-28T21:08:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f2087fff640 1 -- 172.21.15.6:0/3694130173 learned_addr learned my addr 172.21.15.6:0/3694130173 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208d133640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20880b24b0 0x7f20880a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f2087fff640 1 -- 172.21.15.6:0/3694130173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20880b24b0 msgr2=0x7f20880a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f2087fff640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20880b24b0 0x7f20880a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f2087fff640 1 -- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208806c5e0 msgr2=0x7f208814d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f2087fff640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208806c5e0 0x7f208814d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f2087fff640 1 -- 172.21.15.6:0/3694130173 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078009b30 con 0x7f20880b19c0 2023-11-28T21:08:16.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7fb3f0ff9640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb3e0066570 0x7fb3e0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7fb3f0ff9640 1 -- 172.21.15.6:0/4214405659 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3e811e1b0 con 0x7fb3f40c8c40 2023-11-28T21:08:16.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f4fef7fe640 1 --2- 172.21.15.6:0/2705633044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff006c3d0 0x7f4ff00ad5b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0068140 tx=0x7f4fe401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19331adf6f867e9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f2087fff640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f208815c640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f207000e3e0 tx=0x7f207000e8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f20857fa640 1 -- 172.21.15.6:0/3694130173 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070004020 con 0x7f20880b19c0 2023-11-28T21:08:16.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f20857fa640 1 -- 172.21.15.6:0/3694130173 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20700041a0 con 0x7f20880b19c0 2023-11-28T21:08:16.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f20857fa640 1 -- 172.21.15.6:0/3694130173 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070014630 con 0x7f20880b19c0 2023-11-28T21:08:16.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208815bde0 con 0x7f20880b19c0 2023-11-28T21:08:16.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7feb93fff640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7feb8006e760 0x7feb80070b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208814daa0 con 0x7f20880b19c0 2023-11-28T21:08:16.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f4feeffd640 1 -- 172.21.15.6:0/2705633044 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40ac620 con 0x7f4ff006c3d0 2023-11-28T21:08:16.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f6745a45640 1 --2- 172.21.15.6:0/3007685268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67400714f0 0x7f674015d820 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f67400ced50 tx=0x7f673401d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e019426d344eb283 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f4feeffd640 1 -- 172.21.15.6:0/2705633044 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe40ac780 con 0x7f4ff006c3d0 2023-11-28T21:08:16.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7f4feeffd640 1 -- 172.21.15.6:0/2705633044 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe40acb10 con 0x7f4ff006c3d0 2023-11-28T21:08:16.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7fb3f0ff9640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fb3e006e790 0x7fb3e0070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7fb3f0ff9640 1 -- 172.21.15.6:0/4214405659 --> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3e0071260 con 0x7fb3e006e790 2023-11-28T21:08:16.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7fb3f0ff9640 1 -- 172.21.15.6:0/4214405659 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3e811e560 con 0x7fb3f40c8c40 2023-11-28T21:08:16.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7fb3f3fff640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb3e0066570 0x7fb3e0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.299+0000 7fb3f8e39640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fb3e006e790 0x7fb3e0070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc623fff640 1 --2- 172.21.15.6:0/1784275694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc62414b0e0 0x7fc6240b38f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc614009870 tx=0x7fc61401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15aed0a4394cd4f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2088159040 con 0x7f20880b19c0 2023-11-28T21:08:16.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f4ff5393640 1 -- 172.21.15.6:0/2705633044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff006c3d0 msgr2=0x7f4ff00ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f4ff5393640 1 --2- 172.21.15.6:0/2705633044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff006c3d0 0x7f4ff00ad5b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0068140 tx=0x7f4fe401c3e0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7feb7bfff640 1 -- 172.21.15.6:0/4236370146 <== osd.1 v2:172.21.15.6:6824/3767937329 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feb80071230 con 0x7feb8006e760 2023-11-28T21:08:16.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fb3f3fff640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb3e0066570 0x7fb3e0068a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009b60 tx=0x7fb3e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f4ff5393640 1 -- 172.21.15.6:0/2705633044 shutdown_connections 2023-11-28T21:08:16.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f4ff5393640 1 --2- 172.21.15.6:0/2705633044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff006c3d0 0x7f4ff00ad5b0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0068140 tx=0x7f4fe401c3e0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f4ff5393640 1 --2- 172.21.15.6:0/2705633044 >> v2:172.21.15.6:3300/0 conn(0x7f4ff0070520 0x7f4ff00b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f4ff5393640 1 -- 172.21.15.6:0/2705633044 >> 172.21.15.6:0/2705633044 conn(0x7f4ff006a750 msgr2=0x7f4ff006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fb3f8e39640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fb3e006e790 0x7fb3e0070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc622ffd640 1 -- 172.21.15.6:0/1784275694 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140ad680 con 0x7fc62414b0e0 2023-11-28T21:08:16.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc622ffd640 1 -- 172.21.15.6:0/1784275694 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6140ad7e0 con 0x7fc62414b0e0 2023-11-28T21:08:16.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc622ffd640 1 -- 172.21.15.6:0/1784275694 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140adb70 con 0x7fc62414b0e0 2023-11-28T21:08:16.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc62a609640 1 -- 172.21.15.6:0/1784275694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc62414b0e0 msgr2=0x7fc6240b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f4ff5393640 1 -- 172.21.15.6:0/2705633044 shutdown_connections 2023-11-28T21:08:16.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc62a609640 1 --2- 172.21.15.6:0/1784275694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc62414b0e0 0x7fc6240b38f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc614009870 tx=0x7fc61401c4f0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f4ff5393640 1 -- 172.21.15.6:0/2705633044 wait complete. 2023-11-28T21:08:16.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fb3f0ff9640 1 -- 172.21.15.6:0/4214405659 <== osd.2 v2:172.21.15.6:6816/78494204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb3e0071260 con 0x7fb3e006e790 2023-11-28T21:08:16.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc62a609640 1 -- 172.21.15.6:0/1784275694 shutdown_connections 2023-11-28T21:08:16.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc62a609640 1 --2- 172.21.15.6:0/1784275694 >> v2:172.21.15.6:3300/0 conn(0x7fc6240b1e70 0x7fc62406c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc62a609640 1 --2- 172.21.15.6:0/1784275694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc62414b0e0 0x7fc6240b38f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc62a609640 1 -- 172.21.15.6:0/1784275694 >> 172.21.15.6:0/1784275694 conn(0x7fc62406a980 msgr2=0x7fc62406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f6745244640 1 -- 172.21.15.6:0/3007685268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340ac600 con 0x7f67400714f0 2023-11-28T21:08:16.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7facfe7fc640 1 --2- 172.21.15.6:0/4174590448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad000cf3b0 0x7fad00070140 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7facf4009870 tx=0x7facf401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baafe3fb788465e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f6745244640 1 -- 172.21.15.6:0/3007685268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67340a8050 con 0x7f67400714f0 2023-11-28T21:08:16.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f6745244640 1 -- 172.21.15.6:0/3007685268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340ac980 con 0x7f67400714f0 2023-11-28T21:08:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc62a609640 1 -- 172.21.15.6:0/1784275694 shutdown_connections 2023-11-28T21:08:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7fc62a609640 1 -- 172.21.15.6:0/1784275694 wait complete. 2023-11-28T21:08:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.303+0000 7f20857fa640 1 -- 172.21.15.6:0/3694130173 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2070014790 con 0x7f20880b19c0 2023-11-28T21:08:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f20857fa640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2068066540 0x7f2068068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f20857fa640 1 -- 172.21.15.6:0/3694130173 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20700874e0 con 0x7f20880b19c0 2023-11-28T21:08:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f208c932640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2068066540 0x7f2068068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f20857fa640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f206806e760 0x7f2068070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f20857fa640 1 -- 172.21.15.6:0/3694130173 --> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2068071230 con 0x7f206806e760 2023-11-28T21:08:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f20857fa640 1 -- 172.21.15.6:0/3694130173 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2070087890 con 0x7f20880b19c0 2023-11-28T21:08:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f67484aa640 1 -- 172.21.15.6:0/3007685268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67400714f0 msgr2=0x7f674015d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f67484aa640 1 --2- 172.21.15.6:0/3007685268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67400714f0 0x7f674015d820 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f67400ced50 tx=0x7f673401d400 comp rx=0 tx=0).stop 2023-11-28T21:08:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f67484aa640 1 -- 172.21.15.6:0/3007685268 shutdown_connections 2023-11-28T21:08:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f67484aa640 1 --2- 172.21.15.6:0/3007685268 >> v2:172.21.15.31:3300/0 conn(0x7f674006ca80 0x7f674006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f67484aa640 1 --2- 172.21.15.6:0/3007685268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67400714f0 0x7f674015d820 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f67484aa640 1 -- 172.21.15.6:0/3007685268 >> 172.21.15.6:0/3007685268 conn(0x7f674006a580 msgr2=0x7f674006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f67484aa640 1 -- 172.21.15.6:0/3007685268 shutdown_connections 2023-11-28T21:08:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7fb374dd1640 1 Processor -- start 2023-11-28T21:08:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f4ff5393640 1 Processor -- start 2023-11-28T21:08:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7facfdffb640 1 -- 172.21.15.6:0/4174590448 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf40ac600 con 0x7fad000cf3b0 2023-11-28T21:08:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7fc62a609640 1 Processor -- start 2023-11-28T21:08:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7fc62a609640 1 -- start start 2023-11-28T21:08:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f208d133640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f206806e760 0x7f2068070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f208d133640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f206806e760 0x7f2068070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7fb374dd1640 1 -- start start 2023-11-28T21:08:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb374dd1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb370160b40 0x7fb3700cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb374dd1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3700d1f20 0x7fb3700d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb374dd1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3700cf380 con 0x7fb3700b4670 2023-11-28T21:08:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb374dd1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3700b4b70 con 0x7fb3700d1f20 2023-11-28T21:08:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb374dd1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3700d3a70 con 0x7fb370160b40 2023-11-28T21:08:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7facfdffb640 1 -- 172.21.15.6:0/4174590448 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf40a8050 con 0x7fad000cf3b0 2023-11-28T21:08:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7facfdffb640 1 -- 172.21.15.6:0/4174590448 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf40ac600 con 0x7fad000cf3b0 2023-11-28T21:08:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.307+0000 7f67484aa640 1 -- 172.21.15.6:0/3007685268 wait complete. 2023-11-28T21:08:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f67484aa640 1 Processor -- start 2023-11-28T21:08:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb36ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3700d1f20 0x7fb3700d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb36ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3700d1f20 0x7fb3700d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44602/0 (socket says 172.21.15.6:44602) 2023-11-28T21:08:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb36ed9d640 1 -- 172.21.15.6:0/3588617946 learned_addr learned my addr 172.21.15.6:0/3588617946 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f208c932640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2068066540 0x7f2068068a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20780ae000 tx=0x7f20780a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb36e59c640 1 --2- 172.21.15.6:0/3588617946 >> v2:172.21.15.31:3300/0 conn(0x7fb370160b40 0x7fb3700cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb36ed9d640 1 -- 172.21.15.6:0/3588617946 >> v2:172.21.15.31:3300/0 conn(0x7fb370160b40 msgr2=0x7fb3700cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb36ed9d640 1 --2- 172.21.15.6:0/3588617946 >> v2:172.21.15.31:3300/0 conn(0x7fb370160b40 0x7fb3700cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb36ed9d640 1 -- 172.21.15.6:0/3588617946 >> v1:172.21.15.6:6789/0 conn(0x7fb3700b4670 legacy=0x7fb370161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fb36ed9d640 1 -- 172.21.15.6:0/3588617946 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3700d3d50 con 0x7fb3700d1f20 2023-11-28T21:08:16.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f67484aa640 1 -- start start 2023-11-28T21:08:16.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7facfffff640 1 -- 172.21.15.6:0/4174590448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad000cf3b0 msgr2=0x7fad00070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7facfffff640 1 --2- 172.21.15.6:0/4174590448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad000cf3b0 0x7fad00070140 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7facf4009870 tx=0x7facf401c4b0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff5393640 1 -- start start 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff5393640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ff0070520 0x7f4ff014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff5393640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ff00adaf0 0x7f4ff0155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff5393640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff0148680 0x7f4ff0156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff5393640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff014fb10 con 0x7f4ff0070520 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff5393640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff00ccbf0 con 0x7f4ff0148680 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff5393640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff0155650 con 0x7f4ff00adaf0 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4fef7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ff00adaf0 0x7f4ff0155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff4b92640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff0148680 0x7f4ff0156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4fef7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ff00adaf0 0x7f4ff0155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51386/0 (socket says 172.21.15.6:51386) 2023-11-28T21:08:16.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4fef7fe640 1 -- 172.21.15.6:0/3097784851 learned_addr learned my addr 172.21.15.6:0/3097784851 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f20857fa640 1 -- 172.21.15.6:0/3694130173 <== osd.0 v2:172.21.15.6:6800/3567023430 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2068071230 con 0x7f206806e760 2023-11-28T21:08:16.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fc62a609640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6240b1e70 0x7fc624163b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7fc62a609640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240b22d0 0x7fc624148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff4b92640 1 -- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ff00adaf0 msgr2=0x7f4ff0155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff4b92640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ff00adaf0 0x7f4ff0155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff4b92640 1 -- 172.21.15.6:0/3097784851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ff0070520 msgr2=0x7f4ff014fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f67484aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674006ca80 0x7f67400b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f67484aa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67400714f0 0x7f6740202560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff4b92640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ff0070520 0x7f4ff014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7f4ff4b92640 1 -- 172.21.15.6:0/3097784851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe4009420 con 0x7f4ff0148680 2023-11-28T21:08:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.311+0000 7facfffff640 1 -- 172.21.15.6:0/4174590448 shutdown_connections 2023-11-28T21:08:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7facfffff640 1 --2- 172.21.15.6:0/4174590448 >> v2:172.21.15.6:3300/0 conn(0x7fad00070680 0x7fad000b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f67484aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67401591a0 0x7f6740153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6745a45640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67400714f0 0x7f6740202560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6745a45640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67400714f0 0x7f6740202560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43358/0 (socket says 172.21.15.6:43358) 2023-11-28T21:08:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f4ff4b92640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff0148680 0x7f4ff0156e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c780 tx=0x7f4fe000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc62a609640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc62414b0e0 0x7fc62415ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc62a609640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6241498e0 con 0x7fc6240b22d0 2023-11-28T21:08:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc62a609640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc624149bc0 con 0x7fc62414b0e0 2023-11-28T21:08:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc62a609640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc624149ea0 con 0x7fc6240b1e70 2023-11-28T21:08:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240b22d0 0x7fc624148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7facfffff640 1 --2- 172.21.15.6:0/4174590448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad000cf3b0 0x7fad00070140 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7facfffff640 1 -- 172.21.15.6:0/4174590448 >> 172.21.15.6:0/4174590448 conn(0x7fad0006a750 msgr2=0x7fad0006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240b22d0 0x7fc624148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44634/0 (socket says 172.21.15.6:44634) 2023-11-28T21:08:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc6237fe640 1 -- 172.21.15.6:0/677652824 learned_addr learned my addr 172.21.15.6:0/677652824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc628ba6640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc62414b0e0 0x7fc62415ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc623fff640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6240b1e70 0x7fc624163b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f67484aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740153760 con 0x7f674006ca80 2023-11-28T21:08:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f67484aa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6740153990 con 0x7f67400714f0 2023-11-28T21:08:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f67484aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740153c70 con 0x7f67401591a0 2023-11-28T21:08:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746246640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674006ca80 0x7f67400b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746246640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674006ca80 0x7f67400b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44642/0 (socket says 172.21.15.6:44642) 2023-11-28T21:08:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746246640 1 -- 172.21.15.6:0/3697062536 learned_addr learned my addr 172.21.15.6:0/3697062536 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f4fecff9640 1 -- 172.21.15.6:0/3097784851 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000ce30 con 0x7f4ff0148680 2023-11-28T21:08:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f4fecff9640 1 -- 172.21.15.6:0/3097784851 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe000a640 con 0x7f4ff0148680 2023-11-28T21:08:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f4fecff9640 1 -- 172.21.15.6:0/3097784851 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000a9f0 con 0x7f4ff0148680 2023-11-28T21:08:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7facfffff640 1 -- 172.21.15.6:0/4174590448 shutdown_connections 2023-11-28T21:08:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc623fff640 1 -- 172.21.15.6:0/677652824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc62414b0e0 msgr2=0x7fc62415ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc623fff640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc62414b0e0 0x7fc62415ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746a47640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67401591a0 0x7f6740153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc623fff640 1 -- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240b22d0 msgr2=0x7fc624148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc623fff640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240b22d0 0x7fc624148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc623fff640 1 -- 172.21.15.6:0/677652824 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140094d0 con 0x7fc6240b1e70 2023-11-28T21:08:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7facfffff640 1 -- 172.21.15.6:0/4174590448 wait complete. 2023-11-28T21:08:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc6237fe640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6240b22d0 0x7fc624148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc628ba6640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc62414b0e0 0x7fc62415ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc623fff640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6240b1e70 0x7fc624163b60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc6140ac000 tx=0x7fc614019290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746246640 1 -- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67401591a0 msgr2=0x7f6740153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746246640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67401591a0 0x7f6740153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746246640 1 -- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67400714f0 msgr2=0x7f6740202560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746246640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67400714f0 0x7f6740202560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746246640 1 -- 172.21.15.6:0/3697062536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734009420 con 0x7f674006ca80 2023-11-28T21:08:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc620ff9640 1 -- 172.21.15.6:0/677652824 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140be070 con 0x7fc6240b1e70 2023-11-28T21:08:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc620ff9640 1 -- 172.21.15.6:0/677652824 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6140adca0 con 0x7fc6240b1e70 2023-11-28T21:08:16.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc620ff9640 1 -- 172.21.15.6:0/677652824 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140b9690 con 0x7fc6240b1e70 2023-11-28T21:08:16.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff00cce60 con 0x7f4ff0148680 2023-11-28T21:08:16.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff0157360 con 0x7f4ff0148680 2023-11-28T21:08:16.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62414a180 con 0x7fc6240b1e70 2023-11-28T21:08:16.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fb36ed9d640 1 --2- 172.21.15.6:0/3588617946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3700d1f20 0x7fb3700d0130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb37008d410 tx=0x7fb36801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151685f21f0de53c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6746246640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674006ca80 0x7f67400b3230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c780 tx=0x7f673c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6241640a0 con 0x7fc6240b1e70 2023-11-28T21:08:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4fd0000fd0 con 0x7f4ff0148680 2023-11-28T21:08:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.315+0000 7f6732ffd640 1 -- 172.21.15.6:0/3697062536 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0072d0 con 0x7f674006ca80 2023-11-28T21:08:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7f6732ffd640 1 -- 172.21.15.6:0/3697062536 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c007430 con 0x7f674006ca80 2023-11-28T21:08:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7f6732ffd640 1 -- 172.21.15.6:0/3697062536 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0047f0 con 0x7f674006ca80 2023-11-28T21:08:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7facfffff640 1 Processor -- start 2023-11-28T21:08:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7f67484aa640 1 -- 172.21.15.6:0/3697062536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6740159700 con 0x7f674006ca80 2023-11-28T21:08:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7f67484aa640 1 -- 172.21.15.6:0/3697062536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6740154230 con 0x7f674006ca80 2023-11-28T21:08:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7facfffff640 1 -- start start 2023-11-28T21:08:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7f4fecff9640 1 -- 172.21.15.6:0/3097784851 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fe000ab50 con 0x7f4ff0148680 2023-11-28T21:08:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc624149d30 con 0x7fc6240b1e70 2023-11-28T21:08:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7f6730ff9640 1 -- 172.21.15.6:0/3697062536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f671c000fd0 con 0x7f674006ca80 2023-11-28T21:08:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7fc620ff9640 1 -- 172.21.15.6:0/677652824 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc6140b97f0 con 0x7fc6240b1e70 2023-11-28T21:08:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7fb36d59a640 1 -- 172.21.15.6:0/3588617946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3680a57a0 con 0x7fb3700d1f20 2023-11-28T21:08:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7fb36d59a640 1 -- 172.21.15.6:0/3588617946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3680a5900 con 0x7fb3700d1f20 2023-11-28T21:08:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7fb36d59a640 1 -- 172.21.15.6:0/3588617946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3680a5c90 con 0x7fb3700d1f20 2023-11-28T21:08:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7fb374dd1640 1 -- 172.21.15.6:0/3588617946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3700d1f20 msgr2=0x7fb3700d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7fb374dd1640 1 --2- 172.21.15.6:0/3588617946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3700d1f20 0x7fb3700d0130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb37008d410 tx=0x7fb36801c900 comp rx=0 tx=0).stop 2023-11-28T21:08:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7facfffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad00070680 0x7fad00149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7facfffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad000cf3b0 0x7fad00149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7facfffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad0015bb80 0x7fad0014b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7facfffff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0015a270 con 0x7fad00070680 2023-11-28T21:08:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7facfffff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000aff40 con 0x7fad000cf3b0 2023-11-28T21:08:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.319+0000 7facfffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0015a510 con 0x7fad0015bb80 2023-11-28T21:08:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facff7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad0015bb80 0x7fad0014b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facff7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad0015bb80 0x7fad0014b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51402/0 (socket says 172.21.15.6:51402) 2023-11-28T21:08:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facff7fe640 1 -- 172.21.15.6:0/2585808367 learned_addr learned my addr 172.21.15.6:0/2585808367 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facfe7fc640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad000cf3b0 0x7fad00149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facfeffd640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad00070680 0x7fad00149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7f4fecff9640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fdc066570 0x7f4fdc068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fb374dd1640 1 -- 172.21.15.6:0/3588617946 shutdown_connections 2023-11-28T21:08:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fb374dd1640 1 --2- 172.21.15.6:0/3588617946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3700d1f20 0x7fb3700d0130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fb374dd1640 1 --2- 172.21.15.6:0/3588617946 >> v2:172.21.15.31:3300/0 conn(0x7fb370160b40 0x7fb3700cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fb374dd1640 1 -- 172.21.15.6:0/3588617946 >> 172.21.15.6:0/3588617946 conn(0x7fb37009c510 msgr2=0x7fb3700d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facff7fe640 1 -- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad000cf3b0 msgr2=0x7fad00149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facff7fe640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad000cf3b0 0x7fad00149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facff7fe640 1 -- 172.21.15.6:0/2585808367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad00070680 msgr2=0x7fad00149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facff7fe640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad00070680 0x7fad00149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facff7fe640 1 -- 172.21.15.6:0/2585808367 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40094d0 con 0x7fad0015bb80 2023-11-28T21:08:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7f4fecff9640 1 -- 172.21.15.6:0/3097784851 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fe0083d20 con 0x7f4ff0148680 2023-11-28T21:08:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facfe7fc640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad000cf3b0 0x7fad00149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facff7fe640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad0015bb80 0x7fad0014b860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7facf800efc0 tx=0x7facf800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7face77fe640 1 -- 172.21.15.6:0/2585808367 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8014480 con 0x7fad0015bb80 2023-11-28T21:08:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7f4fecff9640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7f4fdc06e790 0x7f4fdc070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7f4fecff9640 1 -- 172.21.15.6:0/3097784851 --> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4fdc071260 con 0x7f4fdc06e790 2023-11-28T21:08:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7f4fecff9640 1 -- 172.21.15.6:0/3097784851 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fe00840d0 con 0x7f4ff0148680 2023-11-28T21:08:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fc620ff9640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc6100664a0 0x7fc610068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fc620ff9640 1 -- 172.21.15.6:0/677652824 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc61411da00 con 0x7fc6240b1e70 2023-11-28T21:08:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fc620ff9640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fc61006e640 0x7fc610070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fc620ff9640 1 -- 172.21.15.6:0/677652824 --> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc610071110 con 0x7fc61006e640 2023-11-28T21:08:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fc620ff9640 1 -- 172.21.15.6:0/677652824 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc61411dd80 con 0x7fc6240b1e70 2023-11-28T21:08:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fc6237fe640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc6100664a0 0x7fc610068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7f4feffff640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fdc066570 0x7f4fdc068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7f4fef7fe640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7f4fdc06e790 0x7f4fdc070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fb374dd1640 1 -- 172.21.15.6:0/3588617946 shutdown_connections 2023-11-28T21:08:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fb374dd1640 1 -- 172.21.15.6:0/3588617946 wait complete. 2023-11-28T21:08:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fb374dd1640 1 Processor -- start 2023-11-28T21:08:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fc628ba6640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fc61006e640 0x7fc610070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7fb374dd1640 1 -- start start 2023-11-28T21:08:16.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fc6237fe640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc6100664a0 0x7fc610068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6241fdcd0 tx=0x7fc618008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7face77fe640 1 -- 172.21.15.6:0/2585808367 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf800f040 con 0x7fad0015bb80 2023-11-28T21:08:16.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7face77fe640 1 -- 172.21.15.6:0/2585808367 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8014820 con 0x7fad0015bb80 2023-11-28T21:08:16.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facfffff640 1 -- 172.21.15.6:0/2585808367 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0015a7f0 con 0x7fad0015bb80 2023-11-28T21:08:16.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.323+0000 7facfffff640 1 -- 172.21.15.6:0/2585808367 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad001535d0 con 0x7fad0015bb80 2023-11-28T21:08:16.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7f4feffff640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fdc066570 0x7f4fdc068a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800a8d0 tx=0x7f4fe8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7face57fa640 1 -- 172.21.15.6:0/2585808367 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facd8000fd0 con 0x7fad0015bb80 2023-11-28T21:08:16.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7f4fef7fe640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7f4fdc06e790 0x7f4fdc070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fc628ba6640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fc61006e640 0x7fc610070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb374dd1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3700b4670 0x7fb37015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb374dd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3700d1f20 0x7fb370070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb374dd1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb370160b40 0x7fb370070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7f4fecff9640 1 -- 172.21.15.6:0/3097784851 <== osd.6 v2:172.21.15.31:6800/2769386372 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4fdc071260 con 0x7f4fdc06e790 2023-11-28T21:08:16.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb374dd1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700b8cb0 con 0x7fb3700d1f20 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb36e59c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3700b4670 0x7fb37015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb36e59c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3700b4670 0x7fb37015ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51412/0 (socket says 172.21.15.6:51412) 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb36e59c640 1 -- 172.21.15.6:0/2218288543 learned_addr learned my addr 172.21.15.6:0/2218288543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700b8f90 con 0x7fb370160b40 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37006fb80 con 0x7fb3700b4670 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb36ed9d640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb370160b40 0x7fb370070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb36ed9d640 1 -- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3700b4670 msgr2=0x7fb37015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb36ed9d640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb3700b4670 0x7fb37015ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb36ed9d640 1 -- 172.21.15.6:0/2218288543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3700d1f20 msgr2=0x7fb370070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb36ed9d640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3700d1f20 0x7fb370070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7fb36ed9d640 1 -- 172.21.15.6:0/2218288543 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb368009b30 con 0x7fb370160b40 2023-11-28T21:08:16.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7face77fe640 1 -- 172.21.15.6:0/2585808367 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7facf8014980 con 0x7fad0015bb80 2023-11-28T21:08:16.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7fc620ff9640 1 -- 172.21.15.6:0/677652824 <== osd.3 v2:172.21.15.6:6808/3632028675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc610071110 con 0x7fc61006e640 2023-11-28T21:08:16.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7fb36ed9d640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb370160b40 0x7fb370070ba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3680ab000 tx=0x7fb3680196a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7fb35effd640 1 -- 172.21.15.6:0/2218288543 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3680b8470 con 0x7fb370160b40 2023-11-28T21:08:16.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7fb35effd640 1 -- 172.21.15.6:0/2218288543 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3680b85d0 con 0x7fb370160b40 2023-11-28T21:08:16.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7fb35effd640 1 -- 172.21.15.6:0/2218288543 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3680b8980 con 0x7fb370160b40 2023-11-28T21:08:16.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.327+0000 7f6732ffd640 1 -- 172.21.15.6:0/3697062536 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f673c004950 con 0x7f674006ca80 2023-11-28T21:08:16.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7f6732ffd640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67240664c0 0x7f6724068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7f6732ffd640 1 -- 172.21.15.6:0/3697062536 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f673c0834f0 con 0x7f674006ca80 2023-11-28T21:08:16.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7f6732ffd640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7f672406e660 0x7f6724070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7f6732ffd640 1 -- 172.21.15.6:0/3697062536 --> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6724071130 con 0x7f672406e660 2023-11-28T21:08:16.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37006fe60 con 0x7fb370160b40 2023-11-28T21:08:16.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37015cf60 con 0x7fb370160b40 2023-11-28T21:08:16.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7f6746a47640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7f672406e660 0x7f6724070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7face77fe640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7facec066540 0x7facec068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7face77fe640 1 -- 172.21.15.6:0/2585808367 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facf80849f0 con 0x7fad0015bb80 2023-11-28T21:08:16.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7face77fe640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7facec06e6e0 0x7facec070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7face77fe640 1 -- 172.21.15.6:0/2585808367 --> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facec0711b0 con 0x7facec06e6e0 2023-11-28T21:08:16.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7facfeffd640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7facec066540 0x7facec068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7facfe7fc640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7facec06e6e0 0x7facec070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7f6746a47640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7f672406e660 0x7f6724070a80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3700a11f0 con 0x7fb370160b40 2023-11-28T21:08:16.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7face77fe640 1 -- 172.21.15.6:0/2585808367 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7facf8051e50 con 0x7fad0015bb80 2023-11-28T21:08:16.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7f6732ffd640 1 -- 172.21.15.6:0/3697062536 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f673c050b00 con 0x7f674006ca80 2023-11-28T21:08:16.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.331+0000 7f6745a45640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67240664c0 0x7f6724068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7f6732ffd640 1 -- 172.21.15.6:0/3697062536 <== osd.5 v2:172.21.15.31:6801/2692774501 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6724071130 con 0x7f672406e660 2023-11-28T21:08:16.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 --> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f208815d3f0 con 0x7f206806e760 2023-11-28T21:08:16.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7facfeffd640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7facec066540 0x7facec068a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facf0000f70 tx=0x7facf0007b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7f20857fa640 1 -- 172.21.15.6:0/3694130173 <== osd.0 v2:172.21.15.6:6800/3567023430 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2068071230 con 0x7f206806e760 2023-11-28T21:08:16.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f206806e760 msgr2=0x7f2068070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7f208d934640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f206806e760 0x7f2068070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7fb35effd640 1 -- 172.21.15.6:0/2218288543 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3680b8ae0 con 0x7fb370160b40 2023-11-28T21:08:16.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7fb35effd640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb350066570 0x7fb350068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7fb35effd640 1 -- 172.21.15.6:0/2218288543 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb36811edf0 con 0x7fb370160b40 2023-11-28T21:08:16.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7fb35effd640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7fb35006e710 0x7fb350070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7fb35effd640 1 -- 172.21.15.6:0/2218288543 --> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3500711e0 con 0x7fb35006e710 2023-11-28T21:08:16.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.335+0000 7fb35effd640 1 -- 172.21.15.6:0/2218288543 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3680ec400 con 0x7fb370160b40 2023-11-28T21:08:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2068066540 msgr2=0x7f2068068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7f208d934640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2068066540 0x7f2068068a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20780ae000 tx=0x7f20780a7070 comp rx=0 tx=0).stop 2023-11-28T21:08:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 msgr2=0x7f208815c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7f208d934640 1 --2- 172.21.15.6:0/3694130173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20880b19c0 0x7f208815c640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f207000e3e0 tx=0x7f207000e8a0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7f208d133640 1 -- 172.21.15.6:0/3694130173 reap_dead start 2023-11-28T21:08:16.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb36e59c640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb350066570 0x7fb350068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7facfe7fc640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7facec06e6e0 0x7facec070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 --> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb3f4144730 con 0x7fb3e006e790 2023-11-28T21:08:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 shutdown_connections 2023-11-28T21:08:16.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 >> 172.21.15.6:0/3694130173 conn(0x7f208806a750 msgr2=0x7f20880af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7f6745a45640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67240664c0 0x7f6724068980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67340ae000 tx=0x7f67340a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7face77fe640 1 -- 172.21.15.6:0/2585808367 <== osd.4 v2:172.21.15.31:6816/1640965128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7facec0711b0 con 0x7facec06e6e0 2023-11-28T21:08:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb36dd9b640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7fb35006e710 0x7fb350070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb36e59c640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb350066570 0x7fb350068a30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb360007b10 tx=0x7fb360008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3f0ff9640 1 -- 172.21.15.6:0/4214405659 <== osd.2 v2:172.21.15.6:6816/78494204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb3f4144730 con 0x7fb3e006e790 2023-11-28T21:08:16.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 --> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb94144cd0 con 0x7feb8006e760 2023-11-28T21:08:16.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb36dd9b640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7fb35006e710 0x7fb350070b30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fb3e006e790 msgr2=0x7fb3e0070bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3fa89c640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fb3e006e790 0x7fb3e0070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb3e0066570 msgr2=0x7fb3e0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3fa89c640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb3e0066570 0x7fb3e0068a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009b60 tx=0x7fb3e4008040 comp rx=0 tx=0).stop 2023-11-28T21:08:16.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3f40c8c40 msgr2=0x7fb3f41ee280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7feb7bfff640 1 -- 172.21.15.6:0/4236370146 <== osd.1 v2:172.21.15.6:6824/3767937329 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feb94144cd0 con 0x7feb8006e760 2023-11-28T21:08:16.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3fa89c640 1 --2- 172.21.15.6:0/4214405659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3f40c8c40 0x7fb3f41ee280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009000 tx=0x7fb3dc005800 comp rx=0 tx=0).stop 2023-11-28T21:08:16.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3f8e39640 1 -- 172.21.15.6:0/4214405659 reap_dead start 2023-11-28T21:08:16.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 shutdown_connections 2023-11-28T21:08:16.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7f208d934640 1 -- 172.21.15.6:0/3694130173 wait complete. 2023-11-28T21:08:16.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 shutdown_connections 2023-11-28T21:08:16.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.339+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 >> 172.21.15.6:0/4214405659 conn(0x7fb3f40d3000 msgr2=0x7fb3f406b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7fb35effd640 1 -- 172.21.15.6:0/2218288543 <== osd.7 v2:172.21.15.31:6820/3973817173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb3500711e0 con 0x7fb35006e710 2023-11-28T21:08:16.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7feb8006e760 msgr2=0x7feb80070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7feb8006e760 0x7feb80070b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7feb80066540 msgr2=0x7feb80068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7feb80066540 0x7feb80068a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009f60 tx=0x7feb8c0094f0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb940b22e0 msgr2=0x7feb9415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 --2- 172.21.15.6:0/4236370146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb940b22e0 0x7feb9415bee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb880ac040 tx=0x7feb8801ad10 comp rx=0 tx=0).stop 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb93fff640 1 -- 172.21.15.6:0/4236370146 reap_dead start 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 shutdown_connections 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 >> 172.21.15.6:0/4236370146 conn(0x7feb9406a980 msgr2=0x7feb940aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 shutdown_connections 2023-11-28T21:08:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.343+0000 7feb99a9c640 1 -- 172.21.15.6:0/4236370146 wait complete. 2023-11-28T21:08:16.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.347+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 shutdown_connections 2023-11-28T21:08:16.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.347+0000 7fb3fa89c640 1 -- 172.21.15.6:0/4214405659 wait complete. 2023-11-28T21:08:16.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.351+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 --> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc6240666a0 con 0x7fc61006e640 2023-11-28T21:08:16.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc620ff9640 1 -- 172.21.15.6:0/677652824 <== osd.3 v2:172.21.15.6:6808/3632028675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc6240666a0 con 0x7fc61006e640 2023-11-28T21:08:16.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fc61006e640 msgr2=0x7fc610070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fc61006e640 0x7fc610070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc6100664a0 msgr2=0x7fc610068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc6100664a0 0x7fc610068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6241fdcd0 tx=0x7fc618008040 comp rx=0 tx=0).stop 2023-11-28T21:08:16.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6240b1e70 msgr2=0x7fc624163b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 --2- 172.21.15.6:0/677652824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc6240b1e70 0x7fc624163b60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc6140ac000 tx=0x7fc614019290 comp rx=0 tx=0).stop 2023-11-28T21:08:16.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc628ba6640 1 -- 172.21.15.6:0/677652824 reap_dead start 2023-11-28T21:08:16.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 shutdown_connections 2023-11-28T21:08:16.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 >> 172.21.15.6:0/677652824 conn(0x7fc62406a980 msgr2=0x7fc6240afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 shutdown_connections 2023-11-28T21:08:16.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.355+0000 7fc62a609640 1 -- 172.21.15.6:0/677652824 wait complete. 2023-11-28T21:08:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.359+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 --> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4fd0002cc0 con 0x7f4fdc06e790 2023-11-28T21:08:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4fecff9640 1 -- 172.21.15.6:0/3097784851 <== osd.6 v2:172.21.15.31:6800/2769386372 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4fd0002cc0 con 0x7f4fdc06e790 2023-11-28T21:08:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7f4fdc06e790 msgr2=0x7f4fdc070bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7f4fdc06e790 0x7f4fdc070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f6730ff9640 1 -- 172.21.15.6:0/3697062536 --> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f671c002cc0 con 0x7f672406e660 2023-11-28T21:08:16.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fdc066570 msgr2=0x7f4fdc068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fdc066570 0x7f4fdc068a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800a8d0 tx=0x7f4fe8008040 comp rx=0 tx=0).stop 2023-11-28T21:08:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff0148680 msgr2=0x7f4ff0156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 --2- 172.21.15.6:0/3097784851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff0148680 0x7f4ff0156e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c780 tx=0x7f4fe000cc40 comp rx=0 tx=0).stop 2023-11-28T21:08:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff4b92640 1 -- 172.21.15.6:0/3097784851 reap_dead start 2023-11-28T21:08:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 shutdown_connections 2023-11-28T21:08:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 >> 172.21.15.6:0/3097784851 conn(0x7f4ff006a750 msgr2=0x7f4ff015fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f6732ffd640 1 -- 172.21.15.6:0/3697062536 <== osd.5 v2:172.21.15.31:6801/2692774501 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f671c002cc0 con 0x7f672406e660 2023-11-28T21:08:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 shutdown_connections 2023-11-28T21:08:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.363+0000 7f4ff5393640 1 -- 172.21.15.6:0/3097784851 wait complete. 2023-11-28T21:08:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.367+0000 7face57fa640 1 -- 172.21.15.6:0/2585808367 --> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facd8002cc0 con 0x7facec06e6e0 2023-11-28T21:08:16.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.367+0000 7face77fe640 1 -- 172.21.15.6:0/2585808367 <== osd.4 v2:172.21.15.31:6816/1640965128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facd8002cc0 con 0x7facec06e6e0 2023-11-28T21:08:16.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.367+0000 7face57fa640 1 -- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7facec06e6e0 msgr2=0x7facec070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.367+0000 7face57fa640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7facec06e6e0 0x7facec070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.367+0000 7face57fa640 1 -- 172.21.15.6:0/2585808367 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7facec066540 msgr2=0x7facec068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.367+0000 7face57fa640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7facec066540 0x7facec068a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facf0000f70 tx=0x7facf0007b80 comp rx=0 tx=0).stop 2023-11-28T21:08:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.367+0000 7face57fa640 1 -- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad0015bb80 msgr2=0x7fad0014b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.367+0000 7face57fa640 1 --2- 172.21.15.6:0/2585808367 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad0015bb80 0x7fad0014b860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7facf800efc0 tx=0x7facf800c490 comp rx=0 tx=0).stop 2023-11-28T21:08:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.367+0000 7facff7fe640 1 -- 172.21.15.6:0/2585808367 reap_dead start 2023-11-28T21:08:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 -- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7f672406e660 msgr2=0x7f6724070a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7f672406e660 0x7f6724070a80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 -- 172.21.15.6:0/3697062536 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67240664c0 msgr2=0x7f6724068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67240664c0 0x7f6724068980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67340ae000 tx=0x7f67340a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 -- 172.21.15.6:0/3697062536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674006ca80 msgr2=0x7f67400b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 --2- 172.21.15.6:0/3697062536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674006ca80 0x7f67400b3230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c780 tx=0x7f673c00cc40 comp rx=0 tx=0).stop 2023-11-28T21:08:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7face57fa640 1 -- 172.21.15.6:0/2585808367 shutdown_connections 2023-11-28T21:08:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7face57fa640 1 -- 172.21.15.6:0/2585808367 >> 172.21.15.6:0/2585808367 conn(0x7fad0006a750 msgr2=0x7fad00162070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6746a47640 1 -- 172.21.15.6:0/3697062536 reap_dead start 2023-11-28T21:08:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 -- 172.21.15.6:0/3697062536 shutdown_connections 2023-11-28T21:08:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 -- 172.21.15.6:0/3697062536 >> 172.21.15.6:0/3697062536 conn(0x7f674006a580 msgr2=0x7f6740152570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7face57fa640 1 -- 172.21.15.6:0/2585808367 shutdown_connections 2023-11-28T21:08:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7face57fa640 1 -- 172.21.15.6:0/2585808367 wait complete. 2023-11-28T21:08:16.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 -- 172.21.15.6:0/3697062536 shutdown_connections 2023-11-28T21:08:16.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7f6730ff9640 1 -- 172.21.15.6:0/3697062536 wait complete. 2023-11-28T21:08:16.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 --> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb370070380 con 0x7fb35006e710 2023-11-28T21:08:16.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7fb35effd640 1 -- 172.21.15.6:0/2218288543 <== osd.7 v2:172.21.15.31:6820/3973817173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb370070380 con 0x7fb35006e710 2023-11-28T21:08:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7fb35006e710 msgr2=0x7fb350070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7fb374dd1640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7fb35006e710 0x7fb350070b30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb350066570 msgr2=0x7fb350068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7fb374dd1640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb350066570 0x7fb350068a30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb360007b10 tx=0x7fb360008040 comp rx=0 tx=0).stop 2023-11-28T21:08:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb370160b40 msgr2=0x7fb370070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.371+0000 7fb374dd1640 1 --2- 172.21.15.6:0/2218288543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb370160b40 0x7fb370070ba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3680ab000 tx=0x7fb3680196a0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.375+0000 7fb36ed9d640 1 -- 172.21.15.6:0/2218288543 reap_dead start 2023-11-28T21:08:16.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.379+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 shutdown_connections 2023-11-28T21:08:16.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.379+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 >> 172.21.15.6:0/2218288543 conn(0x7fb37009c510 msgr2=0x7fb3700c9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.379+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 shutdown_connections 2023-11-28T21:08:16.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.379+0000 7fb374dd1640 1 -- 172.21.15.6:0/2218288543 wait complete. 2023-11-28T21:08:16.424 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2023-11-28T21:08:16.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T21:08:16.425 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2023-11-28T21:08:16.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T21:08:16.426 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-11-28T21:08:16.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T21:08:16.427 INFO:teuthology.orchestra.run.smithi006.stdout:60129542150 2023-11-28T21:08:16.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T21:08:16.428 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-11-28T21:08:16.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T21:08:16.429 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2023-11-28T21:08:16.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T21:08:16.431 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-11-28T21:08:16.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T21:08:16.432 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-11-28T21:08:16.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T21:08:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4cbf65640 1 Processor -- start 2023-11-28T21:08:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4cbf65640 1 -- start start 2023-11-28T21:08:16.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4cbf65640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4cbf65640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4c40cbb70 0x7ff4c40cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4cbf65640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40ce8f0 con 0x7ff4c40b1170 2023-11-28T21:08:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4cbf65640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c406c900 con 0x7ff4c40cbb70 2023-11-28T21:08:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4cbf65640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c415a2b0 con 0x7ff4c4159d40 2023-11-28T21:08:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4c9500640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4ca502640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4c40cbb70 0x7ff4c40cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4c9500640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51414/0 (socket says 172.21.15.6:51414) 2023-11-28T21:08:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4c9500640 1 -- 172.21.15.6:0/3560039795 learned_addr learned my addr 172.21.15.6:0/3560039795 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7f9796df8640 1 Processor -- start 2023-11-28T21:08:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4c9500640 1 -- 172.21.15.6:0/3560039795 >> v2:172.21.15.31:3300/0 conn(0x7ff4c40cbb70 msgr2=0x7ff4c40cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4c9500640 1 --2- 172.21.15.6:0/3560039795 >> v2:172.21.15.31:3300/0 conn(0x7ff4c40cbb70 0x7ff4c40cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4c9500640 1 -- 172.21.15.6:0/3560039795 >> v1:172.21.15.31:6789/0 conn(0x7ff4c40b1170 legacy=0x7ff4c4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7ff4c9500640 1 -- 172.21.15.6:0/3560039795 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c415a590 con 0x7ff4c4159d40 2023-11-28T21:08:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.711+0000 7f9796df8640 1 -- start start 2023-11-28T21:08:16.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9796df8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9790160980 0x7f97900d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9796df8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97900ce6b0 0x7f97900cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9796df8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900cfa80 0x7f97900d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9796df8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900b27d0 con 0x7f97900ce6b0 2023-11-28T21:08:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9796df8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900cfef0 con 0x7f9790160980 2023-11-28T21:08:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9796df8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900b2d40 con 0x7f97900cfa80 2023-11-28T21:08:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9794b94640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9790160980 0x7f97900d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9794b94640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9790160980 0x7f97900d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43394/0 (socket says 172.21.15.6:43394) 2023-11-28T21:08:16.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9794b94640 1 -- 172.21.15.6:0/2078686208 learned_addr learned my addr 172.21.15.6:0/2078686208 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9795395640 1 --2- 172.21.15.6:0/2078686208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900cfa80 0x7f97900d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9794b94640 1 -- 172.21.15.6:0/2078686208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900cfa80 msgr2=0x7f97900d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9794b94640 1 --2- 172.21.15.6:0/2078686208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900cfa80 0x7f97900d0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9794b94640 1 -- 172.21.15.6:0/2078686208 >> v2:172.21.15.6:3300/0 conn(0x7f97900ce6b0 msgr2=0x7f97900cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9794b94640 1 --2- 172.21.15.6:0/2078686208 >> v2:172.21.15.6:3300/0 conn(0x7f97900ce6b0 0x7f97900cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.715+0000 7f9794b94640 1 -- 172.21.15.6:0/2078686208 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900cf130 con 0x7f9790160980 2023-11-28T21:08:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.719+0000 7ff4c9500640 1 --2- 172.21.15.6:0/3560039795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c406cd20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006fd0 tx=0x7ff4b401e950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac7ac0d8ac2d4631 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.719+0000 7ff4c8cff640 1 -- 172.21.15.6:0/3560039795 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40cd420 con 0x7ff4c4159d40 2023-11-28T21:08:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.719+0000 7ff4c8cff640 1 -- 172.21.15.6:0/3560039795 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b40ab070 con 0x7ff4c4159d40 2023-11-28T21:08:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.719+0000 7ff4c8cff640 1 -- 172.21.15.6:0/3560039795 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40044b0 con 0x7ff4c4159d40 2023-11-28T21:08:16.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.719+0000 7f9794b94640 1 --2- 172.21.15.6:0/2078686208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 0x7f97900d3b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f979006d750 tx=0x7f977801f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64bc8b4419c5bd3b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7ff4cbf65640 1 -- 172.21.15.6:0/3560039795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 msgr2=0x7ff4c406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/3560039795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c406cd20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006fd0 tx=0x7ff4b401e950 comp rx=0 tx=0).stop 2023-11-28T21:08:16.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f978ffff640 1 -- 172.21.15.6:0/2078686208 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97780af400 con 0x7f9790160980 2023-11-28T21:08:16.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f978ffff640 1 -- 172.21.15.6:0/2078686208 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97780ab050 con 0x7f9790160980 2023-11-28T21:08:16.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f978ffff640 1 -- 172.21.15.6:0/2078686208 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97780af780 con 0x7f9790160980 2023-11-28T21:08:16.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7ff4cbf65640 1 -- 172.21.15.6:0/3560039795 shutdown_connections 2023-11-28T21:08:16.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/3560039795 >> v2:172.21.15.31:3300/0 conn(0x7ff4c40cbb70 0x7ff4c40cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/3560039795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c406cd20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7ff4cbf65640 1 -- 172.21.15.6:0/3560039795 >> 172.21.15.6:0/3560039795 conn(0x7ff4c40b0650 msgr2=0x7ff4c40b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7ff4cbf65640 1 -- 172.21.15.6:0/3560039795 shutdown_connections 2023-11-28T21:08:16.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f9796df8640 1 -- 172.21.15.6:0/2078686208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 msgr2=0x7f97900d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f9796df8640 1 --2- 172.21.15.6:0/2078686208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 0x7f97900d3b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f979006d750 tx=0x7f977801f1e0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f9796df8640 1 -- 172.21.15.6:0/2078686208 shutdown_connections 2023-11-28T21:08:16.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f9796df8640 1 --2- 172.21.15.6:0/2078686208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900cfa80 0x7f97900d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f9796df8640 1 --2- 172.21.15.6:0/2078686208 >> v2:172.21.15.6:3300/0 conn(0x7f97900ce6b0 0x7f97900cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f9796df8640 1 --2- 172.21.15.6:0/2078686208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 0x7f97900d3b20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f9796df8640 1 -- 172.21.15.6:0/2078686208 >> 172.21.15.6:0/2078686208 conn(0x7f97900d3000 msgr2=0x7f97900d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7ff4cbf65640 1 -- 172.21.15.6:0/3560039795 wait complete. 2023-11-28T21:08:16.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f7558e3c640 1 Processor -- start 2023-11-28T21:08:16.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f9796df8640 1 -- 172.21.15.6:0/2078686208 shutdown_connections 2023-11-28T21:08:16.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7f9796df8640 1 -- 172.21.15.6:0/2078686208 wait complete. 2023-11-28T21:08:16.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4cbf65640 1 Processor -- start 2023-11-28T21:08:16.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4cbf65640 1 -- start start 2023-11-28T21:08:16.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7558e3c640 1 -- start start 2023-11-28T21:08:16.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.723+0000 7fcf88d9d640 1 Processor -- start 2023-11-28T21:08:16.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf88d9d640 1 -- start start 2023-11-28T21:08:16.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4cbf65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40b1170 0x7ff4c414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4cbf65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cbb70 0x7ff4c414cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7558e3c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f754c0e3260 0x7f754c056fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf88d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf840d0890 0x7fcf840c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf88d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf840cf3c0 0x7fcf840b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7558e3c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f754c03e8d0 0x7f754c053ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7558e3c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c03d080 con 0x7f754c058960 2023-11-28T21:08:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7558e3c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c0e3640 con 0x7f754c0e3260 2023-11-28T21:08:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7558e3c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c0578c0 con 0x7f754c03e8d0 2023-11-28T21:08:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f9796df8640 1 Processor -- start 2023-11-28T21:08:16.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4c9d01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40b1170 0x7ff4c414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4c9d01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40b1170 0x7ff4c414aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43408/0 (socket says 172.21.15.6:43408) 2023-11-28T21:08:16.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf88d9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf840b2730 con 0x7fcf840cfda0 2023-11-28T21:08:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf88d9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf840d18b0 con 0x7fcf840d0890 2023-11-28T21:08:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf88d9d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf840cef30 con 0x7fcf840cf3c0 2023-11-28T21:08:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7552ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f754c03e8d0 0x7f754c053ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7552ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f754c03e8d0 0x7f754c053ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43418/0 (socket says 172.21.15.6:43418) 2023-11-28T21:08:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7552ffd640 1 -- 172.21.15.6:0/531057798 learned_addr learned my addr 172.21.15.6:0/531057798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f9796df8640 1 -- start start 2023-11-28T21:08:16.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf82d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf840cf3c0 0x7fcf840b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf82d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf840cf3c0 0x7fcf840b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43428/0 (socket says 172.21.15.6:43428) 2023-11-28T21:08:16.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf82d9d640 1 -- 172.21.15.6:0/2140122104 learned_addr learned my addr 172.21.15.6:0/2140122104 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4c9d01640 1 -- 172.21.15.6:0/2230973057 learned_addr learned my addr 172.21.15.6:0/2230973057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c414c4c0 con 0x7ff4c40cbb70 2023-11-28T21:08:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c414da40 con 0x7ff4c40b1170 2023-11-28T21:08:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c6a20 con 0x7ff4c4159d40 2023-11-28T21:08:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf82d9d640 1 -- 172.21.15.6:0/2140122104 >> v2:172.21.15.6:3300/0 conn(0x7fcf840d0890 msgr2=0x7fcf840c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf82d9d640 1 --2- 172.21.15.6:0/2140122104 >> v2:172.21.15.6:3300/0 conn(0x7fcf840d0890 0x7fcf840c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf82d9d640 1 -- 172.21.15.6:0/2140122104 >> v1:172.21.15.6:6789/0 conn(0x7fcf840cfda0 legacy=0x7fcf840d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7fcf82d9d640 1 -- 172.21.15.6:0/2140122104 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf840d1b00 con 0x7fcf840cf3c0 2023-11-28T21:08:16.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f75537fe640 1 --2- 172.21.15.6:0/531057798 >> v2:172.21.15.6:3300/0 conn(0x7f754c0e3260 0x7f754c056fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f77d45f8640 1 Processor -- start 2023-11-28T21:08:16.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7552ffd640 1 -- 172.21.15.6:0/531057798 >> v2:172.21.15.6:3300/0 conn(0x7f754c0e3260 msgr2=0x7f754c056fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7ff4ca502640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9796df8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900ce6b0 0x7f97900cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9796df8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97900cfa80 0x7f97900b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9796df8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 0x7f9790151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9796df8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900cab80 con 0x7f97900cfa80 2023-11-28T21:08:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9796df8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900ca250 con 0x7f9790160980 2023-11-28T21:08:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9796df8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900ca530 con 0x7f97900ce6b0 2023-11-28T21:08:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4c9d01640 1 -- 172.21.15.6:0/2230973057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 msgr2=0x7ff4c414d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4c9d01640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c414d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4c9d01640 1 -- 172.21.15.6:0/2230973057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cbb70 msgr2=0x7ff4c414cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4c9d01640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cbb70 0x7ff4c414cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4c9d01640 1 -- 172.21.15.6:0/2230973057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b400b780 con 0x7ff4c40b1170 2023-11-28T21:08:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7552ffd640 1 --2- 172.21.15.6:0/531057798 >> v2:172.21.15.6:3300/0 conn(0x7f754c0e3260 0x7f754c056fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7552ffd640 1 -- 172.21.15.6:0/531057798 >> v1:172.21.15.6:6789/0 conn(0x7f754c058960 legacy=0x7f754c0061d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.727+0000 7f7552ffd640 1 -- 172.21.15.6:0/531057798 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c057ba0 con 0x7f754c03e8d0 2023-11-28T21:08:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f75537fe640 1 --2- 172.21.15.6:0/531057798 >> v2:172.21.15.6:3300/0 conn(0x7f754c0e3260 0x7f754c056fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9787fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97900cfa80 0x7f97900b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9787fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97900cfa80 0x7f97900b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44718/0 (socket says 172.21.15.6:44718) 2023-11-28T21:08:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9787fff640 1 -- 172.21.15.6:0/916978121 learned_addr learned my addr 172.21.15.6:0/916978121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9795395640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 0x7f9790151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9794b94640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900ce6b0 0x7f97900cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4c9d01640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40b1170 0x7ff4c414aec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c420 tx=0x7ff4c000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9787fff640 1 -- 172.21.15.6:0/916978121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900ce6b0 msgr2=0x7f97900cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f77d45f8640 1 -- start start 2023-11-28T21:08:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f77d45f8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77cc06d190 0x7f77cc15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f77d45f8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc0ae8e0 con 0x7f77cc1591a0 2023-11-28T21:08:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f77d45f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc0cca70 con 0x7f77cc0714f0 2023-11-28T21:08:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f77d45f8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77cc072700 con 0x7f77cc06d190 2023-11-28T21:08:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9787fff640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900ce6b0 0x7f97900cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9787fff640 1 -- 172.21.15.6:0/916978121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 msgr2=0x7f9790151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9787fff640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 0x7f9790151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9787fff640 1 -- 172.21.15.6:0/916978121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778009b30 con 0x7f97900cfa80 2023-11-28T21:08:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9795395640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 0x7f9790151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4ba7fc640 1 -- 172.21.15.6:0/2230973057 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00052d0 con 0x7ff4c40b1170 2023-11-28T21:08:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4ba7fc640 1 -- 172.21.15.6:0/2230973057 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0005430 con 0x7ff4c40b1170 2023-11-28T21:08:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c414b840 con 0x7ff4c40b1170 2023-11-28T21:08:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f9787fff640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97900cfa80 0x7f97900b4ce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f978000b550 tx=0x7f978000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c414be00 con 0x7ff4c40b1170 2023-11-28T21:08:16.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f77d1b93640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f77cc0714f0 0x7f77cc06ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:60612/0 (socket says 172.21.15.6:60612) 2023-11-28T21:08:16.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7f77d1b93640 1 -- 172.21.15.6:0/3183492215 learned_addr learned my addr 172.21.15.6:0/3183492215 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:16.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.731+0000 7ff4ba7fc640 1 -- 172.21.15.6:0/2230973057 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0007220 con 0x7ff4c40b1170 2023-11-28T21:08:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f978dffb640 1 -- 172.21.15.6:0/916978121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780010870 con 0x7f97900cfa80 2023-11-28T21:08:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f978dffb640 1 -- 172.21.15.6:0/916978121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97800109f0 con 0x7f97900cfa80 2023-11-28T21:08:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f978dffb640 1 -- 172.21.15.6:0/916978121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780010da0 con 0x7f97900cfa80 2023-11-28T21:08:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7fcf82d9d640 1 --2- 172.21.15.6:0/2140122104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840cf3c0 0x7fcf840b2ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009e50 tx=0x7fcf7c01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7723aff2b35bf7b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97900ca810 con 0x7f97900cfa80 2023-11-28T21:08:16.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f77d2b95640 1 --2- 172.21.15.6:0/3183492215 >> v2:172.21.15.6:3300/0 conn(0x7f77cc06d190 0x7f77cc15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f77d1392640 1 -- 172.21.15.6:0/3183492215 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491090544 0 0) 0x7f77cc0cca70 con 0x7f77cc0714f0 2023-11-28T21:08:16.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f77d1392640 1 -- 172.21.15.6:0/3183492215 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b8003530 con 0x7f77cc0714f0 2023-11-28T21:08:16.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f9c430e3640 1 Processor -- start 2023-11-28T21:08:16.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f77d1392640 1 -- 172.21.15.6:0/3183492215 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658832248 0 0) 0x7f77cc0ae8e0 con 0x7f77cc1591a0 2023-11-28T21:08:16.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f9c430e3640 1 -- start start 2023-11-28T21:08:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f7552ffd640 1 --2- 172.21.15.6:0/531057798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c03e8d0 0x7f754c053ca0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f754c0e6c80 tx=0x7f754801ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=853dc04a9d420940 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97900b5220 con 0x7f97900cfa80 2023-11-28T21:08:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7ff4ba7fc640 1 -- 172.21.15.6:0/2230973057 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4c0007380 con 0x7ff4c40b1170 2023-11-28T21:08:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c404e850 con 0x7ff4c40b1170 2023-11-28T21:08:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7fcf81d9b640 1 -- 172.21.15.6:0/2140122104 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0a5720 con 0x7fcf840cf3c0 2023-11-28T21:08:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7fcf81d9b640 1 -- 172.21.15.6:0/2140122104 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c0a5880 con 0x7fcf840cf3c0 2023-11-28T21:08:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2140122104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840cf3c0 msgr2=0x7fcf840b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7fcf88d9d640 1 --2- 172.21.15.6:0/2140122104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840cf3c0 0x7fcf840b2ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009e50 tx=0x7fcf7c01c840 comp rx=0 tx=0).stop 2023-11-28T21:08:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f75527fc640 1 -- 172.21.15.6:0/531057798 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75480a89b0 con 0x7f754c03e8d0 2023-11-28T21:08:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f75527fc640 1 -- 172.21.15.6:0/531057798 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75480a8b10 con 0x7f754c03e8d0 2023-11-28T21:08:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f75527fc640 1 -- 172.21.15.6:0/531057798 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75480a8ea0 con 0x7f754c03e8d0 2023-11-28T21:08:16.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f77d2b95640 1 -- 172.21.15.6:0/3183492215 >> v1:172.21.15.31:6789/0 conn(0x7f77cc0714f0 legacy=0x7f77cc06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f77d2b95640 1 -- 172.21.15.6:0/3183492215 >> v1:172.21.15.6:6789/0 conn(0x7f77cc1591a0 legacy=0x7f77cc0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.735+0000 7f77d2b95640 1 -- 172.21.15.6:0/3183492215 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc071e80 con 0x7f77cc06d190 2023-11-28T21:08:16.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c430e3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c3c144910 0x7f9c3c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c430e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c3c15bef0 0x7f9c3c15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c430e3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c144cf0 con 0x7f9c3c06ce90 2023-11-28T21:08:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c430e3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c06d340 con 0x7f9c3c15bef0 2023-11-28T21:08:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c430e3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c15c380 con 0x7f9c3c144910 2023-11-28T21:08:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c40e7f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c3c144910 0x7f9c3c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7ff4ba7fc640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4a8066540 0x7ff4a8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7ff4ba7fc640 1 -- 172.21.15.6:0/2230973057 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4c0083220 con 0x7ff4c40b1170 2023-11-28T21:08:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c3bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9c3c06ce90 0x7f9c3c15b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58226/0 (socket says 172.21.15.6:58226) 2023-11-28T21:08:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c3bfff640 1 -- 172.21.15.6:0/301695453 learned_addr learned my addr 172.21.15.6:0/301695453 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f7558e3c640 1 -- 172.21.15.6:0/531057798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c03e8d0 msgr2=0x7f754c053ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f7558e3c640 1 --2- 172.21.15.6:0/531057798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c03e8d0 0x7f754c053ca0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f754c0e6c80 tx=0x7f754801ecd0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9f987f5640 1 Processor -- start 2023-11-28T21:08:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c41680640 1 --2- 172.21.15.6:0/301695453 >> v2:172.21.15.6:3300/0 conn(0x7f9c3c15bef0 0x7f9c3c15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f7558e3c640 1 -- 172.21.15.6:0/531057798 shutdown_connections 2023-11-28T21:08:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9f987f5640 1 -- start start 2023-11-28T21:08:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97900cacf0 con 0x7f97900cfa80 2023-11-28T21:08:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c41680640 1 -- 172.21.15.6:0/301695453 >> v2:172.21.15.31:3300/0 conn(0x7f9c3c144910 msgr2=0x7f9c3c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c41680640 1 --2- 172.21.15.6:0/301695453 >> v2:172.21.15.31:3300/0 conn(0x7f9c3c144910 0x7f9c3c06c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c41680640 1 -- 172.21.15.6:0/301695453 >> v1:172.21.15.6:6789/0 conn(0x7f9c3c06ce90 legacy=0x7f9c3c15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f9c41680640 1 -- 172.21.15.6:0/301695453 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c15c8a0 con 0x7f9c3c15bef0 2023-11-28T21:08:16.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7ff4c9500640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4a8066540 0x7ff4a8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f7558e3c640 1 --2- 172.21.15.6:0/531057798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c03e8d0 0x7f754c053ca0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f7558e3c640 1 --2- 172.21.15.6:0/531057798 >> v2:172.21.15.6:3300/0 conn(0x7f754c0e3260 0x7f754c056fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f7558e3c640 1 -- 172.21.15.6:0/531057798 >> 172.21.15.6:0/531057798 conn(0x7f754c058ed0 msgr2=0x7f754c0592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f978dffb640 1 -- 172.21.15.6:0/916978121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f978000f3c0 con 0x7f97900cfa80 2023-11-28T21:08:16.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f7558e3c640 1 -- 172.21.15.6:0/531057798 shutdown_connections 2023-11-28T21:08:16.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f77d2b95640 1 --2- 172.21.15.6:0/3183492215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77cc06d190 0x7f77cc15d820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77cc072070 tx=0x7f77c401e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa9fd0e51a1ff1b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7f7558e3c640 1 -- 172.21.15.6:0/531057798 wait complete. 2023-11-28T21:08:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.739+0000 7ff4c9500640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4a8066540 0x7ff4a8068a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40b1000 tx=0x7ff4b4004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2140122104 shutdown_connections 2023-11-28T21:08:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7fcf88d9d640 1 --2- 172.21.15.6:0/2140122104 >> v2:172.21.15.6:3300/0 conn(0x7fcf840d0890 0x7fcf840c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7fcf88d9d640 1 --2- 172.21.15.6:0/2140122104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840cf3c0 0x7fcf840b2ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f1152780640 1 Processor -- start 2023-11-28T21:08:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f978dffb640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f97740664c0 0x7f9774068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f987f5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f9006e480 0x7f9f900b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2140122104 >> 172.21.15.6:0/2140122104 conn(0x7fcf8409c480 msgr2=0x7fcf840d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f987f5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f901590a0 0x7f9f9006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f987f5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f900b4280 con 0x7f9f900ce370 2023-11-28T21:08:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f987f5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f900717e0 con 0x7f9f901590a0 2023-11-28T21:08:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f987f5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f900b3ab0 con 0x7f9f9006e480 2023-11-28T21:08:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9794b94640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f97740664c0 0x7f9774068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f978dffb640 1 -- 172.21.15.6:0/916978121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9780083cb0 con 0x7f97900cfa80 2023-11-28T21:08:16.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2140122104 shutdown_connections 2023-11-28T21:08:16.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2140122104 wait complete. 2023-11-28T21:08:16.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f96591640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f9006e480 0x7f9f900b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f96591640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f9006e480 0x7f9f900b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43458/0 (socket says 172.21.15.6:43458) 2023-11-28T21:08:16.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f96591640 1 -- 172.21.15.6:0/4232422242 learned_addr learned my addr 172.21.15.6:0/4232422242 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f96d92640 1 --2- 172.21.15.6:0/4232422242 >> v2:172.21.15.6:3300/0 conn(0x7f9f901590a0 0x7f9f9006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f96591640 1 -- 172.21.15.6:0/4232422242 >> v2:172.21.15.6:3300/0 conn(0x7f9f901590a0 msgr2=0x7f9f9006ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:16.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f1152780640 1 -- start start 2023-11-28T21:08:16.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f7558e3c640 1 Processor -- start 2023-11-28T21:08:16.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f96591640 1 --2- 172.21.15.6:0/4232422242 >> v2:172.21.15.6:3300/0 conn(0x7f9f901590a0 0x7f9f9006ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f96591640 1 -- 172.21.15.6:0/4232422242 >> v1:172.21.15.31:6789/0 conn(0x7f9f900ce370 legacy=0x7f9f9015d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f96591640 1 -- 172.21.15.6:0/4232422242 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f900b3cc0 con 0x7f9f9006e480 2023-11-28T21:08:16.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9f96d92640 1 --2- 172.21.15.6:0/4232422242 >> v2:172.21.15.6:3300/0 conn(0x7f9f901590a0 0x7f9f9006ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:16.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9794b94640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f97740664c0 0x7f9774068980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f979006d750 tx=0x7f97780aa000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f7558e3c640 1 -- start start 2023-11-28T21:08:16.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.743+0000 7f9c41680640 1 --2- 172.21.15.6:0/301695453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c15bef0 0x7f9c3c15d620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c06b200 tx=0x7f9c30020780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c6d635a11aa64c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f1152780640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f114c0714f0 0x7f114c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf88d9d640 1 Processor -- start 2023-11-28T21:08:16.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7558e3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c03e8d0 0x7f754c0e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7558e3c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c058960 0x7f754c0e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7558e3c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f754c0e3260 0x7f754c0e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7558e3c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c050650 con 0x7f754c03e8d0 2023-11-28T21:08:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7558e3c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c050860 con 0x7f754c058960 2023-11-28T21:08:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7558e3c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c050b40 con 0x7f754c0e3260 2023-11-28T21:08:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f1152780640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114c0ae8e0 con 0x7f114c06ca80 2023-11-28T21:08:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f1152780640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114c0cca70 con 0x7f114c1591a0 2023-11-28T21:08:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f1152780640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114c072700 con 0x7f114c0714f0 2023-11-28T21:08:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f114bfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f114c1591a0 0x7f114c0b1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:60630/0 (socket says 172.21.15.6:60630) 2023-11-28T21:08:16.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f114bfff640 1 -- 172.21.15.6:0/2706008220 learned_addr learned my addr 172.21.15.6:0/2706008220 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:16.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f75537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c03e8d0 0x7f754c0e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7552ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c058960 0x7f754c0e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7553fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f754c0e3260 0x7f754c0e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7552ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c058960 0x7f754c0e5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43484/0 (socket says 172.21.15.6:43484) 2023-11-28T21:08:16.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7552ffd640 1 -- 172.21.15.6:0/2208349648 learned_addr learned my addr 172.21.15.6:0/2208349648 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f1143fff640 1 --2- 172.21.15.6:0/2706008220 >> v2:172.21.15.31:3300/0 conn(0x7f114c0714f0 0x7f114c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf88d9d640 1 -- start start 2023-11-28T21:08:16.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf88d9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf840cf3c0 0x7fcf84155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf88d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf840cfda0 0x7fcf84159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf88d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840c8cd0 0x7fcf84159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7553fff640 1 -- 172.21.15.6:0/2208349648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c058960 msgr2=0x7f754c0e5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7553fff640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c058960 0x7f754c0e5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7553fff640 1 -- 172.21.15.6:0/2208349648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c03e8d0 msgr2=0x7f754c0e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7553fff640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c03e8d0 0x7f754c0e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7553fff640 1 -- 172.21.15.6:0/2208349648 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480094d0 con 0x7f754c0e3260 2023-11-28T21:08:16.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf8259c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf840cf3c0 0x7fcf84155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf8259c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf840cf3c0 0x7fcf84155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51466/0 (socket says 172.21.15.6:51466) 2023-11-28T21:08:16.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f114b7fe640 1 -- 172.21.15.6:0/2706008220 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950354277 0 0) 0x7f114c0cca70 con 0x7f114c1591a0 2023-11-28T21:08:16.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f114b7fe640 1 -- 172.21.15.6:0/2706008220 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1138003530 con 0x7f114c1591a0 2023-11-28T21:08:16.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f1143fff640 1 -- 172.21.15.6:0/2706008220 >> v1:172.21.15.31:6789/0 conn(0x7f114c1591a0 legacy=0x7f114c0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf79d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf840cfda0 0x7fcf84159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f7553fff640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f754c0e3260 0x7f754c0e5c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7554063f10 tx=0x7f7554068a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f1143fff640 1 -- 172.21.15.6:0/2706008220 >> v1:172.21.15.6:6789/0 conn(0x7f114c06ca80 legacy=0x7f114c0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f1143fff640 1 -- 172.21.15.6:0/2706008220 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c071e80 con 0x7f114c0714f0 2023-11-28T21:08:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7ff4ba7fc640 1 -- 172.21.15.6:0/2230973057 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4c0050710 con 0x7ff4c40b1170 2023-11-28T21:08:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf79d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf840cfda0 0x7fcf84159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44770/0 (socket says 172.21.15.6:44770) 2023-11-28T21:08:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf8259c640 1 -- 172.21.15.6:0/2997888202 learned_addr learned my addr 172.21.15.6:0/2997888202 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840b5ef0 con 0x7fcf840cfda0 2023-11-28T21:08:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c9ae0 con 0x7fcf840c8cd0 2023-11-28T21:08:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c9240 con 0x7fcf840cf3c0 2023-11-28T21:08:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf82d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840c8cd0 0x7fcf84159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f753ffff640 1 -- 172.21.15.6:0/2208349648 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755406bc00 con 0x7f754c0e3260 2023-11-28T21:08:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f9f96591640 1 --2- 172.21.15.6:0/4232422242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f9006e480 0x7f9f900b3570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f9006d780 tx=0x7f9f8c01c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be47fcbdd72a2d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf82d9d640 1 -- 172.21.15.6:0/2997888202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf840cf3c0 msgr2=0x7fcf84155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf82d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf840cf3c0 0x7fcf84155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf82d9d640 1 -- 172.21.15.6:0/2997888202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf840cfda0 msgr2=0x7fcf84159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf82d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf840cfda0 0x7fcf84159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7fcf82d9d640 1 -- 172.21.15.6:0/2997888202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c009b30 con 0x7fcf840c8cd0 2023-11-28T21:08:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f77d1392640 1 -- 172.21.15.6:0/3183492215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8001680 con 0x7f77cc06d190 2023-11-28T21:08:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f9f9558f640 1 -- 172.21.15.6:0/4232422242 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0aa430 con 0x7f9f9006e480 2023-11-28T21:08:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f9f9558f640 1 -- 172.21.15.6:0/4232422242 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0aa590 con 0x7f9f9006e480 2023-11-28T21:08:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f9f9558f640 1 -- 172.21.15.6:0/4232422242 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0aa920 con 0x7f9f9006e480 2023-11-28T21:08:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9c3b7fe640 1 -- 172.21.15.6:0/301695453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000d0d0 con 0x7f9c3c15bef0 2023-11-28T21:08:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9c3b7fe640 1 -- 172.21.15.6:0/301695453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3000d230 con 0x7f9c3c15bef0 2023-11-28T21:08:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9c3b7fe640 1 -- 172.21.15.6:0/301695453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c300a9830 con 0x7f9c3c15bef0 2023-11-28T21:08:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f77d1392640 1 -- 172.21.15.6:0/3183492215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c40a7840 con 0x7f77cc06d190 2023-11-28T21:08:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f77d1392640 1 -- 172.21.15.6:0/3183492215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40a7bd0 con 0x7f77cc06d190 2023-11-28T21:08:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.747+0000 7f753ffff640 1 -- 172.21.15.6:0/2208349648 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755406bd60 con 0x7f754c0e3260 2023-11-28T21:08:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f753ffff640 1 -- 172.21.15.6:0/2208349648 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554092640 con 0x7f754c0e3260 2023-11-28T21:08:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c050e20 con 0x7f754c0e3260 2023-11-28T21:08:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c0513e0 con 0x7f754c0e3260 2023-11-28T21:08:16.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f978dffb640 1 -- 172.21.15.6:0/916978121 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97800512c0 con 0x7f97900cfa80 2023-11-28T21:08:16.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9f987f5640 1 -- 172.21.15.6:0/4232422242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f9006e480 msgr2=0x7f9f900b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9f987f5640 1 --2- 172.21.15.6:0/4232422242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f9006e480 0x7f9f900b3570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f9006d780 tx=0x7f9f8c01c4f0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7fcf82d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840c8cd0 0x7fcf84159aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0ab000 tx=0x7fcf7c0195e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f77d45f8640 1 -- 172.21.15.6:0/3183492215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77cc06d190 msgr2=0x7f77cc15d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7fcf7b7fe640 1 -- 172.21.15.6:0/2997888202 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0a5720 con 0x7fcf840c8cd0 2023-11-28T21:08:16.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7fcf7b7fe640 1 -- 172.21.15.6:0/2997888202 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c007cc0 con 0x7fcf840c8cd0 2023-11-28T21:08:16.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7fcf7b7fe640 1 -- 172.21.15.6:0/2997888202 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0b86b0 con 0x7fcf840c8cd0 2023-11-28T21:08:16.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf840c9520 con 0x7fcf840c8cd0 2023-11-28T21:08:16.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf840b0d80 con 0x7fcf840c8cd0 2023-11-28T21:08:16.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf840b6060 con 0x7fcf840c8cd0 2023-11-28T21:08:16.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c0056f0 con 0x7f754c0e3260 2023-11-28T21:08:16.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9f987f5640 1 -- 172.21.15.6:0/4232422242 shutdown_connections 2023-11-28T21:08:16.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9f987f5640 1 --2- 172.21.15.6:0/4232422242 >> v2:172.21.15.6:3300/0 conn(0x7f9f901590a0 0x7f9f9006ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9f987f5640 1 --2- 172.21.15.6:0/4232422242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f9006e480 0x7f9f900b3570 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9f987f5640 1 -- 172.21.15.6:0/4232422242 >> 172.21.15.6:0/4232422242 conn(0x7f9f9006a980 msgr2=0x7f9f9006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9f987f5640 1 -- 172.21.15.6:0/4232422242 shutdown_connections 2023-11-28T21:08:16.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9f987f5640 1 -- 172.21.15.6:0/4232422242 wait complete. 2023-11-28T21:08:16.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9c430e3640 1 -- 172.21.15.6:0/301695453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c15bef0 msgr2=0x7f9c3c15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9c430e3640 1 --2- 172.21.15.6:0/301695453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c15bef0 0x7f9c3c15d620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c06b200 tx=0x7f9c30020780 comp rx=0 tx=0).stop 2023-11-28T21:08:16.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9c430e3640 1 -- 172.21.15.6:0/301695453 shutdown_connections 2023-11-28T21:08:16.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9c430e3640 1 --2- 172.21.15.6:0/301695453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c15bef0 0x7f9c3c15d620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9c430e3640 1 --2- 172.21.15.6:0/301695453 >> v2:172.21.15.31:3300/0 conn(0x7f9c3c144910 0x7f9c3c06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f9c430e3640 1 -- 172.21.15.6:0/301695453 >> 172.21.15.6:0/301695453 conn(0x7f9c3c06a580 msgr2=0x7f9c3c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9c430e3640 1 -- 172.21.15.6:0/301695453 shutdown_connections 2023-11-28T21:08:16.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f987f5640 1 Processor -- start 2023-11-28T21:08:16.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f1143fff640 1 --2- 172.21.15.6:0/2706008220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f114c0714f0 0x7f114c15d820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f114c072070 tx=0x7f113401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c14950fde3a67887 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f114b7fe640 1 -- 172.21.15.6:0/2706008220 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340ab680 con 0x7f114c0714f0 2023-11-28T21:08:16.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f114b7fe640 1 -- 172.21.15.6:0/2706008220 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11340ab7e0 con 0x7f114c0714f0 2023-11-28T21:08:16.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9c430e3640 1 -- 172.21.15.6:0/301695453 wait complete. 2023-11-28T21:08:16.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f114b7fe640 1 -- 172.21.15.6:0/2706008220 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340abb70 con 0x7f114c0714f0 2023-11-28T21:08:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7fcf7b7fe640 1 -- 172.21.15.6:0/2997888202 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf7c0039a0 con 0x7fcf840c8cd0 2023-11-28T21:08:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f987f5640 1 -- start start 2023-11-28T21:08:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f1152780640 1 -- 172.21.15.6:0/2706008220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f114c0714f0 msgr2=0x7f114c15d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f1152780640 1 --2- 172.21.15.6:0/2706008220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f114c0714f0 0x7f114c15d820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f114c072070 tx=0x7f113401c480 comp rx=0 tx=0).stop 2023-11-28T21:08:16.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.751+0000 7f77d45f8640 1 --2- 172.21.15.6:0/3183492215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77cc06d190 0x7f77cc15d820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77cc072070 tx=0x7f77c401e9b0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f1152780640 1 -- 172.21.15.6:0/2706008220 shutdown_connections 2023-11-28T21:08:16.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f1152780640 1 --2- 172.21.15.6:0/2706008220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f114c0714f0 0x7f114c15d820 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f1152780640 1 -- 172.21.15.6:0/2706008220 >> 172.21.15.6:0/2706008220 conn(0x7f114c06a580 msgr2=0x7f114c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f1152780640 1 -- 172.21.15.6:0/2706008220 shutdown_connections 2023-11-28T21:08:16.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f1152780640 1 -- 172.21.15.6:0/2706008220 wait complete. 2023-11-28T21:08:16.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f77d45f8640 1 -- 172.21.15.6:0/3183492215 shutdown_connections 2023-11-28T21:08:16.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f77d45f8640 1 --2- 172.21.15.6:0/3183492215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77cc06d190 0x7f77cc15d820 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f77d45f8640 1 -- 172.21.15.6:0/3183492215 >> 172.21.15.6:0/3183492215 conn(0x7f77cc06a580 msgr2=0x7f77cc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7fcf7b7fe640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf680664f0 0x7fcf680689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f753ffff640 1 -- 172.21.15.6:0/2208349648 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75540927a0 con 0x7f754c0e3260 2023-11-28T21:08:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f753ffff640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7538066540 0x7f7538068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f753ffff640 1 -- 172.21.15.6:0/2208349648 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75540fd940 con 0x7f754c0e3260 2023-11-28T21:08:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f75537fe640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7538066540 0x7f7538068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f987f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9006e480 0x7f9f9016b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f987f5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900ce370 0x7f9f901fa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f987f5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f901590a0 0x7f9f90169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7fcf7b7fe640 1 -- 172.21.15.6:0/2997888202 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf7c11f360 con 0x7fcf840c8cd0 2023-11-28T21:08:16.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7fcf8259c640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf680664f0 0x7fcf680689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f987f5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9014e040 con 0x7f9f9006e480 2023-11-28T21:08:16.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f987f5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9016bec0 con 0x7f9f901590a0 2023-11-28T21:08:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f987f5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9014e290 con 0x7f9f900ce370 2023-11-28T21:08:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f96591640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9006e480 0x7f9f9016b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f96591640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9006e480 0x7f9f9016b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44780/0 (socket says 172.21.15.6:44780) 2023-11-28T21:08:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f96591640 1 -- 172.21.15.6:0/3093774409 learned_addr learned my addr 172.21.15.6:0/3093774409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f96d92640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f901590a0 0x7f9f90169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f95d90640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900ce370 0x7f9f901fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f77d45f8640 1 -- 172.21.15.6:0/3183492215 shutdown_connections 2023-11-28T21:08:16.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f77d45f8640 1 -- 172.21.15.6:0/3183492215 wait complete. 2023-11-28T21:08:16.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f96591640 1 -- 172.21.15.6:0/3093774409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900ce370 msgr2=0x7f9f901fa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f96591640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900ce370 0x7f9f901fa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f96591640 1 -- 172.21.15.6:0/3093774409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f901590a0 msgr2=0x7f9f90169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f96591640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f901590a0 0x7f9f90169d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9f96591640 1 -- 172.21.15.6:0/3093774409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0094d0 con 0x7f9f9006e480 2023-11-28T21:08:16.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7fcf8259c640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf680664f0 0x7fcf680689b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf840b0b90 tx=0x7fcf6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.755+0000 7f9c430e3640 1 Processor -- start 2023-11-28T21:08:16.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f9c430e3640 1 -- start start 2023-11-28T21:08:16.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f77d45f8640 1 Processor -- start 2023-11-28T21:08:16.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f9f96591640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9006e480 0x7f9f9016b7e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c019100 tx=0x7f9f8c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7fcf7b7fe640 1 -- 172.21.15.6:0/2997888202 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf840b6060 con 0x7fcf840c8cd0 2023-11-28T21:08:16.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f77d45f8640 1 -- start start 2023-11-28T21:08:16.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f9f86ffd640 1 -- 172.21.15.6:0/3093774409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0b3800 con 0x7f9f9006e480 2023-11-28T21:08:16.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f9f86ffd640 1 -- 172.21.15.6:0/3093774409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0b3960 con 0x7f9f9006e480 2023-11-28T21:08:16.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f9f86ffd640 1 -- 172.21.15.6:0/3093774409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0b3d10 con 0x7f9f9006e480 2023-11-28T21:08:16.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9014e570 con 0x7f9f9006e480 2023-11-28T21:08:16.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f9c430e3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c3c06ce90 0x7f9c3c1360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1152780640 1 Processor -- start 2023-11-28T21:08:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1152780640 1 -- start start 2023-11-28T21:08:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1152780640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c06ca80 0x7f114c144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1152780640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f114c0714f0 0x7f114c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1152780640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f114c1591a0 0x7f114c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1152780640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c1588b0 con 0x7f114c06ca80 2023-11-28T21:08:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1152780640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c157c30 con 0x7f114c0714f0 2023-11-28T21:08:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1152780640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c157f10 con 0x7f114c1591a0 2023-11-28T21:08:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1150d1d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f114c1591a0 0x7f114c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1150d1d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f114c1591a0 0x7f114c155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51488/0 (socket says 172.21.15.6:51488) 2023-11-28T21:08:16.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f1150d1d640 1 -- 172.21.15.6:0/2846017382 learned_addr learned my addr 172.21.15.6:0/2846017382 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f901fae80 con 0x7f9f9006e480 2023-11-28T21:08:16.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1143fff640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f114c0714f0 0x7f114c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1150d1d640 1 -- 172.21.15.6:0/2846017382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f114c0714f0 msgr2=0x7f114c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1150d1d640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f114c0714f0 0x7f114c15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1150d1d640 1 -- 172.21.15.6:0/2846017382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c06ca80 msgr2=0x7f114c144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1150d1d640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c06ca80 0x7f114c144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1150d1d640 1 -- 172.21.15.6:0/2846017382 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134009420 con 0x7f114c1591a0 2023-11-28T21:08:16.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.759+0000 7f75537fe640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7538066540 0x7f7538068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75400045f0 tx=0x7f7540008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f753ffff640 1 -- 172.21.15.6:0/2208349648 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75540cae50 con 0x7f754c0e3260 2023-11-28T21:08:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1150d1d640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f114c1591a0 0x7f114c155970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f114400c760 tx=0x7f114400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f11497fa640 1 -- 172.21.15.6:0/2846017382 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1144003b80 con 0x7f114c1591a0 2023-11-28T21:08:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f11497fa640 1 -- 172.21.15.6:0/2846017382 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1144003d00 con 0x7f114c1591a0 2023-11-28T21:08:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f11497fa640 1 -- 172.21.15.6:0/2846017382 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400aa90 con 0x7f114c1591a0 2023-11-28T21:08:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c159700 con 0x7f114c1591a0 2023-11-28T21:08:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c1584d0 con 0x7f114c1591a0 2023-11-28T21:08:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f90072b90 con 0x7f9f9006e480 2023-11-28T21:08:16.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d45f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77cc06d190 0x7f77cc15d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d45f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77cc0714f0 0x7f77cc149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d45f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77cc1591a0 0x7f77cc0b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d45f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc15d9e0 con 0x7f77cc1591a0 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d45f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc140460 con 0x7f77cc06d190 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d45f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc140740 con 0x7f77cc0714f0 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d2394640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77cc06d190 0x7f77cc15d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d1b93640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77cc0714f0 0x7f77cc149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d2394640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77cc06d190 0x7f77cc15d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:43528/0 (socket says 172.21.15.6:43528) 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d2394640 1 -- 172.21.15.6:0/237073068 learned_addr learned my addr 172.21.15.6:0/237073068 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d2394640 1 -- 172.21.15.6:0/237073068 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77cc0714f0 msgr2=0x7f77cc149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d2394640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77cc0714f0 0x7f77cc149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d2394640 1 -- 172.21.15.6:0/237073068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77cc1591a0 msgr2=0x7f77cc0b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d2394640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77cc1591a0 0x7f77cc0b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d2394640 1 -- 172.21.15.6:0/237073068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4009a70 con 0x7f77cc06d190 2023-11-28T21:08:16.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d1b93640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77cc0714f0 0x7f77cc149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:16.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f9f86ffd640 1 -- 172.21.15.6:0/3093774409 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f8c0a9410 con 0x7f9f9006e480 2023-11-28T21:08:16.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f77d2394640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77cc06d190 0x7f77cc15d4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00c410 tx=0x7f77bc00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.763+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c1589f0 con 0x7f114c1591a0 2023-11-28T21:08:16.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9f86ffd640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f74066470 0x7f9f74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c430e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c144910 0x7f9c3c136610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c40e7f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c3c06ce90 0x7f9c3c1360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c40e7f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c3c06ce90 0x7f9c3c1360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:51502/0 (socket says 172.21.15.6:51502) 2023-11-28T21:08:16.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9f86ffd640 1 -- 172.21.15.6:0/3093774409 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f8c11e4a0 con 0x7f9f9006e480 2023-11-28T21:08:16.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c40e7f640 1 -- 172.21.15.6:0/2081101648 learned_addr learned my addr 172.21.15.6:0/2081101648 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:16.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c430e3640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3c15bef0 0x7f9c3c139bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c430e3640 1 -- 172.21.15.6:0/2081101648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c135d20 con 0x7f9c3c144910 2023-11-28T21:08:16.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c430e3640 1 -- 172.21.15.6:0/2081101648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c135110 con 0x7f9c3c15bef0 2023-11-28T21:08:16.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f77c2ffd640 1 -- 172.21.15.6:0/237073068 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0054e0 con 0x7f77cc06d190 2023-11-28T21:08:16.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f77c2ffd640 1 -- 172.21.15.6:0/237073068 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc003600 con 0x7f77cc06d190 2023-11-28T21:08:16.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f77c2ffd640 1 -- 172.21.15.6:0/237073068 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc003990 con 0x7f77cc06d190 2023-11-28T21:08:16.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9f95d90640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f74066470 0x7f9f74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c430e3640 1 -- 172.21.15.6:0/2081101648 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c1353f0 con 0x7f9c3c06ce90 2023-11-28T21:08:16.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c3bfff640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c144910 0x7f9c3c136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c41680640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3c15bef0 0x7f9c3c139bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc159700 con 0x7f77cc06d190 2023-11-28T21:08:16.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9f95d90640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f74066470 0x7f9f74068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9f9014bc20 tx=0x7f9f80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc140d00 con 0x7f77cc06d190 2023-11-28T21:08:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c41680640 1 -- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c3c06ce90 msgr2=0x7f9c3c1360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c41680640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c3c06ce90 0x7f9c3c1360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c41680640 1 -- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c144910 msgr2=0x7f9c3c136610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c41680640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c144910 0x7f9c3c136610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f9c41680640 1 -- 172.21.15.6:0/2081101648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3000d8c0 con 0x7f9c3c15bef0 2023-11-28T21:08:16.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f11497fa640 1 -- 172.21.15.6:0/2846017382 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f114400abf0 con 0x7f114c1591a0 2023-11-28T21:08:16.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f11497fa640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f112c0664c0 0x7f112c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f11497fa640 1 -- 172.21.15.6:0/2846017382 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1144083b40 con 0x7f114c1591a0 2023-11-28T21:08:16.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.767+0000 7f114bfff640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f112c0664c0 0x7f112c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f114bfff640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f112c0664c0 0x7f112c068980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f113c000f70 tx=0x7f113c0078e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f9c40e7f640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c3c06ce90 0x7f9c3c1360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:16.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f9c41680640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3c15bef0 0x7f9c3c139bc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c300af000 tx=0x7f9c3001d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc072b90 con 0x7f77cc06d190 2023-11-28T21:08:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f9c397fa640 1 -- 172.21.15.6:0/2081101648 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000b070 con 0x7f9c3c15bef0 2023-11-28T21:08:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f9c430e3640 1 -- 172.21.15.6:0/2081101648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c1356d0 con 0x7f9c3c15bef0 2023-11-28T21:08:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f9c430e3640 1 -- 172.21.15.6:0/2081101648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c13a100 con 0x7f9c3c15bef0 2023-11-28T21:08:16.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f77c2ffd640 1 -- 172.21.15.6:0/237073068 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77bc003af0 con 0x7f77cc06d190 2023-11-28T21:08:16.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f9c397fa640 1 -- 172.21.15.6:0/2081101648 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c300a9e70 con 0x7f9c3c15bef0 2023-11-28T21:08:16.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f9c397fa640 1 -- 172.21.15.6:0/2081101648 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000b070 con 0x7f9c3c15bef0 2023-11-28T21:08:16.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f9c22ffd640 1 -- 172.21.15.6:0/2081101648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c14005260 con 0x7f9c3c15bef0 2023-11-28T21:08:16.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f77c2ffd640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f77b00664c0 0x7f77b0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f11497fa640 1 -- 172.21.15.6:0/2846017382 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f114c1589f0 con 0x7f114c1591a0 2023-11-28T21:08:16.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.771+0000 7f9f86ffd640 1 -- 172.21.15.6:0/3093774409 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f8c0eb9d0 con 0x7f9f9006e480 2023-11-28T21:08:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.775+0000 7f77d1b93640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f77b00664c0 0x7f77b0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.775+0000 7f77c2ffd640 1 -- 172.21.15.6:0/237073068 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77bc0833a0 con 0x7f77cc06d190 2023-11-28T21:08:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.775+0000 7f77d1b93640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f77b00664c0 0x7f77b0068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77c8001ec0 tx=0x7f77c8001620 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.775+0000 7f9c397fa640 1 -- 172.21.15.6:0/2081101648 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c300ba460 con 0x7f9c3c15bef0 2023-11-28T21:08:16.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.779+0000 7f9c397fa640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9c280664d0 0x7f9c28068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:16.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.779+0000 7f9c397fa640 1 -- 172.21.15.6:0/2081101648 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c3011d800 con 0x7f9c3c15bef0 2023-11-28T21:08:16.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.779+0000 7f9c40e7f640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9c280664d0 0x7f9c28068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:16.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.779+0000 7f9c40e7f640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9c280664d0 0x7f9c28068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c340076a0 tx=0x7f9c3400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:16.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.779+0000 7f77c2ffd640 1 -- 172.21.15.6:0/237073068 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77bc0508b0 con 0x7f77cc06d190 2023-11-28T21:08:16.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:16.783+0000 7f9c397fa640 1 -- 172.21.15.6:0/2081101648 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c300ead20 con 0x7f9c3c15bef0 2023-11-28T21:08:17.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.087+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4c406dce0 con 0x7ff4c40b1170 2023-11-28T21:08:17.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.091+0000 7ff4ba7fc640 1 -- 172.21.15.6:0/2230973057 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4c0053d30 con 0x7ff4c40b1170 2023-11-28T21:08:17.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.091+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f979004e850 con 0x7f97900cfa80 2023-11-28T21:08:17.098 INFO:teuthology.orchestra.run.smithi006.stdout:60129542148 2023-11-28T21:08:17.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.091+0000 7f978dffb640 1 -- 172.21.15.6:0/916978121 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97800548e0 con 0x7f97900cfa80 2023-11-28T21:08:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.091+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4a8066540 msgr2=0x7ff4a8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.091+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4a8066540 0x7ff4a8068a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40b1000 tx=0x7ff4b4004740 comp rx=0 tx=0).stop 2023-11-28T21:08:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40b1170 msgr2=0x7ff4c414aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40b1170 0x7ff4c414aec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c420 tx=0x7ff4c000c8e0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 shutdown_connections 2023-11-28T21:08:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4a8066540 0x7ff4a8068a00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4c4159d40 0x7ff4c414d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cbb70 0x7ff4c414cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 --2- 172.21.15.6:0/2230973057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4c40b1170 0x7ff4c414aec0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 >> 172.21.15.6:0/2230973057 conn(0x7ff4c40b0650 msgr2=0x7ff4c40af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:17.101 INFO:teuthology.orchestra.run.smithi006.stdout:60129542148 2023-11-28T21:08:17.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f754c0515d0 con 0x7f754c0e3260 2023-11-28T21:08:17.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 shutdown_connections 2023-11-28T21:08:17.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7ff4cbf65640 1 -- 172.21.15.6:0/2230973057 wait complete. 2023-11-28T21:08:17.103 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2023-11-28T21:08:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7f753ffff640 1 -- 172.21.15.6:0/2208349648 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75540ce470 con 0x7f754c0e3260 2023-11-28T21:08:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.095+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf840b6060 con 0x7fcf840c8cd0 2023-11-28T21:08:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f97740664c0 msgr2=0x7f9774068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f97740664c0 0x7f9774068980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f979006d750 tx=0x7f97780aa000 comp rx=0 tx=0).stop 2023-11-28T21:08:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97900cfa80 msgr2=0x7f97900b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97900cfa80 0x7f97900b4ce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f978000b550 tx=0x7f978000ba10 comp rx=0 tx=0).stop 2023-11-28T21:08:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7538066540 msgr2=0x7f7538068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7538066540 0x7f7538068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75400045f0 tx=0x7f7540008040 comp rx=0 tx=0).stop 2023-11-28T21:08:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f754c0e3260 msgr2=0x7f754c0e5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f754c0e3260 0x7f754c0e5c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7554063f10 tx=0x7f7554068a30 comp rx=0 tx=0).stop 2023-11-28T21:08:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7fcf7b7fe640 1 -- 172.21.15.6:0/2997888202 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf840b6060 con 0x7fcf840c8cd0 2023-11-28T21:08:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 shutdown_connections 2023-11-28T21:08:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7538066540 0x7f7538068a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f754c0e3260 0x7f754c0e5c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 shutdown_connections 2023-11-28T21:08:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f97740664c0 0x7f9774068980 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9790160980 0x7f9790151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97900cfa80 0x7f97900b4ce0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 --2- 172.21.15.6:0/916978121 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97900ce6b0 0x7f97900cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 >> 172.21.15.6:0/916978121 conn(0x7f97900d3000 msgr2=0x7f979015e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f754c058960 0x7f754c0e5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 --2- 172.21.15.6:0/2208349648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f754c03e8d0 0x7f754c0e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 >> 172.21.15.6:0/2208349648 conn(0x7f754c058ed0 msgr2=0x7f754c04d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 shutdown_connections 2023-11-28T21:08:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f9796df8640 1 -- 172.21.15.6:0/916978121 wait complete. 2023-11-28T21:08:17.109 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2023-11-28T21:08:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 shutdown_connections 2023-11-28T21:08:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.099+0000 7f7558e3c640 1 -- 172.21.15.6:0/2208349648 wait complete. 2023-11-28T21:08:17.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf680664f0 msgr2=0x7fcf680689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf680664f0 0x7fcf680689b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf840b0b90 tx=0x7fcf6c009040 comp rx=0 tx=0).stop 2023-11-28T21:08:17.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840c8cd0 msgr2=0x7fcf84159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840c8cd0 0x7fcf84159aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0ab000 tx=0x7fcf7c0195e0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7f9c22ffd640 1 -- 172.21.15.6:0/2081101648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9c14005510 con 0x7f9c3c15bef0 2023-11-28T21:08:17.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 shutdown_connections 2023-11-28T21:08:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf680664f0 0x7fcf680689b0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf840b0b90 tx=0x7fcf6c009040 comp rx=0 tx=0).stop 2023-11-28T21:08:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf840c8cd0 0x7fcf84159aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf840cfda0 0x7fcf84159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 --2- 172.21.15.6:0/2997888202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf840cf3c0 0x7fcf84155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 >> 172.21.15.6:0/2997888202 conn(0x7fcf8409c480 msgr2=0x7fcf840d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 shutdown_connections 2023-11-28T21:08:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.107+0000 7f9c397fa640 1 -- 172.21.15.6:0/2081101648 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c300bf090 con 0x7f9c3c15bef0 2023-11-28T21:08:17.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.111+0000 7fcf88d9d640 1 -- 172.21.15.6:0/2997888202 wait complete. 2023-11-28T21:08:17.115 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-11-28T21:08:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.111+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f114c072b90 con 0x7f114c1591a0 2023-11-28T21:08:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 -- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9c280664d0 msgr2=0x7f9c28068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9c280664d0 0x7f9c28068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c340076a0 tx=0x7f9c3400b040 comp rx=0 tx=0).stop 2023-11-28T21:08:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 -- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3c15bef0 msgr2=0x7f9c3c139bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3c15bef0 0x7f9c3c139bc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c300af000 tx=0x7f9c3001d520 comp rx=0 tx=0).stop 2023-11-28T21:08:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 -- 172.21.15.6:0/2081101648 shutdown_connections 2023-11-28T21:08:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f11497fa640 1 -- 172.21.15.6:0/2846017382 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f114c1589f0 con 0x7f114c1591a0 2023-11-28T21:08:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9c280664d0 0x7f9c28068990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3c15bef0 0x7f9c3c139bc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c3c144910 0x7f9c3c136610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 --2- 172.21.15.6:0/2081101648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c3c06ce90 0x7f9c3c1360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9c22ffd640 1 -- 172.21.15.6:0/2081101648 >> 172.21.15.6:0/2081101648 conn(0x7f9c3c06a580 msgr2=0x7f9c3c15d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:17.122 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-11-28T21:08:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.115+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9f9004e930 con 0x7f9f9006e480 2023-11-28T21:08:17.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f9c22ffd640 1 -- 172.21.15.6:0/2081101648 shutdown_connections 2023-11-28T21:08:17.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f9c22ffd640 1 -- 172.21.15.6:0/2081101648 wait complete. 2023-11-28T21:08:17.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f9f86ffd640 1 -- 172.21.15.6:0/3093774409 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f8c0eeff0 con 0x7f9f9006e480 2023-11-28T21:08:17.125 INFO:teuthology.orchestra.run.smithi006.stdout:64424509444 2023-11-28T21:08:17.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f112c0664c0 msgr2=0x7f112c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f112c0664c0 0x7f112c068980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f113c000f70 tx=0x7f113c0078e0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f114c1591a0 msgr2=0x7f114c155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f114c1591a0 0x7f114c155970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f114400c760 tx=0x7f114400cc20 comp rx=0 tx=0).stop 2023-11-28T21:08:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 shutdown_connections 2023-11-28T21:08:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f112c0664c0 0x7f112c068980 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f113c000f70 tx=0x7f113c0078e0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f114c1591a0 0x7f114c155970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f114c0714f0 0x7f114c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 --2- 172.21.15.6:0/2846017382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c06ca80 0x7f114c144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 >> 172.21.15.6:0/2846017382 conn(0x7f114c06a580 msgr2=0x7f114c0aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 shutdown_connections 2023-11-28T21:08:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f1152780640 1 -- 172.21.15.6:0/2846017382 wait complete. 2023-11-28T21:08:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f77cc04e930 con 0x7f77cc06d190 2023-11-28T21:08:17.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.119+0000 7f77c2ffd640 1 -- 172.21.15.6:0/237073068 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77bc017020 con 0x7f77cc06d190 2023-11-28T21:08:17.128 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-11-28T21:08:17.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f74066470 msgr2=0x7f9f74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f74066470 0x7f9f74068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9f9014bc20 tx=0x7f9f80009040 comp rx=0 tx=0).stop 2023-11-28T21:08:17.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9006e480 msgr2=0x7f9f9016b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9006e480 0x7f9f9016b7e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c019100 tx=0x7f9f8c01ad30 comp rx=0 tx=0).stop 2023-11-28T21:08:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 shutdown_connections 2023-11-28T21:08:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f74066470 0x7f9f74068930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f901590a0 0x7f9f90169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900ce370 0x7f9f901fa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 --2- 172.21.15.6:0/3093774409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9006e480 0x7f9f9016b7e0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c019100 tx=0x7f9f8c01ad30 comp rx=0 tx=0).stop 2023-11-28T21:08:17.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 >> 172.21.15.6:0/3093774409 conn(0x7f9f9006a980 msgr2=0x7f9f900b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 shutdown_connections 2023-11-28T21:08:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f9f987f5640 1 -- 172.21.15.6:0/3093774409 wait complete. 2023-11-28T21:08:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f77b00664c0 msgr2=0x7f77b0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f77b00664c0 0x7f77b0068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77c8001ec0 tx=0x7f77c8001620 comp rx=0 tx=0).stop 2023-11-28T21:08:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77cc06d190 msgr2=0x7f77cc15d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77cc06d190 0x7f77cc15d4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00c410 tx=0x7f77bc00c8d0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 shutdown_connections 2023-11-28T21:08:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f77b00664c0 0x7f77b0068980 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77c8001ec0 tx=0x7f77c8001620 comp rx=0 tx=0).stop 2023-11-28T21:08:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77cc1591a0 0x7f77cc0b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77cc0714f0 0x7f77cc149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 --2- 172.21.15.6:0/237073068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77cc06d190 0x7f77cc15d4a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.123+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 >> 172.21.15.6:0/237073068 conn(0x7f77cc06a580 msgr2=0x7f77cc155600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.127+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 shutdown_connections 2023-11-28T21:08:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:17.127+0000 7f77d45f8640 1 -- 172.21.15.6:0/237073068 wait complete. 2023-11-28T21:08:17.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2023-11-28T21:08:17.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.3 2023-11-28T21:08:17.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2023-11-28T21:08:17.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2023-11-28T21:08:17.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2023-11-28T21:08:17.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2023-11-28T21:08:17.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.4 2023-11-28T21:08:17.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.7 2023-11-28T21:08:18.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T21:08:18.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T21:08:18.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T21:08:18.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T21:08:18.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T21:08:18.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T21:08:18.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T21:08:18.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T21:08:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.371+0000 7fd28070f640 1 Processor -- start 2023-11-28T21:08:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.371+0000 7fd28070f640 1 -- start start 2023-11-28T21:08:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.371+0000 7f94e6832640 1 Processor -- start 2023-11-28T21:08:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.371+0000 7f94e6832640 1 -- start start 2023-11-28T21:08:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.371+0000 7fd28070f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780cd0e0 0x7fd278070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.371+0000 7fd28070f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd27806c8b0 0x7fd2780cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd28070f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2780c9150 con 0x7fd2780c1fe0 2023-11-28T21:08:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27ecac640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd27806c8b0 0x7fd2780cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27ecac640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd27806c8b0 0x7fd2780cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49096/0 (socket says 172.21.15.6:49096) 2023-11-28T21:08:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27ecac640 1 -- 172.21.15.6:0/357109726 learned_addr learned my addr 172.21.15.6:0/357109726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd28070f640 1 -- 172.21.15.6:0/357109726 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780c9960 con 0x7fd27806c8b0 2023-11-28T21:08:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27dcaa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780cd0e0 0x7fd278070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd28070f640 1 -- 172.21.15.6:0/357109726 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780cd570 con 0x7fd2780cd0e0 2023-11-28T21:08:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94e6832640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94e00cb460 0x7f94e00ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27d4a9640 1 -- 172.21.15.6:0/357109726 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992503144 0 0) 0x7fd2780c9150 con 0x7fd2780c1fe0 2023-11-28T21:08:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94dffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f94e00c2070 0x7f94e00cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:54488/0 (socket says 172.21.15.6:54488) 2023-11-28T21:08:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94dffff640 1 -- 172.21.15.6:0/244194131 learned_addr learned my addr 172.21.15.6:0/244194131 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94e6832640 1 -- 172.21.15.6:0/244194131 --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00c9150 con 0x7f94e006cbb0 2023-11-28T21:08:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94e6832640 1 -- 172.21.15.6:0/244194131 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00c2450 con 0x7f94e00c2070 2023-11-28T21:08:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94e6832640 1 -- 172.21.15.6:0/244194131 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e00c9960 con 0x7f94e00cb460 2023-11-28T21:08:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626561883 0 0) 0x7f94e00c2450 con 0x7f94e00c2070 2023-11-28T21:08:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c8003530 con 0x7f94e00c2070 2023-11-28T21:08:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2725626996 0 0) 0x7f94c8003530 con 0x7f94e00c2070 2023-11-28T21:08:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 >> v2:172.21.15.6:3300/0 conn(0x7f94e00cb460 msgr2=0x7f94e00ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 --2- 172.21.15.6:0/244194131 >> v2:172.21.15.6:3300/0 conn(0x7f94e00cb460 0x7f94e00ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 >> v1:172.21.15.6:6789/0 conn(0x7f94e006cbb0 legacy=0x7f94e00cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00c93a0 con 0x7f94e00c2070 2023-11-28T21:08:18.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f94d8001a00 con 0x7f94e00c2070 2023-11-28T21:08:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 >> v1:172.21.15.31:6789/0 conn(0x7f94e00c2070 legacy=0x7f94e00cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94c80039d0 0x7f94c8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80047d0 0x7f94c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c8005390 0x7f94c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c9960 con 0x7f94c80047d0 2023-11-28T21:08:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c800c2b0 con 0x7f94c80039d0 2023-11-28T21:08:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c800c470 con 0x7f94c8005390 2023-11-28T21:08:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94dffff640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94c80039d0 0x7f94c8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94e4dcf640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c8005390 0x7f94c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94df7fe640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80047d0 0x7f94c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94dffff640 1 -- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c8005390 msgr2=0x7f94c800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94dffff640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c8005390 0x7f94c800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94dffff640 1 -- 172.21.15.6:0/244194131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80047d0 msgr2=0x7f94c8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94dffff640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80047d0 0x7f94c8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94dffff640 1 -- 172.21.15.6:0/244194131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8003530 con 0x7f94c80039d0 2023-11-28T21:08:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27d4a9640 1 -- 172.21.15.6:0/357109726 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd264003530 con 0x7fd2780c1fe0 2023-11-28T21:08:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27dcaa640 1 -- 172.21.15.6:0/357109726 >> v2:172.21.15.6:3300/0 conn(0x7fd27806c8b0 msgr2=0x7fd2780cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27dcaa640 1 --2- 172.21.15.6:0/357109726 >> v2:172.21.15.6:3300/0 conn(0x7fd27806c8b0 0x7fd2780cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27dcaa640 1 -- 172.21.15.6:0/357109726 >> v1:172.21.15.31:6789/0 conn(0x7fd2780c1fe0 legacy=0x7fd27806c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.375+0000 7fd27dcaa640 1 -- 172.21.15.6:0/357109726 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780c93a0 con 0x7fd2780cd0e0 2023-11-28T21:08:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94e4dcf640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c8005390 0x7f94c800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7f94e4dcf640 1 -- 172.21.15.6:0/244194131 reap_dead start 2023-11-28T21:08:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7fd27dcaa640 1 --2- 172.21.15.6:0/357109726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780cd0e0 0x7fd278070140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd2740097c0 tx=0x7fd27401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5814094bb6c0381 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7fd27d4a9640 1 -- 172.21.15.6:0/357109726 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740ad680 con 0x7fd2780cd0e0 2023-11-28T21:08:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7fd27d4a9640 1 -- 172.21.15.6:0/357109726 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2740ad7e0 con 0x7fd2780cd0e0 2023-11-28T21:08:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.379+0000 7fd27d4a9640 1 -- 172.21.15.6:0/357109726 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740adb70 con 0x7fd2780cd0e0 2023-11-28T21:08:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7fd28070f640 1 -- 172.21.15.6:0/357109726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780cd0e0 msgr2=0x7fd278070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7fd28070f640 1 --2- 172.21.15.6:0/357109726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780cd0e0 0x7fd278070140 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd2740097c0 tx=0x7fd27401c400 comp rx=0 tx=0).stop 2023-11-28T21:08:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7fd28070f640 1 -- 172.21.15.6:0/357109726 shutdown_connections 2023-11-28T21:08:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7fd28070f640 1 --2- 172.21.15.6:0/357109726 >> v2:172.21.15.6:3300/0 conn(0x7fd27806c8b0 0x7fd2780cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7fd28070f640 1 --2- 172.21.15.6:0/357109726 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780cd0e0 0x7fd278070140 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7fd28070f640 1 -- 172.21.15.6:0/357109726 >> 172.21.15.6:0/357109726 conn(0x7fd2780b0650 msgr2=0x7fd2780b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7f94dffff640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94c80039d0 0x7f94c8003df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f94d800a760 tx=0x7f94d801d280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3ba2e9af9ae3379 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7fd28070f640 1 -- 172.21.15.6:0/357109726 shutdown_connections 2023-11-28T21:08:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7fd28070f640 1 -- 172.21.15.6:0/357109726 wait complete. 2023-11-28T21:08:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d80ad630 con 0x7f94c80039d0 2023-11-28T21:08:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.383+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d80a8070 con 0x7f94c80039d0 2023-11-28T21:08:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7f94deffd640 1 -- 172.21.15.6:0/244194131 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d80ad630 con 0x7f94c80039d0 2023-11-28T21:08:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7f94e6832640 1 -- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94c80039d0 msgr2=0x7f94c8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7f94e6832640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94c80039d0 0x7f94c8003df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f94d800a760 tx=0x7f94d801d280 comp rx=0 tx=0).stop 2023-11-28T21:08:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7f94e6832640 1 -- 172.21.15.6:0/244194131 shutdown_connections 2023-11-28T21:08:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7f94e6832640 1 --2- 172.21.15.6:0/244194131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94c80039d0 0x7f94c8003df0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7f94e6832640 1 -- 172.21.15.6:0/244194131 >> 172.21.15.6:0/244194131 conn(0x7f94e00b0650 msgr2=0x7f94e00b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7f94e6832640 1 -- 172.21.15.6:0/244194131 shutdown_connections 2023-11-28T21:08:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7fd28070f640 1 Processor -- start 2023-11-28T21:08:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7f94e6832640 1 -- 172.21.15.6:0/244194131 wait complete. 2023-11-28T21:08:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7fd28070f640 1 -- start start 2023-11-28T21:08:18.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.387+0000 7fd28070f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd27806c8b0 0x7fd278151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd28070f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780c1fe0 0x7fd27815f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd28070f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd27815f9c0 0x7fd2780b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd28070f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27815e880 con 0x7fd27806c8b0 2023-11-28T21:08:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd28070f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780b1f70 con 0x7fd27815f9c0 2023-11-28T21:08:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd28070f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780b2250 con 0x7fd2780c1fe0 2023-11-28T21:08:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7f94e6832640 1 Processor -- start 2023-11-28T21:08:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27dcaa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780c1fe0 0x7fd27815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7f94e6832640 1 -- start start 2023-11-28T21:08:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27dcaa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780c1fe0 0x7fd27815f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:39286/0 (socket says 172.21.15.6:39286) 2023-11-28T21:08:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27dcaa640 1 -- 172.21.15.6:0/3903276411 learned_addr learned my addr 172.21.15.6:0/3903276411 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27e4ab640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd27806c8b0 0x7fd278151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27dcaa640 1 -- 172.21.15.6:0/3903276411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd27815f9c0 msgr2=0x7fd2780b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27dcaa640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd27815f9c0 0x7fd2780b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27dcaa640 1 -- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd27806c8b0 msgr2=0x7fd278151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27dcaa640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd27806c8b0 0x7fd278151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27dcaa640 1 -- 172.21.15.6:0/3903276411 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009420 con 0x7fd2780c1fe0 2023-11-28T21:08:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd27dcaa640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780c1fe0 0x7fd27815f480 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd27401aab0 tx=0x7fd27401ac40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd26effd640 1 -- 172.21.15.6:0/3903276411 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740add60 con 0x7fd2780c1fe0 2023-11-28T21:08:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd26effd640 1 -- 172.21.15.6:0/3903276411 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2740b8450 con 0x7fd2780c1fe0 2023-11-28T21:08:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd26effd640 1 -- 172.21.15.6:0/3903276411 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2740b8800 con 0x7fd2780c1fe0 2023-11-28T21:08:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd28070f640 1 -- 172.21.15.6:0/3903276411 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2780b2530 con 0x7fd2780c1fe0 2023-11-28T21:08:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7fd28070f640 1 -- 172.21.15.6:0/3903276411 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2780b2af0 con 0x7fd2780c1fe0 2023-11-28T21:08:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.391+0000 7f94e6832640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c80039d0 0x7f94e0160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7fd26cff9640 1 -- 172.21.15.6:0/3903276411 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd254005260 con 0x7fd2780c1fe0 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94e6832640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e00c52d0 0x7f94e015f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94e6832640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e015fba0 0x7f94e0157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94dffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c80039d0 0x7f94e0160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94dffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c80039d0 0x7f94e0160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:39292/0 (socket says 172.21.15.6:39292) 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94dffff640 1 -- 172.21.15.6:0/498094342 learned_addr learned my addr 172.21.15.6:0/498094342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c4c70 con 0x7f94e00c52d0 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94df7fe640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e00c52d0 0x7f94e015f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00b43f0 con 0x7f94e015fba0 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01572f0 con 0x7f94c80039d0 2023-11-28T21:08:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94e4dcf640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e015fba0 0x7f94e0157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7fd26effd640 1 -- 172.21.15.6:0/3903276411 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd2740b4070 con 0x7fd2780c1fe0 2023-11-28T21:08:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94dffff640 1 -- 172.21.15.6:0/498094342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e015fba0 msgr2=0x7f94e0157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94dffff640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e015fba0 0x7f94e0157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94dffff640 1 -- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e00c52d0 msgr2=0x7f94e015f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94dffff640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e00c52d0 0x7f94e015f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7f94dffff640 1 -- 172.21.15.6:0/498094342 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0160c60 con 0x7f94c80039d0 2023-11-28T21:08:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7fd26effd640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd25c066470 0x7fd25c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.395+0000 7fd27e4ab640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd25c066470 0x7fd25c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.399+0000 7f94dffff640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c80039d0 0x7f94e0160720 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f94d801d2c0 tx=0x7f94c8005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.399+0000 7fd26effd640 1 -- 172.21.15.6:0/3903276411 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd27411e320 con 0x7fd2780c1fe0 2023-11-28T21:08:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.399+0000 7fd27e4ab640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd25c066470 0x7fd25c068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2680011f0 tx=0x7fd268009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.399+0000 7f94dcff9640 1 -- 172.21.15.6:0/498094342 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d80ba070 con 0x7f94c80039d0 2023-11-28T21:08:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.399+0000 7f94dcff9640 1 -- 172.21.15.6:0/498094342 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d8001980 con 0x7f94c80039d0 2023-11-28T21:08:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.399+0000 7f94dcff9640 1 -- 172.21.15.6:0/498094342 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d80ad430 con 0x7f94c80039d0 2023-11-28T21:08:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.399+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e00b4110 con 0x7f94c80039d0 2023-11-28T21:08:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.403+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e0157870 con 0x7f94c80039d0 2023-11-28T21:08:18.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.403+0000 7fd26effd640 1 -- 172.21.15.6:0/3903276411 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2740eb830 con 0x7fd2780c1fe0 2023-11-28T21:08:18.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.403+0000 7f94dcff9640 1 -- 172.21.15.6:0/498094342 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f94d80aa030 con 0x7f94c80039d0 2023-11-28T21:08:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.407+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e0157a60 con 0x7f94c80039d0 2023-11-28T21:08:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.407+0000 7f94dcff9640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f94cc0664c0 0x7f94cc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.407+0000 7f94dcff9640 1 -- 172.21.15.6:0/498094342 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94d811de00 con 0x7f94c80039d0 2023-11-28T21:08:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.407+0000 7f94df7fe640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f94cc0664c0 0x7f94cc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.407+0000 7f94df7fe640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f94cc0664c0 0x7f94cc068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94d0006fd0 tx=0x7f94d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.415+0000 7f94dcff9640 1 -- 172.21.15.6:0/498094342 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f94d80eb3f0 con 0x7f94c80039d0 2023-11-28T21:08:18.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.447+0000 7fae72d8d640 1 Processor -- start 2023-11-28T21:08:18.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.447+0000 7fae72d8d640 1 -- start start 2023-11-28T21:08:18.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.447+0000 7fae72d8d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae6c0cbb70 0x7fae6c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.447+0000 7fcfc03f8640 1 Processor -- start 2023-11-28T21:08:18.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.447+0000 7fcfc03f8640 1 -- start start 2023-11-28T21:08:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.447+0000 7fae72d8d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c159d40 0x7fae6c0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.447+0000 7fae70b29640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae6c0cbb70 0x7fae6c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.447+0000 7fae6bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fae6c0c9150 0x7fae6c159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40212/0 (socket says 172.21.15.6:40212) 2023-11-28T21:08:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fae6bfff640 1 -- 172.21.15.6:0/4197292686 learned_addr learned my addr 172.21.15.6:0/4197292686 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fae72d8d640 1 -- 172.21.15.6:0/4197292686 --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c0ce8f0 con 0x7fae6c0c9150 2023-11-28T21:08:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fae72d8d640 1 -- 172.21.15.6:0/4197292686 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c06c900 con 0x7fae6c0cbb70 2023-11-28T21:08:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fae72d8d640 1 -- 172.21.15.6:0/4197292686 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0c9b40 con 0x7fae6c159d40 2023-11-28T21:08:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fae7132a640 1 --2- 172.21.15.6:0/4197292686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c159d40 0x7fae6c0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fae70b29640 1 -- 172.21.15.6:0/4197292686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c159d40 msgr2=0x7fae6c0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fae70b29640 1 --2- 172.21.15.6:0/4197292686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c159d40 0x7fae6c0c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fae70b29640 1 -- 172.21.15.6:0/4197292686 >> v1:172.21.15.6:6789/0 conn(0x7fae6c0c9150 legacy=0x7fae6c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fae70b29640 1 -- 172.21.15.6:0/4197292686 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c15a2b0 con 0x7fae6c0cbb70 2023-11-28T21:08:18.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7ffb8ebd1640 1 Processor -- start 2023-11-28T21:08:18.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7ffb8ebd1640 1 -- start start 2023-11-28T21:08:18.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fcfc03f8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfb815e130 0x7fcfb81681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fcfc03f8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb815e7c0 con 0x7fcfb8143870 2023-11-28T21:08:18.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fcfc03f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb8143c50 con 0x7fcfb806d120 2023-11-28T21:08:18.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fcfc03f8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb815e5c0 con 0x7fcfb815e130 2023-11-28T21:08:18.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fcfbd993640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcfb806d120 0x7fcfb815da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:54502/0 (socket says 172.21.15.6:54502) 2023-11-28T21:08:18.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.451+0000 7fcfbd993640 1 -- 172.21.15.6:0/1820763750 learned_addr learned my addr 172.21.15.6:0/1820763750 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:18.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101776180 0 0) 0x7fcfb8143c50 con 0x7fcfb806d120 2023-11-28T21:08:18.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa4003530 con 0x7fcfb806d120 2023-11-28T21:08:18.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb8ebd1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb880714f0 0x7ffb8815d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb8ebd1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb880ae8e0 con 0x7ffb881591a0 2023-11-28T21:08:18.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb8ebd1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb880cca70 con 0x7ffb8806b0a0 2023-11-28T21:08:18.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb8ebd1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88072700 con 0x7ffb880714f0 2023-11-28T21:08:18.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb87fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffb8806b0a0 0x7ffb880cd230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:54514/0 (socket says 172.21.15.6:54514) 2023-11-28T21:08:18.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb87fff640 1 -- 172.21.15.6:0/4156235014 learned_addr learned my addr 172.21.15.6:0/4156235014 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:18.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1174086346 0 0) 0x7fcfa4003530 con 0x7fcfb806d120 2023-11-28T21:08:18.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 >> v2:172.21.15.6:3300/0 conn(0x7fcfb815e130 msgr2=0x7fcfb81681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 --2- 172.21.15.6:0/1820763750 >> v2:172.21.15.6:3300/0 conn(0x7fcfb815e130 0x7fcfb81681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 >> v1:172.21.15.6:6789/0 conn(0x7fcfb8143870 legacy=0x7fcfb806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329364830 0 0) 0x7ffb880cca70 con 0x7ffb8806b0a0 2023-11-28T21:08:18.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb78003530 con 0x7ffb8806b0a0 2023-11-28T21:08:18.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80b40a0 con 0x7fcfb806d120 2023-11-28T21:08:18.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fcfb4001680 con 0x7fcfb806d120 2023-11-28T21:08:18.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 >> v1:172.21.15.31:6789/0 conn(0x7fcfb806d120 legacy=0x7fcfb815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa4003980 0x7fcfa4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfa40047d0 0x7fcfa4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfa4005390 0x7fcfa40141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb815e5c0 con 0x7fcfa4003980 2023-11-28T21:08:18.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4014a60 con 0x7fcfa40047d0 2023-11-28T21:08:18.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4014c20 con 0x7fcfa4005390 2023-11-28T21:08:18.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbd993640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfa40047d0 0x7fcfa4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481651100 0 0) 0x7ffb78003530 con 0x7ffb8806b0a0 2023-11-28T21:08:18.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb880714f0 msgr2=0x7ffb8815d820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T21:08:18.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 --2- 172.21.15.6:0/4156235014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb880714f0 0x7ffb8815d820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 >> v1:172.21.15.6:6789/0 conn(0x7ffb881591a0 legacy=0x7ffb880b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb88071e80 con 0x7ffb8806b0a0 2023-11-28T21:08:18.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7ffb74001680 con 0x7ffb8806b0a0 2023-11-28T21:08:18.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 >> v1:172.21.15.31:6789/0 conn(0x7ffb8806b0a0 legacy=0x7ffb880cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 --2- 172.21.15.6:0/4156235014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb78003980 0x7ffb78003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 --2- 172.21.15.6:0/4156235014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb780047d0 0x7ffb78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 --2- 172.21.15.6:0/4156235014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb780052b0 0x7ffb780141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88072700 con 0x7ffb780047d0 2023-11-28T21:08:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78014970 con 0x7ffb780052b0 2023-11-28T21:08:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78014b30 con 0x7ffb78003980 2023-11-28T21:08:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7ffb87fff640 1 --2- 172.21.15.6:0/4156235014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb780047d0 0x7ffb78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7ffb87fff640 1 -- 172.21.15.6:0/4156235014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb78003980 msgr2=0x7ffb78003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T21:08:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7ffb87fff640 1 --2- 172.21.15.6:0/4156235014 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb78003980 0x7ffb78003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7ffb87fff640 1 -- 172.21.15.6:0/4156235014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb780052b0 msgr2=0x7ffb780141a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T21:08:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7ffb87fff640 1 --2- 172.21.15.6:0/4156235014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb780052b0 0x7ffb780141a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7ffb87fff640 1 -- 172.21.15.6:0/4156235014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb78003530 con 0x7ffb780047d0 2023-11-28T21:08:18.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fae70b29640 1 --2- 172.21.15.6:0/4197292686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0cbb70 0x7fae6c06cd20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae600097c0 tx=0x7fae6001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baee896719467b5b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fcfbd993640 1 -- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfa4005390 msgr2=0x7fcfa40141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fcfbe194640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa4003980 0x7fcfa4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.455+0000 7fcfbe995640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfa4005390 0x7fcfa40141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fcfbd993640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfa4005390 0x7fcfa40141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fcfbd993640 1 -- 172.21.15.6:0/1820763750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa4003980 msgr2=0x7fcfa4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fcfbd993640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa4003980 0x7fcfa4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fcfbd993640 1 -- 172.21.15.6:0/1820763750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80b40a0 con 0x7fcfa40047d0 2023-11-28T21:08:18.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fcfbe995640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfa4005390 0x7fcfa40141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:18.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fae6b7fe640 1 -- 172.21.15.6:0/4197292686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600ab600 con 0x7fae6c0cbb70 2023-11-28T21:08:18.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fcfbe995640 1 -- 172.21.15.6:0/1820763750 reap_dead start 2023-11-28T21:08:18.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fae6b7fe640 1 -- 172.21.15.6:0/4197292686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae600a7050 con 0x7fae6c0cbb70 2023-11-28T21:08:18.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.459+0000 7fae6b7fe640 1 -- 172.21.15.6:0/4197292686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600ab600 con 0x7fae6c0cbb70 2023-11-28T21:08:18.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fae72d8d640 1 -- 172.21.15.6:0/4197292686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0cbb70 msgr2=0x7fae6c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fae72d8d640 1 --2- 172.21.15.6:0/4197292686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0cbb70 0x7fae6c06cd20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae600097c0 tx=0x7fae6001c3f0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fcfbe194640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa4003980 0x7fcfa4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:18.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fae72d8d640 1 -- 172.21.15.6:0/4197292686 shutdown_connections 2023-11-28T21:08:18.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fae72d8d640 1 --2- 172.21.15.6:0/4197292686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c159d40 0x7fae6c0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fae72d8d640 1 --2- 172.21.15.6:0/4197292686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0cbb70 0x7fae6c06cd20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fae72d8d640 1 -- 172.21.15.6:0/4197292686 >> 172.21.15.6:0/4197292686 conn(0x7fae6c0b0650 msgr2=0x7fae6c0b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fae72d8d640 1 -- 172.21.15.6:0/4197292686 shutdown_connections 2023-11-28T21:08:18.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fae72d8d640 1 -- 172.21.15.6:0/4197292686 wait complete. 2023-11-28T21:08:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7ffb87fff640 1 --2- 172.21.15.6:0/4156235014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb780047d0 0x7ffb78004c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c0e0 tx=0x7ffb7401f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36aa8cad1371ed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740058e0 con 0x7ffb780047d0 2023-11-28T21:08:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74005a40 con 0x7ffb780047d0 2023-11-28T21:08:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/4156235014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb780047d0 msgr2=0x7ffb78004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7ffb8ebd1640 1 --2- 172.21.15.6:0/4156235014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb780047d0 0x7ffb78004c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c0e0 tx=0x7ffb7401f2f0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7ffb877fe640 1 -- 172.21.15.6:0/4156235014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74005e70 con 0x7ffb780047d0 2023-11-28T21:08:18.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7ffb8d16e640 1 -- 172.21.15.6:0/4156235014 reap_dead start 2023-11-28T21:08:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.463+0000 7fae72d8d640 1 Processor -- start 2023-11-28T21:08:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/4156235014 shutdown_connections 2023-11-28T21:08:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/4156235014 >> 172.21.15.6:0/4156235014 conn(0x7ffb8806a580 msgr2=0x7ffb8806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7fae72d8d640 1 -- start start 2023-11-28T21:08:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/4156235014 shutdown_connections 2023-11-28T21:08:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7fae72d8d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0c9150 0x7fae6c14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7fae72d8d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c0cbb70 0x7fae6c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/4156235014 wait complete. 2023-11-28T21:08:18.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7ffb8ebd1640 1 Processor -- start 2023-11-28T21:08:18.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7ffb8ebd1640 1 -- start start 2023-11-28T21:08:18.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.467+0000 7fae72d8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c159d40 0x7fae6c1fab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae72d8d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1fa720 con 0x7fae6c0c9150 2023-11-28T21:08:18.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae72d8d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1504e0 con 0x7fae6c159d40 2023-11-28T21:08:18.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae72d8d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0c7320 con 0x7fae6c0cbb70 2023-11-28T21:08:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae70b29640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0c9150 0x7fae6c14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae70b29640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0c9150 0x7fae6c14ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49180/0 (socket says 172.21.15.6:49180) 2023-11-28T21:08:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae70b29640 1 -- 172.21.15.6:0/1153878597 learned_addr learned my addr 172.21.15.6:0/1153878597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae6bfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c0cbb70 0x7fae6c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae7132a640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c159d40 0x7fae6c1fab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfbd993640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfa40047d0 0x7fcfa4004c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcfb806b250 tx=0x7fcfb401cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43ecd048d10a9aba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4005ae0 con 0x7fcfa40047d0 2023-11-28T21:08:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7f187c85f640 1 Processor -- start 2023-11-28T21:08:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7f187c85f640 1 -- start start 2023-11-28T21:08:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb4005c40 con 0x7fcfa40047d0 2023-11-28T21:08:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfbd192640 1 -- 172.21.15.6:0/1820763750 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40a58d0 con 0x7fcfa40047d0 2023-11-28T21:08:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7ffb8ebd1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb780047d0 0x7ffb880adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae6bfff640 1 -- 172.21.15.6:0/1153878597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c159d40 msgr2=0x7fae6c1fab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae6bfff640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c159d40 0x7fae6c1fab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae6bfff640 1 -- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0c9150 msgr2=0x7fae6c14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae6bfff640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0c9150 0x7fae6c14ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae6bfff640 1 -- 172.21.15.6:0/1153878597 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009420 con 0x7fae6c0cbb70 2023-11-28T21:08:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae70b29640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0c9150 0x7fae6c14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7ffb8ebd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb880aeae0 0x7ffb880aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfa40047d0 msgr2=0x7fcfa4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfc03f8640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfa40047d0 0x7fcfa4004c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcfb806b250 tx=0x7fcfb401cbf0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7ffb8c96d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb780047d0 0x7ffb880adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae6bfff640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c0cbb70 0x7fae6c0c6ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00c430 tx=0x7fae5c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7ffb8c96d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb780047d0 0x7ffb880adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:40880/0 (socket says 172.21.15.6:40880) 2023-11-28T21:08:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7ffb8c96d640 1 -- 172.21.15.6:0/1154634538 learned_addr learned my addr 172.21.15.6:0/1154634538 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1820763750 shutdown_connections 2023-11-28T21:08:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfc03f8640 1 --2- 172.21.15.6:0/1820763750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfa40047d0 0x7fcfa4004c50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1820763750 >> 172.21.15.6:0/1820763750 conn(0x7fcfb806a580 msgr2=0x7fcfb806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae697fa640 1 -- 172.21.15.6:0/1153878597 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c005cf0 con 0x7fae6c0cbb70 2023-11-28T21:08:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae697fa640 1 -- 172.21.15.6:0/1153878597 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c005e50 con 0x7fae6c0cbb70 2023-11-28T21:08:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fae697fa640 1 -- 172.21.15.6:0/1153878597 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0072d0 con 0x7fae6c0cbb70 2023-11-28T21:08:18.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1820763750 shutdown_connections 2023-11-28T21:08:18.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1820763750 wait complete. 2023-11-28T21:08:18.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7ffb8ebd1640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb8815a800 0x7ffb8815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.471+0000 7ffb87fff640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb880aeae0 0x7ffb880aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c0c7600 con 0x7fae6c0cbb70 2023-11-28T21:08:18.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c0c7bc0 con 0x7fae6c0cbb70 2023-11-28T21:08:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f187c85f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1878143870 0x7f187806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f187c85f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f187815e130 0x7f18780b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f187c85f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187806d3b0 con 0x7f187806cf50 2023-11-28T21:08:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f187c85f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187815e7c0 con 0x7f187815e130 2023-11-28T21:08:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f187c85f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1878143c50 con 0x7f1878143870 2023-11-28T21:08:18.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb8d16e640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb8815a800 0x7ffb8815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880af4a0 con 0x7ffb880aeae0 2023-11-28T21:08:18.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f1876d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f187815e130 0x7f18780b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb881517e0 con 0x7ffb780047d0 2023-11-28T21:08:18.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88151a80 con 0x7ffb8815a800 2023-11-28T21:08:18.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f1876d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f187815e130 0x7f18780b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49196/0 (socket says 172.21.15.6:49196) 2023-11-28T21:08:18.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f1876d9d640 1 -- 172.21.15.6:0/747416874 learned_addr learned my addr 172.21.15.6:0/747416874 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f187659c640 1 --2- 172.21.15.6:0/747416874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1878143870 0x7f187806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f1875d9b640 1 -- 172.21.15.6:0/747416874 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649369600 0 0) 0x7f187806d3b0 con 0x7f187806cf50 2023-11-28T21:08:18.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f1875d9b640 1 -- 172.21.15.6:0/747416874 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1864003530 con 0x7f187806cf50 2023-11-28T21:08:18.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f1876d9d640 1 -- 172.21.15.6:0/747416874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1878143870 msgr2=0x7f187806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f1876d9d640 1 --2- 172.21.15.6:0/747416874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1878143870 0x7f187806ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f1876d9d640 1 -- 172.21.15.6:0/747416874 >> v1:172.21.15.31:6789/0 conn(0x7f187806cf50 legacy=0x7f187815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7f1876d9d640 1 -- 172.21.15.6:0/747416874 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187815e540 con 0x7f187815e130 2023-11-28T21:08:18.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb87fff640 1 -- 172.21.15.6:0/1154634538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb8815a800 msgr2=0x7ffb8815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb87fff640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb8815a800 0x7ffb8815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb87fff640 1 -- 172.21.15.6:0/1154634538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb780047d0 msgr2=0x7ffb880adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb87fff640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb780047d0 0x7ffb880adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb87fff640 1 -- 172.21.15.6:0/1154634538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb88151d60 con 0x7ffb880aeae0 2023-11-28T21:08:18.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb8d16e640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb8815a800 0x7ffb8815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:18.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c1fa860 con 0x7fae6c0cbb70 2023-11-28T21:08:18.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7ffb87fff640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb880aeae0 0x7ffb880aef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009000 tx=0x7ffb78005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfc03f8640 1 Processor -- start 2023-11-28T21:08:18.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7fe0c47d1640 1 Processor -- start 2023-11-28T21:08:18.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7fe0c47d1640 1 -- start start 2023-11-28T21:08:18.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7ffb857fa640 1 -- 172.21.15.6:0/1154634538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740b7070 con 0x7ffb880aeae0 2023-11-28T21:08:18.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfc03f8640 1 -- start start 2023-11-28T21:08:18.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7ffb857fa640 1 -- 172.21.15.6:0/1154634538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74001440 con 0x7ffb880aeae0 2023-11-28T21:08:18.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7ffb857fa640 1 -- 172.21.15.6:0/1154634538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74007090 con 0x7ffb880aeae0 2023-11-28T21:08:18.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb88152040 con 0x7ffb880aeae0 2023-11-28T21:08:18.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb880ae1b0 con 0x7ffb880aeae0 2023-11-28T21:08:18.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.475+0000 7fae697fa640 1 -- 172.21.15.6:0/1153878597 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fae5c007430 con 0x7fae6c0cbb70 2023-11-28T21:08:18.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fae697fa640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fae58066570 0x7fae58068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fae697fa640 1 -- 172.21.15.6:0/1153878597 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae5c083280 con 0x7fae6c0cbb70 2023-11-28T21:08:18.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fae70b29640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fae58066570 0x7fae58068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c47d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0bc06e480 0x7fe0bc0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c47d1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe0bc0ce370 0x7fe0bc15d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fae70b29640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fae58066570 0x7fae58068a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0c8bd0 tx=0x7fae600a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfc03f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa40047d0 0x7fcfb80aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfc03f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb813f7c0 0x7fcfb80ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfc03f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb80cdd80 0x7fcfb80ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfc03f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80ce740 con 0x7fcfa40047d0 2023-11-28T21:08:18.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c47d1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0bc0b4280 con 0x7fe0bc1590a0 2023-11-28T21:08:18.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c47d1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc0717e0 con 0x7fe0bc06e480 2023-11-28T21:08:18.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c47d1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc0b3ab0 con 0x7fe0bc0ce370 2023-11-28T21:08:18.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7f1876d9d640 1 --2- 172.21.15.6:0/747416874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f187815e130 0x7f18780b3090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1870009e50 tx=0x7f187001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459d844dba3d34e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfc03f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb812f6f0 con 0x7fcfb813f7c0 2023-11-28T21:08:18.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfc03f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80cac90 con 0x7fcfb80cdd80 2023-11-28T21:08:18.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c1d6c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe0bc0ce370 0x7fe0bc15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c1d6c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe0bc0ce370 0x7fe0bc15d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:40892/0 (socket says 172.21.15.6:40892) 2023-11-28T21:08:18.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c1d6c640 1 -- 172.21.15.6:0/693052223 learned_addr learned my addr 172.21.15.6:0/693052223 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c256d640 1 --2- 172.21.15.6:0/693052223 >> v2:172.21.15.6:3300/0 conn(0x7fe0bc06e480 0x7fe0bc0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c1d6c640 1 -- 172.21.15.6:0/693052223 >> v2:172.21.15.6:3300/0 conn(0x7fe0bc06e480 msgr2=0x7fe0bc0b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c1d6c640 1 --2- 172.21.15.6:0/693052223 >> v2:172.21.15.6:3300/0 conn(0x7fe0bc06e480 0x7fe0bc0b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c1d6c640 1 -- 172.21.15.6:0/693052223 >> v1:172.21.15.6:6789/0 conn(0x7fe0bc1590a0 legacy=0x7fe0bc06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:18.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fe0c1d6c640 1 -- 172.21.15.6:0/693052223 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc15dcd0 con 0x7fe0bc0ce370 2023-11-28T21:08:18.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfbd993640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb813f7c0 0x7fcfb80ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfbd993640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb813f7c0 0x7fcfb80ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:40900/0 (socket says 172.21.15.6:40900) 2023-11-28T21:08:18.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfbd993640 1 -- 172.21.15.6:0/1391845116 learned_addr learned my addr 172.21.15.6:0/1391845116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7fcfbe995640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb80cdd80 0x7fcfb80ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfbd993640 1 -- 172.21.15.6:0/1391845116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb80cdd80 msgr2=0x7fcfb80ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfbd993640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb80cdd80 0x7fcfb80ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfbd993640 1 -- 172.21.15.6:0/1391845116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa40047d0 msgr2=0x7fcfb80aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfbd993640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa40047d0 0x7fcfb80aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfbd993640 1 -- 172.21.15.6:0/1391845116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80ab3e0 con 0x7fcfb813f7c0 2023-11-28T21:08:18.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfbe995640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb80cdd80 0x7fcfb80ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:18.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfbd993640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb813f7c0 0x7fcfb80ca750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4000c10 tx=0x7fcfa4005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.479+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb68005260 con 0x7ffb880aeae0 2023-11-28T21:08:18.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7ffb857fa640 1 -- 172.21.15.6:0/1154634538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffb740071f0 con 0x7ffb880aeae0 2023-11-28T21:08:18.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f1875d9b640 1 -- 172.21.15.6:0/747416874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700a5810 con 0x7f187815e130 2023-11-28T21:08:18.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f1875d9b640 1 -- 172.21.15.6:0/747416874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18700a5970 con 0x7f187815e130 2023-11-28T21:08:18.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f1875d9b640 1 -- 172.21.15.6:0/747416874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700a5d00 con 0x7f187815e130 2023-11-28T21:08:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfaeffd640 1 -- 172.21.15.6:0/1391845116 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40b4070 con 0x7fcfb813f7c0 2023-11-28T21:08:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfaeffd640 1 -- 172.21.15.6:0/1391845116 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb40a58d0 con 0x7fcfb813f7c0 2023-11-28T21:08:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfaeffd640 1 -- 172.21.15.6:0/1391845116 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40b4070 con 0x7fcfb813f7c0 2023-11-28T21:08:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb80ab6c0 con 0x7fcfb813f7c0 2023-11-28T21:08:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb80abc80 con 0x7fcfb813f7c0 2023-11-28T21:08:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f187c85f640 1 -- 172.21.15.6:0/747416874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f187815e130 msgr2=0x7f18780b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f187c85f640 1 --2- 172.21.15.6:0/747416874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f187815e130 0x7f18780b3090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1870009e50 tx=0x7f187001c950 comp rx=0 tx=0).stop 2023-11-28T21:08:18.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f6a09f03640 1 Processor -- start 2023-11-28T21:08:18.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f6a09f03640 1 -- start start 2023-11-28T21:08:18.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f187c85f640 1 -- 172.21.15.6:0/747416874 shutdown_connections 2023-11-28T21:08:18.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f187c85f640 1 --2- 172.21.15.6:0/747416874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f187815e130 0x7f18780b3090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.483+0000 7f187c85f640 1 --2- 172.21.15.6:0/747416874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1878143870 0x7f187806ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f187c85f640 1 -- 172.21.15.6:0/747416874 >> 172.21.15.6:0/747416874 conn(0x7f187806a580 msgr2=0x7f187806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7fae697fa640 1 -- 172.21.15.6:0/1153878597 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae6c1fa860 con 0x7fae6c0cbb70 2023-11-28T21:08:18.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f187c85f640 1 -- 172.21.15.6:0/747416874 shutdown_connections 2023-11-28T21:08:18.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f187c85f640 1 -- 172.21.15.6:0/747416874 wait complete. 2023-11-28T21:08:18.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a09f03640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 0x7f69fc03e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a09f03640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc03bef0 con 0x7f69fc0e6c10 2023-11-28T21:08:18.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a09f03640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc057580 con 0x7f69fc007200 2023-11-28T21:08:18.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a09f03640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc056f50 con 0x7f69fc0e2fe0 2023-11-28T21:08:18.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a03fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f69fc0e6c10 0x7f69fc0e7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40262/0 (socket says 172.21.15.6:40262) 2023-11-28T21:08:18.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a03fff640 1 -- 172.21.15.6:0/1060450783 learned_addr learned my addr 172.21.15.6:0/1060450783 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7fcfaeffd640 1 -- 172.21.15.6:0/1391845116 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfb40a5a40 con 0x7fcfb813f7c0 2023-11-28T21:08:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb8072b90 con 0x7fcfb813f7c0 2023-11-28T21:08:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7ffb857fa640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffb6c0664c0 0x7ffb6c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7ffb857fa640 1 -- 172.21.15.6:0/1154634538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb74120fe0 con 0x7ffb880aeae0 2023-11-28T21:08:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7ffb8c96d640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffb6c0664c0 0x7ffb6c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a08f01640 1 --2- 172.21.15.6:0/1060450783 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 0x7f69fc03e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7ffb8c96d640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffb6c0664c0 0x7ffb6c068980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c007fd0 tx=0x7ffb7c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7fe0c1d6c640 1 --2- 172.21.15.6:0/693052223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc0ce370 0x7fe0bc15d790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0ce9e0 tx=0x7fe0b8020a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad4acd71dec377e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a08f01640 1 -- 172.21.15.6:0/1060450783 >> v1:172.21.15.31:6789/0 conn(0x7f69fc007200 legacy=0x7f69fc057a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a08f01640 1 -- 172.21.15.6:0/1060450783 >> v1:172.21.15.6:6789/0 conn(0x7f69fc0e6c10 legacy=0x7f69fc0e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f6a08f01640 1 -- 172.21.15.6:0/1060450783 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc007750 con 0x7f69fc0e2fe0 2023-11-28T21:08:18.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7f187c85f640 1 Processor -- start 2023-11-28T21:08:18.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7fcfaeffd640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf9c066500 0x7fcf9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7fcfaeffd640 1 -- 172.21.15.6:0/1391845116 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfb411d440 con 0x7fcfb813f7c0 2023-11-28T21:08:18.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.487+0000 7fcfbe194640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf9c066500 0x7fcf9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187c85f640 1 -- start start 2023-11-28T21:08:18.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7fcfbe194640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf9c066500 0x7fcf9c0689c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000c10 tx=0x7fcfa8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187c85f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f187806cf50 0x7f187815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187c85f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1878143870 0x7f18780cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7ffb857fa640 1 -- 172.21.15.6:0/1154634538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb740ee5a0 con 0x7ffb880aeae0 2023-11-28T21:08:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187659c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f187806cf50 0x7f187815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187659c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f187806cf50 0x7f187815abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:39374/0 (socket says 172.21.15.6:39374) 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187c85f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f187815e130 0x7f18780ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187c85f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1878140090 con 0x7f1878143870 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187c85f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187813b390 con 0x7f187815e130 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187c85f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f187813f510 con 0x7f187806cf50 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f186ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1878143870 0x7f18780cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f186ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1878143870 0x7f18780cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49216/0 (socket says 172.21.15.6:49216) 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f186ffff640 1 -- 172.21.15.6:0/150120640 learned_addr learned my addr 172.21.15.6:0/150120640 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f1876d9d640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f187815e130 0x7f18780ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f186ffff640 1 -- 172.21.15.6:0/150120640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f187806cf50 msgr2=0x7f187815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f186ffff640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f187806cf50 0x7f187815abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f186ffff640 1 -- 172.21.15.6:0/150120640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f187815e130 msgr2=0x7f18780ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f186ffff640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f187815e130 0x7f18780ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f186ffff640 1 -- 172.21.15.6:0/150120640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870009b30 con 0x7f1878143870 2023-11-28T21:08:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f187659c640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f187806cf50 0x7f187815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.491+0000 7f6a08f01640 1 --2- 172.21.15.6:0/1060450783 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 0x7f69fc03e7e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6a040643d0 tx=0x7f6a04099290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1ded97bd3b8ca05 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f186ffff640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1878143870 0x7f18780cdce0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f186000c430 tx=0x7f186000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7fcfaeffd640 1 -- 172.21.15.6:0/1391845116 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfb40ea820 con 0x7fcfb813f7c0 2023-11-28T21:08:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f6a037fe640 1 -- 172.21.15.6:0/1060450783 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0412a440 con 0x7f69fc0e2fe0 2023-11-28T21:08:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f6a037fe640 1 -- 172.21.15.6:0/1060450783 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0412a5a0 con 0x7f69fc0e2fe0 2023-11-28T21:08:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f6a037fe640 1 -- 172.21.15.6:0/1060450783 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0412a990 con 0x7f69fc0e2fe0 2023-11-28T21:08:18.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f186effd640 1 -- 172.21.15.6:0/150120640 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18600052d0 con 0x7f1878143870 2023-11-28T21:08:18.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187813f7f0 con 0x7f1878143870 2023-11-28T21:08:18.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187813fdb0 con 0x7f1878143870 2023-11-28T21:08:18.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f6a09f03640 1 -- 172.21.15.6:0/1060450783 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 msgr2=0x7f69fc03e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f6a09f03640 1 --2- 172.21.15.6:0/1060450783 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 0x7f69fc03e7e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6a040643d0 tx=0x7f6a04099290 comp rx=0 tx=0).stop 2023-11-28T21:08:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f186effd640 1 -- 172.21.15.6:0/150120640 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860005430 con 0x7f1878143870 2023-11-28T21:08:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1878072b90 con 0x7f1878143870 2023-11-28T21:08:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f186effd640 1 -- 172.21.15.6:0/150120640 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860003800 con 0x7f1878143870 2023-11-28T21:08:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f6a09f03640 1 -- 172.21.15.6:0/1060450783 shutdown_connections 2023-11-28T21:08:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f6a09f03640 1 --2- 172.21.15.6:0/1060450783 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 0x7f69fc03e7e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.495+0000 7f6a09f03640 1 -- 172.21.15.6:0/1060450783 >> 172.21.15.6:0/1060450783 conn(0x7f69fc03aa20 msgr2=0x7f69fc03ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.499+0000 7f6a09f03640 1 -- 172.21.15.6:0/1060450783 shutdown_connections 2023-11-28T21:08:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.499+0000 7f6a09f03640 1 -- 172.21.15.6:0/1060450783 wait complete. 2023-11-28T21:08:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.499+0000 7fe0c156b640 1 -- 172.21.15.6:0/693052223 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80a9b10 con 0x7fe0bc0ce370 2023-11-28T21:08:18.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.499+0000 7fe0c156b640 1 -- 172.21.15.6:0/693052223 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b80a9c70 con 0x7fe0bc0ce370 2023-11-28T21:08:18.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.499+0000 7fe0c156b640 1 -- 172.21.15.6:0/693052223 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80b1440 con 0x7fe0bc0ce370 2023-11-28T21:08:18.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.499+0000 7f6a09f03640 1 Processor -- start 2023-11-28T21:08:18.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.499+0000 7f186effd640 1 -- 172.21.15.6:0/150120640 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1860003960 con 0x7f1878143870 2023-11-28T21:08:18.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f186effd640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1858066470 0x7f1858068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f186effd640 1 -- 172.21.15.6:0/150120640 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1860083f90 con 0x7f1878143870 2023-11-28T21:08:18.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f6a09f03640 1 -- start start 2023-11-28T21:08:18.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7fe0c47d1640 1 -- 172.21.15.6:0/693052223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc0ce370 msgr2=0x7fe0bc15d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7fe0c47d1640 1 --2- 172.21.15.6:0/693052223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc0ce370 0x7fe0bc15d790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0ce9e0 tx=0x7fe0b8020a40 comp rx=0 tx=0).stop 2023-11-28T21:08:18.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f187659c640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1858066470 0x7f1858068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7fe0c47d1640 1 -- 172.21.15.6:0/693052223 shutdown_connections 2023-11-28T21:08:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7fe0c47d1640 1 --2- 172.21.15.6:0/693052223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc0ce370 0x7fe0bc15d790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7fe0c47d1640 1 --2- 172.21.15.6:0/693052223 >> v2:172.21.15.6:3300/0 conn(0x7fe0bc06e480 0x7fe0bc0b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7fe0c47d1640 1 -- 172.21.15.6:0/693052223 >> 172.21.15.6:0/693052223 conn(0x7fe0bc06a980 msgr2=0x7fe0bc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7fe0c47d1640 1 -- 172.21.15.6:0/693052223 shutdown_connections 2023-11-28T21:08:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7fe0c47d1640 1 -- 172.21.15.6:0/693052223 wait complete. 2023-11-28T21:08:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f6a09f03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69fc007200 0x7f69fc0d7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f6a09f03640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 0x7f69fc0d6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f6a09f03640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc0e6c10 0x7f69fc17c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f6a09f03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc052470 con 0x7f69fc007200 2023-11-28T21:08:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f6a09f03640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc050130 con 0x7f69fc0e6c10 2023-11-28T21:08:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.503+0000 7f6a09f03640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc052680 con 0x7f69fc0e2fe0 2023-11-28T21:08:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09702640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc0e6c10 0x7f69fc17c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09702640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc0e6c10 0x7f69fc17c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:40916/0 (socket says 172.21.15.6:40916) 2023-11-28T21:08:18.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09702640 1 -- 172.21.15.6:0/106256676 learned_addr learned my addr 172.21.15.6:0/106256676 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a03fff640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 0x7f69fc0d6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f187659c640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1858066470 0x7f1858068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1868009bb0 tx=0x7f1868008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09702640 1 -- 172.21.15.6:0/106256676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 msgr2=0x7f69fc0d6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09702640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 0x7f69fc0d6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09702640 1 -- 172.21.15.6:0/106256676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69fc007200 msgr2=0x7f69fc0d7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09702640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69fc007200 0x7f69fc0d7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09702640 1 -- 172.21.15.6:0/106256676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0404f7e0 con 0x7f69fc0e6c10 2023-11-28T21:08:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09702640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc0e6c10 0x7f69fc17c550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c390 tx=0x7f69f000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7fe0c47d1640 1 Processor -- start 2023-11-28T21:08:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a017fa640 1 -- 172.21.15.6:0/106256676 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00052d0 con 0x7f69fc0e6c10 2023-11-28T21:08:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a017fa640 1 -- 172.21.15.6:0/106256676 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f0005430 con 0x7f69fc0e6c10 2023-11-28T21:08:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7fe0c47d1640 1 -- start start 2023-11-28T21:08:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a017fa640 1 -- 172.21.15.6:0/106256676 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f00052d0 con 0x7f69fc0e6c10 2023-11-28T21:08:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc052960 con 0x7f69fc0e6c10 2023-11-28T21:08:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.507+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc052f20 con 0x7f69fc0e6c10 2023-11-28T21:08:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c47d1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0bc06e480 0x7fe0bc147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c47d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0bc0ce370 0x7fe0bc157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c47d1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc1590a0 0x7fe0bc1504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c47d1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc15b4b0 con 0x7fe0bc0ce370 2023-11-28T21:08:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c47d1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc15a870 con 0x7fe0bc1590a0 2023-11-28T21:08:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c47d1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc15ab10 con 0x7fe0bc06e480 2023-11-28T21:08:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c1d6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0bc0ce370 0x7fe0bc157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c2d6e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc1590a0 0x7fe0bc1504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c2d6e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc1590a0 0x7fe0bc1504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:40926/0 (socket says 172.21.15.6:40926) 2023-11-28T21:08:18.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c2d6e640 1 -- 172.21.15.6:0/1656421410 learned_addr learned my addr 172.21.15.6:0/1656421410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:18.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7f186effd640 1 -- 172.21.15.6:0/150120640 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f18600514a0 con 0x7f1878143870 2023-11-28T21:08:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c1d6c640 1 -- 172.21.15.6:0/1656421410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0bc06e480 msgr2=0x7fe0bc147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c1d6c640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0bc06e480 0x7fe0bc147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c1d6c640 1 -- 172.21.15.6:0/1656421410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc1590a0 msgr2=0x7fe0bc1504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c1d6c640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc1590a0 0x7fe0bc1504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c1d6c640 1 -- 172.21.15.6:0/1656421410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8010810 con 0x7fe0bc0ce370 2023-11-28T21:08:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c2d6e640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc1590a0 0x7fe0bc1504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c1d6c640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0bc0ce370 0x7fe0bc157950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80b0000 tx=0x7fe0b801d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0b2ffd640 1 -- 172.21.15.6:0/1656421410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80c2070 con 0x7fe0bc0ce370 2023-11-28T21:08:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0b2ffd640 1 -- 172.21.15.6:0/1656421410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b80b1c80 con 0x7fe0bc0ce370 2023-11-28T21:08:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0b2ffd640 1 -- 172.21.15.6:0/1656421410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80bd450 con 0x7fe0bc0ce370 2023-11-28T21:08:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0bc15adf0 con 0x7fe0bc0ce370 2023-11-28T21:08:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc0052a0 con 0x7f69fc0e6c10 2023-11-28T21:08:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7f6a017fa640 1 -- 172.21.15.6:0/106256676 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69f0003600 con 0x7f69fc0e6c10 2023-11-28T21:08:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7f6a017fa640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f69e80664d0 0x7f69e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.511+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0bc148400 con 0x7fe0bc0ce370 2023-11-28T21:08:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.515+0000 7f6a017fa640 1 -- 172.21.15.6:0/106256676 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69f0054610 con 0x7f69fc0e6c10 2023-11-28T21:08:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.515+0000 7f6a08f01640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f69e80664d0 0x7f69e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.515+0000 7f6a08f01640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f69e80664d0 0x7f69e8068990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69fc008660 tx=0x7f6a0412c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.519+0000 7f6a017fa640 1 -- 172.21.15.6:0/106256676 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69f00509e0 con 0x7f69fc0e6c10 2023-11-28T21:08:18.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.519+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a4005260 con 0x7fe0bc0ce370 2023-11-28T21:08:18.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.523+0000 7fe0b2ffd640 1 -- 172.21.15.6:0/1656421410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0b80bd5b0 con 0x7fe0bc0ce370 2023-11-28T21:08:18.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.523+0000 7fe0b2ffd640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0a0066540 0x7fe0a0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:18.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.523+0000 7fe0b2ffd640 1 -- 172.21.15.6:0/1656421410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0b8122ca0 con 0x7fe0bc0ce370 2023-11-28T21:08:18.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.523+0000 7fe0c256d640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0a0066540 0x7fe0a0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:18.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.527+0000 7fe0c256d640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0a0066540 0x7fe0a0068a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40070b0 tx=0x7fe0b4007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.531+0000 7fe0b2ffd640 1 -- 172.21.15.6:0/1656421410 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0b80f02b0 con 0x7fe0bc0ce370 2023-11-28T21:08:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.723+0000 7fd26cff9640 1 -- 172.21.15.6:0/3903276411 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd2540057e0 con 0x7fd2780c1fe0 2023-11-28T21:08:18.732 INFO:teuthology.orchestra.run.smithi006.stdout:60129542150 2023-11-28T21:08:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.723+0000 7fd26effd640 1 -- 172.21.15.6:0/3903276411 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2740b2020 con 0x7fd2780c1fe0 2023-11-28T21:08:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 -- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd25c066470 msgr2=0x7fd25c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd25c066470 0x7fd25c068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd2680011f0 tx=0x7fd268009040 comp rx=0 tx=0).stop 2023-11-28T21:08:18.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 -- 172.21.15.6:0/3903276411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780c1fe0 msgr2=0x7fd27815f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780c1fe0 0x7fd27815f480 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd27401aab0 tx=0x7fd27401ac40 comp rx=0 tx=0).stop 2023-11-28T21:08:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 -- 172.21.15.6:0/3903276411 shutdown_connections 2023-11-28T21:08:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd25c066470 0x7fd25c068930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd27815f9c0 0x7fd2780b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2780c1fe0 0x7fd27815f480 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 --2- 172.21.15.6:0/3903276411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd27806c8b0 0x7fd278151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 -- 172.21.15.6:0/3903276411 >> 172.21.15.6:0/3903276411 conn(0x7fd2780b0650 msgr2=0x7fd2780c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 -- 172.21.15.6:0/3903276411 shutdown_connections 2023-11-28T21:08:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.727+0000 7fd26cff9640 1 -- 172.21.15.6:0/3903276411 wait complete. 2023-11-28T21:08:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.743+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f94e0157a60 con 0x7f94c80039d0 2023-11-28T21:08:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.743+0000 7f94dcff9640 1 -- 172.21.15.6:0/498094342 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94d80eea10 con 0x7f94c80039d0 2023-11-28T21:08:18.750 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2023-11-28T21:08:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.747+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f94cc0664c0 msgr2=0x7f94cc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.747+0000 7f94e6832640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f94cc0664c0 0x7f94cc068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f94d0006fd0 tx=0x7f94d0008040 comp rx=0 tx=0).stop 2023-11-28T21:08:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.747+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c80039d0 msgr2=0x7f94e0160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.747+0000 7f94e6832640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c80039d0 0x7f94e0160720 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f94d801d2c0 tx=0x7f94c8005800 comp rx=0 tx=0).stop 2023-11-28T21:08:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.747+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 shutdown_connections 2023-11-28T21:08:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.747+0000 7f94e6832640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f94cc0664c0 0x7f94cc068980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.747+0000 7f94e6832640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94e015fba0 0x7f94e0157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.747+0000 7f94e6832640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e00c52d0 0x7f94e015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.747+0000 7f94e6832640 1 --2- 172.21.15.6:0/498094342 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94c80039d0 0x7f94e0160720 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.751+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 >> 172.21.15.6:0/498094342 conn(0x7f94e00b0650 msgr2=0x7f94e015a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.751+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 shutdown_connections 2023-11-28T21:08:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.751+0000 7f94e6832640 1 -- 172.21.15.6:0/498094342 wait complete. 2023-11-28T21:08:18.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2023-11-28T21:08:18.769 DEBUG:teuthology.parallel:result is None 2023-11-28T21:08:18.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2023-11-28T21:08:18.787 DEBUG:teuthology.parallel:result is None 2023-11-28T21:08:18.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.807+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f69fc0502c0 con 0x7f69fc0e6c10 2023-11-28T21:08:18.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.807+0000 7f6a017fa640 1 -- 172.21.15.6:0/106256676 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69f0050b80 con 0x7f69fc0e6c10 2023-11-28T21:08:18.814 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2023-11-28T21:08:18.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f69e80664d0 msgr2=0x7f69e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f69e80664d0 0x7f69e8068990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69fc008660 tx=0x7f6a0412c040 comp rx=0 tx=0).stop 2023-11-28T21:08:18.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc0e6c10 msgr2=0x7f69fc17c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc0e6c10 0x7f69fc17c550 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c390 tx=0x7f69f000c850 comp rx=0 tx=0).stop 2023-11-28T21:08:18.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 shutdown_connections 2023-11-28T21:08:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f69e80664d0 0x7f69e8068990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69fc0e6c10 0x7f69fc17c550 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69fc0e2fe0 0x7f69fc0d6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 --2- 172.21.15.6:0/106256676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69fc007200 0x7f69fc0d7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 >> 172.21.15.6:0/106256676 conn(0x7f69fc03aa20 msgr2=0x7f69fc03c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 shutdown_connections 2023-11-28T21:08:18.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.811+0000 7f6a09f03640 1 -- 172.21.15.6:0/106256676 wait complete. 2023-11-28T21:08:18.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.819+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ffb680057e0 con 0x7ffb880aeae0 2023-11-28T21:08:18.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.819+0000 7ffb857fa640 1 -- 172.21.15.6:0/1154634538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb740f1bc0 con 0x7ffb880aeae0 2023-11-28T21:08:18.825 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-11-28T21:08:18.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffb6c0664c0 msgr2=0x7ffb6c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffb6c0664c0 0x7ffb6c068980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c007fd0 tx=0x7ffb7c007e80 comp rx=0 tx=0).stop 2023-11-28T21:08:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb880aeae0 msgr2=0x7ffb880aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb880aeae0 0x7ffb880aef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009000 tx=0x7ffb78005800 comp rx=0 tx=0).stop 2023-11-28T21:08:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 shutdown_connections 2023-11-28T21:08:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffb6c0664c0 0x7ffb6c068980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffb8815a800 0x7ffb8815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb880aeae0 0x7ffb880aef60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 --2- 172.21.15.6:0/1154634538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb780047d0 0x7ffb880adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 >> 172.21.15.6:0/1154634538 conn(0x7ffb8806a580 msgr2=0x7ffb88070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 shutdown_connections 2023-11-28T21:08:18.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.823+0000 7ffb8ebd1640 1 -- 172.21.15.6:0/1154634538 wait complete. 2023-11-28T21:08:18.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.827+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe0a4005510 con 0x7fe0bc0ce370 2023-11-28T21:08:18.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.827+0000 7fe0b2ffd640 1 -- 172.21.15.6:0/1656421410 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0b80f38d0 con 0x7fe0bc0ce370 2023-11-28T21:08:18.836 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-11-28T21:08:18.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.827+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0a0066540 msgr2=0x7fe0a0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.827+0000 7fe0c47d1640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0a0066540 0x7fe0a0068a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40070b0 tx=0x7fe0b4007040 comp rx=0 tx=0).stop 2023-11-28T21:08:18.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.827+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0bc0ce370 msgr2=0x7fe0bc157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.827+0000 7fe0c47d1640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0bc0ce370 0x7fe0bc157950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80b0000 tx=0x7fe0b801d7e0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.831+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 shutdown_connections 2023-11-28T21:08:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.831+0000 7fe0c47d1640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0a0066540 0x7fe0a0068a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.831+0000 7fe0c47d1640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0bc1590a0 0x7fe0bc1504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.831+0000 7fe0c47d1640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0bc0ce370 0x7fe0bc157950 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.831+0000 7fe0c47d1640 1 --2- 172.21.15.6:0/1656421410 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0bc06e480 0x7fe0bc147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.831+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 >> 172.21.15.6:0/1656421410 conn(0x7fe0bc06a980 msgr2=0x7fe0bc0b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.831+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 shutdown_connections 2023-11-28T21:08:18.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.831+0000 7fe0c47d1640 1 -- 172.21.15.6:0/1656421410 wait complete. 2023-11-28T21:08:18.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2023-11-28T21:08:18.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.831+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fae6c1fa860 con 0x7fae6c0cbb70 2023-11-28T21:08:18.839 DEBUG:teuthology.parallel:result is None 2023-11-28T21:08:18.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.835+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcfb812f830 con 0x7fcfb813f7c0 2023-11-28T21:08:18.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.835+0000 7fae697fa640 1 -- 172.21.15.6:0/1153878597 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae6c1fa860 con 0x7fae6c0cbb70 2023-11-28T21:08:18.840 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2023-11-28T21:08:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.835+0000 7fcfaeffd640 1 -- 172.21.15.6:0/1391845116 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfb40ede40 con 0x7fcfb813f7c0 2023-11-28T21:08:18.841 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-11-28T21:08:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.835+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fae58066570 msgr2=0x7fae58068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.835+0000 7fae72d8d640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fae58066570 0x7fae58068a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0c8bd0 tx=0x7fae600a6000 comp rx=0 tx=0).stop 2023-11-28T21:08:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.835+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c0cbb70 msgr2=0x7fae6c0c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.835+0000 7fae72d8d640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c0cbb70 0x7fae6c0c6ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00c430 tx=0x7fae5c00c8f0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 shutdown_connections 2023-11-28T21:08:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fae72d8d640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fae58066570 0x7fae58068a30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fae72d8d640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6c159d40 0x7fae6c1fab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fae72d8d640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6c0cbb70 0x7fae6c0c6ab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fae72d8d640 1 --2- 172.21.15.6:0/1153878597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae6c0c9150 0x7fae6c14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 >> 172.21.15.6:0/1153878597 conn(0x7fae6c0b0650 msgr2=0x7fae6c0c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf9c066500 msgr2=0x7fcf9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf9c066500 0x7fcf9c0689c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000c10 tx=0x7fcfa8009040 comp rx=0 tx=0).stop 2023-11-28T21:08:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb813f7c0 msgr2=0x7fcfb80ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb813f7c0 0x7fcfb80ca750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4000c10 tx=0x7fcfa4005800 comp rx=0 tx=0).stop 2023-11-28T21:08:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 shutdown_connections 2023-11-28T21:08:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fae72d8d640 1 -- 172.21.15.6:0/1153878597 wait complete. 2023-11-28T21:08:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 shutdown_connections 2023-11-28T21:08:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf9c066500 0x7fcf9c0689c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb80cdd80 0x7fcfb80ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb813f7c0 0x7fcfb80ca750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 --2- 172.21.15.6:0/1391845116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa40047d0 0x7fcfb80aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 >> 172.21.15.6:0/1391845116 conn(0x7fcfb806a580 msgr2=0x7fcfb815cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 shutdown_connections 2023-11-28T21:08:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.839+0000 7fcfc03f8640 1 -- 172.21.15.6:0/1391845116 wait complete. 2023-11-28T21:08:18.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f187804e930 con 0x7f1878143870 2023-11-28T21:08:18.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f186effd640 1 -- 172.21.15.6:0/150120640 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1860017020 con 0x7f1878143870 2023-11-28T21:08:18.848 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-11-28T21:08:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1858066470 msgr2=0x7f1858068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1858066470 0x7f1858068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1868009bb0 tx=0x7f1868008040 comp rx=0 tx=0).stop 2023-11-28T21:08:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1878143870 msgr2=0x7f18780cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1878143870 0x7f18780cdce0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f186000c430 tx=0x7f186000c8f0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 shutdown_connections 2023-11-28T21:08:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1858066470 0x7f1858068930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f187815e130 0x7f18780ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1878143870 0x7f18780cdce0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.843+0000 7f187c85f640 1 --2- 172.21.15.6:0/150120640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f187806cf50 0x7f187815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.847+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 >> 172.21.15.6:0/150120640 conn(0x7f187806a580 msgr2=0x7f18780ad320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.847+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 shutdown_connections 2023-11-28T21:08:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:18.847+0000 7f187c85f640 1 -- 172.21.15.6:0/150120640 wait complete. 2023-11-28T21:08:18.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2023-11-28T21:08:18.863 DEBUG:teuthology.parallel:result is None 2023-11-28T21:08:18.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2023-11-28T21:08:18.866 DEBUG:teuthology.parallel:result is None 2023-11-28T21:08:18.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2023-11-28T21:08:18.875 DEBUG:teuthology.parallel:result is None 2023-11-28T21:08:18.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2023-11-28T21:08:18.879 DEBUG:teuthology.parallel:result is None 2023-11-28T21:08:18.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2023-11-28T21:08:18.884 DEBUG:teuthology.parallel:result is None 2023-11-28T21:08:18.884 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T21:08:18.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:08:19.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8774c6b640 1 Processor -- start 2023-11-28T21:08:19.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8774c6b640 1 -- start start 2023-11-28T21:08:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8774c6b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f877006dd90 0x7f8770071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8774c6b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877015e340 con 0x7f8770142da0 2023-11-28T21:08:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8774c6b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87700b39b0 con 0x7f877015e7d0 2023-11-28T21:08:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8774c6b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877015dae0 con 0x7f877006dd90 2023-11-28T21:08:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8767fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f877006dd90 0x7f8770071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f876e59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8770142da0 0x7f877006d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40270/0 (socket says 172.21.15.6:40270) 2023-11-28T21:08:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f876e59c640 1 -- 172.21.15.6:0/3542465897 learned_addr learned my addr 172.21.15.6:0/3542465897 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8767fff640 1 -- 172.21.15.6:0/3542465897 >> v1:172.21.15.31:6789/0 conn(0x7f877015e7d0 legacy=0x7f87700b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8767fff640 1 -- 172.21.15.6:0/3542465897 >> v1:172.21.15.6:6789/0 conn(0x7f8770142da0 legacy=0x7f877006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.063+0000 7f8767fff640 1 -- 172.21.15.6:0/3542465897 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770143440 con 0x7f877006dd90 2023-11-28T21:08:19.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f8767fff640 1 --2- 172.21.15.6:0/3542465897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 0x7f8770071fb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f87580097c0 tx=0x7f875801e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8b5d0b9ae9dfae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:19.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f876dd9b640 1 -- 172.21.15.6:0/3542465897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87580aa650 con 0x7f877006dd90 2023-11-28T21:08:19.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f876dd9b640 1 -- 172.21.15.6:0/3542465897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87580aa7b0 con 0x7f877006dd90 2023-11-28T21:08:19.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f876dd9b640 1 -- 172.21.15.6:0/3542465897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87580aab40 con 0x7f877006dd90 2023-11-28T21:08:19.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f8774c6b640 1 -- 172.21.15.6:0/3542465897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 msgr2=0x7f8770071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f8774c6b640 1 --2- 172.21.15.6:0/3542465897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 0x7f8770071fb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f87580097c0 tx=0x7f875801e620 comp rx=0 tx=0).stop 2023-11-28T21:08:19.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f8774c6b640 1 -- 172.21.15.6:0/3542465897 shutdown_connections 2023-11-28T21:08:19.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f8774c6b640 1 --2- 172.21.15.6:0/3542465897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 0x7f8770071fb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f8774c6b640 1 -- 172.21.15.6:0/3542465897 >> 172.21.15.6:0/3542465897 conn(0x7f877006ab80 msgr2=0x7f87700b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:19.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f8774c6b640 1 -- 172.21.15.6:0/3542465897 shutdown_connections 2023-11-28T21:08:19.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.067+0000 7f8774c6b640 1 -- 172.21.15.6:0/3542465897 wait complete. 2023-11-28T21:08:19.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 Processor -- start 2023-11-28T21:08:19.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 -- start start 2023-11-28T21:08:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 0x7f877015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8770142da0 0x7f8770138ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877015e7d0 0x7f8770136420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877015a560 con 0x7f877006dd90 2023-11-28T21:08:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877013f790 con 0x7f877015e7d0 2023-11-28T21:08:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877013fa70 con 0x7f8770142da0 2023-11-28T21:08:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 0x7f877015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 0x7f877015cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49242/0 (socket says 172.21.15.6:49242) 2023-11-28T21:08:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876e59c640 1 -- 172.21.15.6:0/664375822 learned_addr learned my addr 172.21.15.6:0/664375822 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8767fff640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8770142da0 0x7f8770138ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876ed9d640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877015e7d0 0x7f8770136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876e59c640 1 -- 172.21.15.6:0/664375822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8770142da0 msgr2=0x7f8770138ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876e59c640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8770142da0 0x7f8770138ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876e59c640 1 -- 172.21.15.6:0/664375822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877015e7d0 msgr2=0x7f8770136420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876e59c640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877015e7d0 0x7f8770136420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876e59c640 1 -- 172.21.15.6:0/664375822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758009420 con 0x7f877006dd90 2023-11-28T21:08:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f876e59c640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 0x7f877015cb20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f876000c500 tx=0x7f876000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8766ffd640 1 -- 172.21.15.6:0/664375822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760005cf0 con 0x7f877006dd90 2023-11-28T21:08:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8766ffd640 1 -- 172.21.15.6:0/664375822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760005e50 con 0x7f877006dd90 2023-11-28T21:08:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8766ffd640 1 -- 172.21.15.6:0/664375822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87600072f0 con 0x7f877006dd90 2023-11-28T21:08:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877015a7b0 con 0x7f877006dd90 2023-11-28T21:08:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.071+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877015d060 con 0x7f877006dd90 2023-11-28T21:08:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.075+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877013fc30 con 0x7f877006dd90 2023-11-28T21:08:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.075+0000 7f8766ffd640 1 -- 172.21.15.6:0/664375822 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8760007450 con 0x7f877006dd90 2023-11-28T21:08:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.075+0000 7f8766ffd640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8750066470 0x7f8750068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.075+0000 7f8766ffd640 1 -- 172.21.15.6:0/664375822 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8760083470 con 0x7f877006dd90 2023-11-28T21:08:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.075+0000 7f8767fff640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8750066470 0x7f8750068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.075+0000 7f8767fff640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8750066470 0x7f8750068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f87580b1000 tx=0x7f8758008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:19.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.079+0000 7f8766ffd640 1 -- 172.21.15.6:0/664375822 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8760050900 con 0x7f877006dd90 2023-11-28T21:08:19.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.235+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87700674d0 con 0x7f8750066470 2023-11-28T21:08:19.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.243+0000 7f8766ffd640 1 -- 172.21.15.6:0/664375822 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264524 (secure 0 0 0) 0x7f87700674d0 con 0x7f8750066470 2023-11-28T21:08:19.251 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:19.253 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-28T21:08:19.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8750066470 msgr2=0x7f8750068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8750066470 0x7f8750068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f87580b1000 tx=0x7f8758008040 comp rx=0 tx=0).stop 2023-11-28T21:08:19.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 msgr2=0x7f877015cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 0x7f877015cb20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f876000c500 tx=0x7f876000c9c0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 shutdown_connections 2023-11-28T21:08:19.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8750066470 0x7f8750068930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f877015e7d0 0x7f8770136420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8770142da0 0x7f8770138ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 --2- 172.21.15.6:0/664375822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f877006dd90 0x7f877015cb20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 >> 172.21.15.6:0/664375822 conn(0x7f877006ab80 msgr2=0x7f87700aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 shutdown_connections 2023-11-28T21:08:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.247+0000 7f8774c6b640 1 -- 172.21.15.6:0/664375822 wait complete. 2023-11-28T21:08:19.271 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T21:08:18.659425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2924544,"data_stored":1763276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.469172"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428684+0000","last_change":"2023-11-28T21:08:10.226585+0000","last_active":"2023-11-28T21:08:11.428684+0000","last_peered":"2023-11-28T21:08:11.428684+0000","last_clean":"2023-11-28T21:08:11.428684+0000","last_became_active":"2023-11-28T21:08:10.223076+0000","last_became_peered":"2023-11-28T21:08:10.223076+0000","last_unstale":"2023-11-28T21:08:11.428684+0000","last_undegraded":"2023-11-28T21:08:11.428684+0000","last_fullsized":"2023-11-28T21:08:11.428684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:01.331246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193106+0000","last_change":"2023-11-28T21:08:10.219531+0000","last_active":"2023-11-28T21:08:11.193106+0000","last_peered":"2023-11-28T21:08:11.193106+0000","last_clean":"2023-11-28T21:08:11.193106+0000","last_became_active":"2023-11-28T21:08:10.219219+0000","last_became_peered":"2023-11-28T21:08:10.219219+0000","last_unstale":"2023-11-28T21:08:11.193106+0000","last_undegraded":"2023-11-28T21:08:11.193106+0000","last_fullsized":"2023-11-28T21:08:11.193106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426406+0000","last_change":"2023-11-28T21:08:10.214525+0000","last_active":"2023-11-28T21:08:11.426406+0000","last_peered":"2023-11-28T21:08:11.426406+0000","last_clean":"2023-11-28T21:08:11.426406+0000","last_became_active":"2023-11-28T21:08:10.207834+0000","last_became_peered":"2023-11-28T21:08:10.207834+0000","last_unstale":"2023-11-28T21:08:11.426406+0000","last_undegraded":"2023-11-28T21:08:11.426406+0000","last_fullsized":"2023-11-28T21:08:11.426406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:58.849892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427963+0000","last_change":"2023-11-28T21:08:10.218249+0000","last_active":"2023-11-28T21:08:11.427963+0000","last_peered":"2023-11-28T21:08:11.427963+0000","last_clean":"2023-11-28T21:08:11.427963+0000","last_became_active":"2023-11-28T21:08:10.217753+0000","last_became_peered":"2023-11-28T21:08:10.217753+0000","last_unstale":"2023-11-28T21:08:11.427963+0000","last_undegraded":"2023-11-28T21:08:11.427963+0000","last_fullsized":"2023-11-28T21:08:11.427963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:22.626652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428006+0000","last_change":"2023-11-28T21:08:10.226231+0000","last_active":"2023-11-28T21:08:11.428006+0000","last_peered":"2023-11-28T21:08:11.428006+0000","last_clean":"2023-11-28T21:08:11.428006+0000","last_became_active":"2023-11-28T21:08:10.222935+0000","last_became_peered":"2023-11-28T21:08:10.222935+0000","last_unstale":"2023-11-28T21:08:11.428006+0000","last_undegraded":"2023-11-28T21:08:11.428006+0000","last_fullsized":"2023-11-28T21:08:11.428006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:52.316215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428380+0000","last_change":"2023-11-28T21:08:10.221517+0000","last_active":"2023-11-28T21:08:11.428380+0000","last_peered":"2023-11-28T21:08:11.428380+0000","last_clean":"2023-11-28T21:08:11.428380+0000","last_became_active":"2023-11-28T21:08:10.221308+0000","last_became_peered":"2023-11-28T21:08:10.221308+0000","last_unstale":"2023-11-28T21:08:11.428380+0000","last_undegraded":"2023-11-28T21:08:11.428380+0000","last_fullsized":"2023-11-28T21:08:11.428380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:52.862412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427554+0000","last_change":"2023-11-28T21:08:10.224411+0000","last_active":"2023-11-28T21:08:11.427554+0000","last_peered":"2023-11-28T21:08:11.427554+0000","last_clean":"2023-11-28T21:08:11.427554+0000","last_became_active":"2023-11-28T21:08:10.222988+0000","last_became_peered":"2023-11-28T21:08:10.222988+0000","last_unstale":"2023-11-28T21:08:11.427554+0000","last_undegraded":"2023-11-28T21:08:11.427554+0000","last_fullsized":"2023-11-28T21:08:11.427554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:04.834063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426821+0000","last_change":"2023-11-28T21:08:10.219243+0000","last_active":"2023-11-28T21:08:11.426821+0000","last_peered":"2023-11-28T21:08:11.426821+0000","last_clean":"2023-11-28T21:08:11.426821+0000","last_became_active":"2023-11-28T21:08:10.218641+0000","last_became_peered":"2023-11-28T21:08:10.218641+0000","last_unstale":"2023-11-28T21:08:11.426821+0000","last_undegraded":"2023-11-28T21:08:11.426821+0000","last_fullsized":"2023-11-28T21:08:11.426821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:47:10.269501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428832+0000","last_change":"2023-11-28T21:08:10.226553+0000","last_active":"2023-11-28T21:08:11.428832+0000","last_peered":"2023-11-28T21:08:11.428832+0000","last_clean":"2023-11-28T21:08:11.428832+0000","last_became_active":"2023-11-28T21:08:10.224176+0000","last_became_peered":"2023-11-28T21:08:10.224176+0000","last_unstale":"2023-11-28T21:08:11.428832+0000","last_undegraded":"2023-11-28T21:08:11.428832+0000","last_fullsized":"2023-11-28T21:08:11.428832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:32:56.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198381+0000","last_change":"2023-11-28T21:08:10.221489+0000","last_active":"2023-11-28T21:08:11.198381+0000","last_peered":"2023-11-28T21:08:11.198381+0000","last_clean":"2023-11-28T21:08:11.198381+0000","last_became_active":"2023-11-28T21:08:10.221213+0000","last_became_peered":"2023-11-28T21:08:10.221213+0000","last_unstale":"2023-11-28T21:08:11.198381+0000","last_undegraded":"2023-11-28T21:08:11.198381+0000","last_fullsized":"2023-11-28T21:08:11.198381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:07.366435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198075+0000","last_change":"2023-11-28T21:08:10.220463+0000","last_active":"2023-11-28T21:08:11.198075+0000","last_peered":"2023-11-28T21:08:11.198075+0000","last_clean":"2023-11-28T21:08:11.198075+0000","last_became_active":"2023-11-28T21:08:10.220156+0000","last_became_peered":"2023-11-28T21:08:10.220156+0000","last_unstale":"2023-11-28T21:08:11.198075+0000","last_undegraded":"2023-11-28T21:08:11.198075+0000","last_fullsized":"2023-11-28T21:08:11.198075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:44.030281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197586+0000","last_change":"2023-11-28T21:08:10.199948+0000","last_active":"2023-11-28T21:08:11.197586+0000","last_peered":"2023-11-28T21:08:11.197586+0000","last_clean":"2023-11-28T21:08:11.197586+0000","last_became_active":"2023-11-28T21:08:10.199532+0000","last_became_peered":"2023-11-28T21:08:10.199532+0000","last_unstale":"2023-11-28T21:08:11.197586+0000","last_undegraded":"2023-11-28T21:08:11.197586+0000","last_fullsized":"2023-11-28T21:08:11.197586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:27.044594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427310+0000","last_change":"2023-11-28T21:08:10.214392+0000","last_active":"2023-11-28T21:08:11.427310+0000","last_peered":"2023-11-28T21:08:11.427310+0000","last_clean":"2023-11-28T21:08:11.427310+0000","last_became_active":"2023-11-28T21:08:10.214074+0000","last_became_peered":"2023-11-28T21:08:10.214074+0000","last_unstale":"2023-11-28T21:08:11.427310+0000","last_undegraded":"2023-11-28T21:08:11.427310+0000","last_fullsized":"2023-11-28T21:08:11.427310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:58.192436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426020+0000","last_change":"2023-11-28T21:08:10.215067+0000","last_active":"2023-11-28T21:08:11.426020+0000","last_peered":"2023-11-28T21:08:11.426020+0000","last_clean":"2023-11-28T21:08:11.426020+0000","last_became_active":"2023-11-28T21:08:10.209787+0000","last_became_peered":"2023-11-28T21:08:10.209787+0000","last_unstale":"2023-11-28T21:08:11.426020+0000","last_undegraded":"2023-11-28T21:08:11.426020+0000","last_fullsized":"2023-11-28T21:08:11.426020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:25.410328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192859+0000","last_change":"2023-11-28T21:08:10.204388+0000","last_active":"2023-11-28T21:08:11.192859+0000","last_peered":"2023-11-28T21:08:11.192859+0000","last_clean":"2023-11-28T21:08:11.192859+0000","last_became_active":"2023-11-28T21:08:10.204131+0000","last_became_peered":"2023-11-28T21:08:10.204131+0000","last_unstale":"2023-11-28T21:08:11.192859+0000","last_undegraded":"2023-11-28T21:08:11.192859+0000","last_fullsized":"2023-11-28T21:08:11.192859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:44.030281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427959+0000","last_change":"2023-11-28T21:08:10.221483+0000","last_active":"2023-11-28T21:08:11.427959+0000","last_peered":"2023-11-28T21:08:11.427959+0000","last_clean":"2023-11-28T21:08:11.427959+0000","last_became_active":"2023-11-28T21:08:10.220760+0000","last_became_peered":"2023-11-28T21:08:10.220760+0000","last_unstale":"2023-11-28T21:08:11.427959+0000","last_undegraded":"2023-11-28T21:08:11.427959+0000","last_fullsized":"2023-11-28T21:08:11.427959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428971+0000","last_change":"2023-11-28T21:08:10.225874+0000","last_active":"2023-11-28T21:08:11.428971+0000","last_peered":"2023-11-28T21:08:11.428971+0000","last_clean":"2023-11-28T21:08:11.428971+0000","last_became_active":"2023-11-28T21:08:10.225479+0000","last_became_peered":"2023-11-28T21:08:10.225479+0000","last_unstale":"2023-11-28T21:08:11.428971+0000","last_undegraded":"2023-11-28T21:08:11.428971+0000","last_fullsized":"2023-11-28T21:08:11.428971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:28.425251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425760+0000","last_change":"2023-11-28T21:08:10.211031+0000","last_active":"2023-11-28T21:08:11.425760+0000","last_peered":"2023-11-28T21:08:11.425760+0000","last_clean":"2023-11-28T21:08:11.425760+0000","last_became_active":"2023-11-28T21:08:10.210800+0000","last_became_peered":"2023-11-28T21:08:10.210800+0000","last_unstale":"2023-11-28T21:08:11.425760+0000","last_undegraded":"2023-11-28T21:08:11.425760+0000","last_fullsized":"2023-11-28T21:08:11.425760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:38.556751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429133+0000","last_change":"2023-11-28T21:08:10.227036+0000","last_active":"2023-11-28T21:08:11.429133+0000","last_peered":"2023-11-28T21:08:11.429133+0000","last_clean":"2023-11-28T21:08:11.429133+0000","last_became_active":"2023-11-28T21:08:10.225399+0000","last_became_peered":"2023-11-28T21:08:10.225399+0000","last_unstale":"2023-11-28T21:08:11.429133+0000","last_undegraded":"2023-11-28T21:08:11.429133+0000","last_fullsized":"2023-11-28T21:08:11.429133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:18.468892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198186+0000","last_change":"2023-11-28T21:08:10.203332+0000","last_active":"2023-11-28T21:08:11.198186+0000","last_peered":"2023-11-28T21:08:11.198186+0000","last_clean":"2023-11-28T21:08:11.198186+0000","last_became_active":"2023-11-28T21:08:10.202618+0000","last_became_peered":"2023-11-28T21:08:10.202618+0000","last_unstale":"2023-11-28T21:08:11.198186+0000","last_undegraded":"2023-11-28T21:08:11.198186+0000","last_fullsized":"2023-11-28T21:08:11.198186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:44.204323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426278+0000","last_change":"2023-11-28T21:08:10.213322+0000","last_active":"2023-11-28T21:08:11.426278+0000","last_peered":"2023-11-28T21:08:11.426278+0000","last_clean":"2023-11-28T21:08:11.426278+0000","last_became_active":"2023-11-28T21:08:10.212677+0000","last_became_peered":"2023-11-28T21:08:10.212677+0000","last_unstale":"2023-11-28T21:08:11.426278+0000","last_undegraded":"2023-11-28T21:08:11.426278+0000","last_fullsized":"2023-11-28T21:08:11.426278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:47:10.269501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428778+0000","last_change":"2023-11-28T21:08:10.232806+0000","last_active":"2023-11-28T21:08:11.428778+0000","last_peered":"2023-11-28T21:08:11.428778+0000","last_clean":"2023-11-28T21:08:11.428778+0000","last_became_active":"2023-11-28T21:08:10.232447+0000","last_became_peered":"2023-11-28T21:08:10.232447+0000","last_unstale":"2023-11-28T21:08:11.428778+0000","last_undegraded":"2023-11-28T21:08:11.428778+0000","last_fullsized":"2023-11-28T21:08:11.428778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:03.816068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426930+0000","last_change":"2023-11-28T21:08:10.213764+0000","last_active":"2023-11-28T21:08:11.426930+0000","last_peered":"2023-11-28T21:08:11.426930+0000","last_clean":"2023-11-28T21:08:11.426930+0000","last_became_active":"2023-11-28T21:08:10.213514+0000","last_became_peered":"2023-11-28T21:08:10.213514+0000","last_unstale":"2023-11-28T21:08:11.426930+0000","last_undegraded":"2023-11-28T21:08:11.426930+0000","last_fullsized":"2023-11-28T21:08:11.426930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:58.849892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428091+0000","last_change":"2023-11-28T21:08:10.216604+0000","last_active":"2023-11-28T21:08:11.428091+0000","last_peered":"2023-11-28T21:08:11.428091+0000","last_clean":"2023-11-28T21:08:11.428091+0000","last_became_active":"2023-11-28T21:08:10.216256+0000","last_became_peered":"2023-11-28T21:08:10.216256+0000","last_unstale":"2023-11-28T21:08:11.428091+0000","last_undegraded":"2023-11-28T21:08:11.428091+0000","last_fullsized":"2023-11-28T21:08:11.428091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:49:34.820109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427556+0000","last_change":"2023-11-28T21:08:10.225157+0000","last_active":"2023-11-28T21:08:11.427556+0000","last_peered":"2023-11-28T21:08:11.427556+0000","last_clean":"2023-11-28T21:08:11.427556+0000","last_became_active":"2023-11-28T21:08:10.224943+0000","last_became_peered":"2023-11-28T21:08:10.224943+0000","last_unstale":"2023-11-28T21:08:11.427556+0000","last_undegraded":"2023-11-28T21:08:11.427556+0000","last_fullsized":"2023-11-28T21:08:11.427556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:39.372238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198391+0000","last_change":"2023-11-28T21:08:10.213317+0000","last_active":"2023-11-28T21:08:11.198391+0000","last_peered":"2023-11-28T21:08:11.198391+0000","last_clean":"2023-11-28T21:08:11.198391+0000","last_became_active":"2023-11-28T21:08:10.212825+0000","last_became_peered":"2023-11-28T21:08:10.212825+0000","last_unstale":"2023-11-28T21:08:11.198391+0000","last_undegraded":"2023-11-28T21:08:11.198391+0000","last_fullsized":"2023-11-28T21:08:11.198391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193012+0000","last_change":"2023-11-28T21:08:10.211086+0000","last_active":"2023-11-28T21:08:11.193012+0000","last_peered":"2023-11-28T21:08:11.193012+0000","last_clean":"2023-11-28T21:08:11.193012+0000","last_became_active":"2023-11-28T21:08:10.210680+0000","last_became_peered":"2023-11-28T21:08:10.210680+0000","last_unstale":"2023-11-28T21:08:11.193012+0000","last_undegraded":"2023-11-28T21:08:11.193012+0000","last_fullsized":"2023-11-28T21:08:11.193012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:07.366435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427688+0000","last_change":"2023-11-28T21:08:10.222999+0000","last_active":"2023-11-28T21:08:11.427688+0000","last_peered":"2023-11-28T21:08:11.427688+0000","last_clean":"2023-11-28T21:08:11.427688+0000","last_became_active":"2023-11-28T21:08:10.222686+0000","last_became_peered":"2023-11-28T21:08:10.222686+0000","last_unstale":"2023-11-28T21:08:11.427688+0000","last_undegraded":"2023-11-28T21:08:11.427688+0000","last_fullsized":"2023-11-28T21:08:11.427688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:15.263435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426287+0000","last_change":"2023-11-28T21:08:10.208621+0000","last_active":"2023-11-28T21:08:11.426287+0000","last_peered":"2023-11-28T21:08:11.426287+0000","last_clean":"2023-11-28T21:08:11.426287+0000","last_became_active":"2023-11-28T21:08:10.206992+0000","last_became_peered":"2023-11-28T21:08:10.206992+0000","last_unstale":"2023-11-28T21:08:11.426287+0000","last_undegraded":"2023-11-28T21:08:11.426287+0000","last_fullsized":"2023-11-28T21:08:11.426287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:58.131504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428613+0000","last_change":"2023-11-28T21:08:10.217326+0000","last_active":"2023-11-28T21:08:11.428613+0000","last_peered":"2023-11-28T21:08:11.428613+0000","last_clean":"2023-11-28T21:08:11.428613+0000","last_became_active":"2023-11-28T21:08:10.216919+0000","last_became_peered":"2023-11-28T21:08:10.216919+0000","last_unstale":"2023-11-28T21:08:11.428613+0000","last_undegraded":"2023-11-28T21:08:11.428613+0000","last_fullsized":"2023-11-28T21:08:11.428613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:52.316215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425834+0000","last_change":"2023-11-28T21:08:10.227414+0000","last_active":"2023-11-28T21:08:11.425834+0000","last_peered":"2023-11-28T21:08:11.425834+0000","last_clean":"2023-11-28T21:08:11.425834+0000","last_became_active":"2023-11-28T21:08:10.227158+0000","last_became_peered":"2023-11-28T21:08:10.227158+0000","last_unstale":"2023-11-28T21:08:11.425834+0000","last_undegraded":"2023-11-28T21:08:11.425834+0000","last_fullsized":"2023-11-28T21:08:11.425834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:36:09.278216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.196935+0000","last_change":"2023-11-28T21:08:10.202982+0000","last_active":"2023-11-28T21:08:11.196935+0000","last_peered":"2023-11-28T21:08:11.196935+0000","last_clean":"2023-11-28T21:08:11.196935+0000","last_became_active":"2023-11-28T21:08:10.202638+0000","last_became_peered":"2023-11-28T21:08:10.202638+0000","last_unstale":"2023-11-28T21:08:11.196935+0000","last_undegraded":"2023-11-28T21:08:11.196935+0000","last_fullsized":"2023-11-28T21:08:11.196935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:20:14.317884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197295+0000","last_change":"2023-11-28T21:08:10.214194+0000","last_active":"2023-11-28T21:08:11.197295+0000","last_peered":"2023-11-28T21:08:11.197295+0000","last_clean":"2023-11-28T21:08:11.197295+0000","last_became_active":"2023-11-28T21:08:10.213046+0000","last_became_peered":"2023-11-28T21:08:10.213046+0000","last_unstale":"2023-11-28T21:08:11.197295+0000","last_undegraded":"2023-11-28T21:08:11.197295+0000","last_fullsized":"2023-11-28T21:08:11.197295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:23.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427403+0000","last_change":"2023-11-28T21:08:09.408970+0000","last_active":"2023-11-28T21:08:11.427403+0000","last_peered":"2023-11-28T21:08:11.427403+0000","last_clean":"2023-11-28T21:08:11.427403+0000","last_became_active":"2023-11-28T21:08:09.407594+0000","last_became_peered":"2023-11-28T21:08:09.407594+0000","last_unstale":"2023-11-28T21:08:11.427403+0000","last_undegraded":"2023-11-28T21:08:11.427403+0000","last_fullsized":"2023-11-28T21:08:11.427403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:52.171842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426417+0000","last_change":"2023-11-28T21:08:10.206555+0000","last_active":"2023-11-28T21:08:11.426417+0000","last_peered":"2023-11-28T21:08:11.426417+0000","last_clean":"2023-11-28T21:08:11.426417+0000","last_became_active":"2023-11-28T21:08:10.206199+0000","last_became_peered":"2023-11-28T21:08:10.206199+0000","last_unstale":"2023-11-28T21:08:11.426417+0000","last_undegraded":"2023-11-28T21:08:11.426417+0000","last_fullsized":"2023-11-28T21:08:11.426417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:43:54.997585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197850+0000","last_change":"2023-11-28T21:08:09.409806+0000","last_active":"2023-11-28T21:08:11.197850+0000","last_peered":"2023-11-28T21:08:11.197850+0000","last_clean":"2023-11-28T21:08:11.197850+0000","last_became_active":"2023-11-28T21:08:09.409409+0000","last_became_peered":"2023-11-28T21:08:09.409409+0000","last_unstale":"2023-11-28T21:08:11.197850+0000","last_undegraded":"2023-11-28T21:08:11.197850+0000","last_fullsized":"2023-11-28T21:08:11.197850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:00.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427006+0000","last_change":"2023-11-28T21:08:09.411063+0000","last_active":"2023-11-28T21:08:11.427006+0000","last_peered":"2023-11-28T21:08:11.427006+0000","last_clean":"2023-11-28T21:08:11.427006+0000","last_became_active":"2023-11-28T21:08:09.410772+0000","last_became_peered":"2023-11-28T21:08:09.410772+0000","last_unstale":"2023-11-28T21:08:11.427006+0000","last_undegraded":"2023-11-28T21:08:11.427006+0000","last_fullsized":"2023-11-28T21:08:11.427006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:24.407303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426871+0000","last_change":"2023-11-28T21:08:10.218510+0000","last_active":"2023-11-28T21:08:11.426871+0000","last_peered":"2023-11-28T21:08:11.426871+0000","last_clean":"2023-11-28T21:08:11.426871+0000","last_became_active":"2023-11-28T21:08:10.216099+0000","last_became_peered":"2023-11-28T21:08:10.216099+0000","last_unstale":"2023-11-28T21:08:11.426871+0000","last_undegraded":"2023-11-28T21:08:11.426871+0000","last_fullsized":"2023-11-28T21:08:11.426871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:58.131504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428208+0000","last_change":"2023-11-28T21:08:09.411506+0000","last_active":"2023-11-28T21:08:11.428208+0000","last_peered":"2023-11-28T21:08:11.428208+0000","last_clean":"2023-11-28T21:08:11.428208+0000","last_became_active":"2023-11-28T21:08:09.411121+0000","last_became_peered":"2023-11-28T21:08:09.411121+0000","last_unstale":"2023-11-28T21:08:11.428208+0000","last_undegraded":"2023-11-28T21:08:11.428208+0000","last_fullsized":"2023-11-28T21:08:11.428208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:20:13.314859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192789+0000","last_change":"2023-11-28T21:08:10.208767+0000","last_active":"2023-11-28T21:08:11.192789+0000","last_peered":"2023-11-28T21:08:11.192789+0000","last_clean":"2023-11-28T21:08:11.192789+0000","last_became_active":"2023-11-28T21:08:10.208461+0000","last_became_peered":"2023-11-28T21:08:10.208461+0000","last_unstale":"2023-11-28T21:08:11.192789+0000","last_undegraded":"2023-11-28T21:08:11.192789+0000","last_fullsized":"2023-11-28T21:08:11.192789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:04.311783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198365+0000","last_change":"2023-11-28T21:08:09.413726+0000","last_active":"2023-11-28T21:08:11.198365+0000","last_peered":"2023-11-28T21:08:11.198365+0000","last_clean":"2023-11-28T21:08:11.198365+0000","last_became_active":"2023-11-28T21:08:09.413416+0000","last_became_peered":"2023-11-28T21:08:09.413416+0000","last_unstale":"2023-11-28T21:08:11.198365+0000","last_undegraded":"2023-11-28T21:08:11.198365+0000","last_fullsized":"2023-11-28T21:08:11.198365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:41:22.294086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429381+0000","last_change":"2023-11-28T21:08:10.226078+0000","last_active":"2023-11-28T21:08:11.429381+0000","last_peered":"2023-11-28T21:08:11.429381+0000","last_clean":"2023-11-28T21:08:11.429381+0000","last_became_active":"2023-11-28T21:08:10.225785+0000","last_became_peered":"2023-11-28T21:08:10.225785+0000","last_unstale":"2023-11-28T21:08:11.429381+0000","last_undegraded":"2023-11-28T21:08:11.429381+0000","last_fullsized":"2023-11-28T21:08:11.429381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:44.649741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429363+0000","last_change":"2023-11-28T21:08:09.405377+0000","last_active":"2023-11-28T21:08:11.429363+0000","last_peered":"2023-11-28T21:08:11.429363+0000","last_clean":"2023-11-28T21:08:11.429363+0000","last_became_active":"2023-11-28T21:08:09.405079+0000","last_became_peered":"2023-11-28T21:08:09.405079+0000","last_unstale":"2023-11-28T21:08:11.429363+0000","last_undegraded":"2023-11-28T21:08:11.429363+0000","last_fullsized":"2023-11-28T21:08:11.429363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:03.308758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426696+0000","last_change":"2023-11-28T21:08:10.220356+0000","last_active":"2023-11-28T21:08:11.426696+0000","last_peered":"2023-11-28T21:08:11.426696+0000","last_clean":"2023-11-28T21:08:11.426696+0000","last_became_active":"2023-11-28T21:08:10.220024+0000","last_became_peered":"2023-11-28T21:08:10.220024+0000","last_unstale":"2023-11-28T21:08:11.426696+0000","last_undegraded":"2023-11-28T21:08:11.426696+0000","last_fullsized":"2023-11-28T21:08:11.426696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:22:29.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193017+0000","last_change":"2023-11-28T21:08:09.414108+0000","last_active":"2023-11-28T21:08:11.193017+0000","last_peered":"2023-11-28T21:08:11.193017+0000","last_clean":"2023-11-28T21:08:11.193017+0000","last_became_active":"2023-11-28T21:08:09.413780+0000","last_became_peered":"2023-11-28T21:08:09.413780+0000","last_unstale":"2023-11-28T21:08:11.193017+0000","last_undegraded":"2023-11-28T21:08:11.193017+0000","last_fullsized":"2023-11-28T21:08:11.193017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197987+0000","last_change":"2023-11-28T21:08:10.218932+0000","last_active":"2023-11-28T21:08:11.197987+0000","last_peered":"2023-11-28T21:08:11.197987+0000","last_clean":"2023-11-28T21:08:11.197987+0000","last_became_active":"2023-11-28T21:08:10.218621+0000","last_became_peered":"2023-11-28T21:08:10.218621+0000","last_unstale":"2023-11-28T21:08:11.197987+0000","last_undegraded":"2023-11-28T21:08:11.197987+0000","last_fullsized":"2023-11-28T21:08:11.197987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:38.556751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198214+0000","last_change":"2023-11-28T21:08:09.416708+0000","last_active":"2023-11-28T21:08:11.198214+0000","last_peered":"2023-11-28T21:08:11.198214+0000","last_clean":"2023-11-28T21:08:11.198214+0000","last_became_active":"2023-11-28T21:08:09.416209+0000","last_became_peered":"2023-11-28T21:08:09.416209+0000","last_unstale":"2023-11-28T21:08:11.198214+0000","last_undegraded":"2023-11-28T21:08:11.198214+0000","last_fullsized":"2023-11-28T21:08:11.198214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428761+0000","last_change":"2023-11-28T21:08:10.226709+0000","last_active":"2023-11-28T21:08:11.428761+0000","last_peered":"2023-11-28T21:08:11.428761+0000","last_clean":"2023-11-28T21:08:11.428761+0000","last_became_active":"2023-11-28T21:08:10.223145+0000","last_became_peered":"2023-11-28T21:08:10.223145+0000","last_unstale":"2023-11-28T21:08:11.428761+0000","last_undegraded":"2023-11-28T21:08:11.428761+0000","last_fullsized":"2023-11-28T21:08:11.428761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:28.425251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426379+0000","last_change":"2023-11-28T21:08:09.417259+0000","last_active":"2023-11-28T21:08:11.426379+0000","last_peered":"2023-11-28T21:08:11.426379+0000","last_clean":"2023-11-28T21:08:11.426379+0000","last_became_active":"2023-11-28T21:08:09.415186+0000","last_became_peered":"2023-11-28T21:08:09.415186+0000","last_unstale":"2023-11-28T21:08:11.426379+0000","last_undegraded":"2023-11-28T21:08:11.426379+0000","last_fullsized":"2023-11-28T21:08:11.426379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:51.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426183+0000","last_change":"2023-11-28T21:08:10.206745+0000","last_active":"2023-11-28T21:08:11.426183+0000","last_peered":"2023-11-28T21:08:11.426183+0000","last_clean":"2023-11-28T21:08:11.426183+0000","last_became_active":"2023-11-28T21:08:10.206444+0000","last_became_peered":"2023-11-28T21:08:10.206444+0000","last_unstale":"2023-11-28T21:08:11.426183+0000","last_undegraded":"2023-11-28T21:08:11.426183+0000","last_fullsized":"2023-11-28T21:08:11.426183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:49.158934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428881+0000","last_change":"2023-11-28T21:08:09.411244+0000","last_active":"2023-11-28T21:08:11.428881+0000","last_peered":"2023-11-28T21:08:11.428881+0000","last_clean":"2023-11-28T21:08:11.428881+0000","last_became_active":"2023-11-28T21:08:09.410896+0000","last_became_peered":"2023-11-28T21:08:09.410896+0000","last_unstale":"2023-11-28T21:08:11.428881+0000","last_undegraded":"2023-11-28T21:08:11.428881+0000","last_fullsized":"2023-11-28T21:08:11.428881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.027257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428127+0000","last_change":"2023-11-28T21:08:10.228561+0000","last_active":"2023-11-28T21:08:11.428127+0000","last_peered":"2023-11-28T21:08:11.428127+0000","last_clean":"2023-11-28T21:08:11.428127+0000","last_became_active":"2023-11-28T21:08:10.228150+0000","last_became_peered":"2023-11-28T21:08:10.228150+0000","last_unstale":"2023-11-28T21:08:11.428127+0000","last_undegraded":"2023-11-28T21:08:11.428127+0000","last_fullsized":"2023-11-28T21:08:11.428127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:22.992496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197207+0000","last_change":"2023-11-28T21:08:09.411127+0000","last_active":"2023-11-28T21:08:11.197207+0000","last_peered":"2023-11-28T21:08:11.197207+0000","last_clean":"2023-11-28T21:08:11.197207+0000","last_became_active":"2023-11-28T21:08:09.410838+0000","last_became_peered":"2023-11-28T21:08:09.410838+0000","last_unstale":"2023-11-28T21:08:11.197207+0000","last_undegraded":"2023-11-28T21:08:11.197207+0000","last_fullsized":"2023-11-28T21:08:11.197207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:36:08.275191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.196958+0000","last_change":"2023-11-28T21:08:10.204504+0000","last_active":"2023-11-28T21:08:11.196958+0000","last_peered":"2023-11-28T21:08:11.196958+0000","last_clean":"2023-11-28T21:08:11.196958+0000","last_became_active":"2023-11-28T21:08:10.204189+0000","last_became_peered":"2023-11-28T21:08:10.204189+0000","last_unstale":"2023-11-28T21:08:11.196958+0000","last_undegraded":"2023-11-28T21:08:11.196958+0000","last_fullsized":"2023-11-28T21:08:11.196958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:04.311783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425946+0000","last_change":"2023-11-28T21:08:09.400060+0000","last_active":"2023-11-28T21:08:11.425946+0000","last_peered":"2023-11-28T21:08:11.425946+0000","last_clean":"2023-11-28T21:08:11.425946+0000","last_became_active":"2023-11-28T21:08:09.399648+0000","last_became_peered":"2023-11-28T21:08:09.399648+0000","last_unstale":"2023-11-28T21:08:11.425946+0000","last_undegraded":"2023-11-28T21:08:11.425946+0000","last_fullsized":"2023-11-28T21:08:11.425946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:50.664387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427688+0000","last_change":"2023-11-28T21:08:10.228574+0000","last_active":"2023-11-28T21:08:11.427688+0000","last_peered":"2023-11-28T21:08:11.427688+0000","last_clean":"2023-11-28T21:08:11.427688+0000","last_became_active":"2023-11-28T21:08:10.228233+0000","last_became_peered":"2023-11-28T21:08:10.228233+0000","last_unstale":"2023-11-28T21:08:11.427688+0000","last_undegraded":"2023-11-28T21:08:11.427688+0000","last_fullsized":"2023-11-28T21:08:11.427688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:52.862412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197974+0000","last_change":"2023-11-28T21:08:09.412110+0000","last_active":"2023-11-28T21:08:11.197974+0000","last_peered":"2023-11-28T21:08:11.197974+0000","last_clean":"2023-11-28T21:08:11.197974+0000","last_became_active":"2023-11-28T21:08:09.411775+0000","last_became_peered":"2023-11-28T21:08:09.411775+0000","last_unstale":"2023-11-28T21:08:11.197974+0000","last_undegraded":"2023-11-28T21:08:11.197974+0000","last_fullsized":"2023-11-28T21:08:11.197974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:51.690241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428422+0000","last_change":"2023-11-28T21:08:10.226232+0000","last_active":"2023-11-28T21:08:11.428422+0000","last_peered":"2023-11-28T21:08:11.428422+0000","last_clean":"2023-11-28T21:08:11.428422+0000","last_became_active":"2023-11-28T21:08:10.225427+0000","last_became_peered":"2023-11-28T21:08:10.225427+0000","last_unstale":"2023-11-28T21:08:11.428422+0000","last_undegraded":"2023-11-28T21:08:11.428422+0000","last_fullsized":"2023-11-28T21:08:11.428422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:03.816068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425869+0000","last_change":"2023-11-28T21:08:09.414676+0000","last_active":"2023-11-28T21:08:11.425869+0000","last_peered":"2023-11-28T21:08:11.425869+0000","last_clean":"2023-11-28T21:08:11.425869+0000","last_became_active":"2023-11-28T21:08:09.414376+0000","last_became_peered":"2023-11-28T21:08:09.414376+0000","last_unstale":"2023-11-28T21:08:11.425869+0000","last_undegraded":"2023-11-28T21:08:11.425869+0000","last_fullsized":"2023-11-28T21:08:11.425869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:25.360796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428963+0000","last_change":"2023-11-28T21:08:10.228599+0000","last_active":"2023-11-28T21:08:11.428963+0000","last_peered":"2023-11-28T21:08:11.428963+0000","last_clean":"2023-11-28T21:08:11.428963+0000","last_became_active":"2023-11-28T21:08:10.228211+0000","last_became_peered":"2023-11-28T21:08:10.228211+0000","last_unstale":"2023-11-28T21:08:11.428963+0000","last_undegraded":"2023-11-28T21:08:11.428963+0000","last_fullsized":"2023-11-28T21:08:11.428963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:06:10.717892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193206+0000","last_change":"2023-11-28T21:08:09.412288+0000","last_active":"2023-11-28T21:08:11.193206+0000","last_peered":"2023-11-28T21:08:11.193206+0000","last_clean":"2023-11-28T21:08:11.193206+0000","last_became_active":"2023-11-28T21:08:09.411979+0000","last_became_peered":"2023-11-28T21:08:09.411979+0000","last_unstale":"2023-11-28T21:08:11.193206+0000","last_undegraded":"2023-11-28T21:08:11.193206+0000","last_fullsized":"2023-11-28T21:08:11.193206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429188+0000","last_change":"2023-11-28T21:08:10.217612+0000","last_active":"2023-11-28T21:08:11.429188+0000","last_peered":"2023-11-28T21:08:11.429188+0000","last_clean":"2023-11-28T21:08:11.429188+0000","last_became_active":"2023-11-28T21:08:10.217135+0000","last_became_peered":"2023-11-28T21:08:10.217135+0000","last_unstale":"2023-11-28T21:08:11.429188+0000","last_undegraded":"2023-11-28T21:08:11.429188+0000","last_fullsized":"2023-11-28T21:08:11.429188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:32:56.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425780+0000","last_change":"2023-11-28T21:08:09.412915+0000","last_active":"2023-11-28T21:08:11.425780+0000","last_peered":"2023-11-28T21:08:11.425780+0000","last_clean":"2023-11-28T21:08:11.425780+0000","last_became_active":"2023-11-28T21:08:09.412526+0000","last_became_peered":"2023-11-28T21:08:09.412526+0000","last_unstale":"2023-11-28T21:08:11.425780+0000","last_undegraded":"2023-11-28T21:08:11.425780+0000","last_fullsized":"2023-11-28T21:08:11.425780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:22.819533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428899+0000","last_change":"2023-11-28T21:08:10.224859+0000","last_active":"2023-11-28T21:08:11.428899+0000","last_peered":"2023-11-28T21:08:11.428899+0000","last_clean":"2023-11-28T21:08:11.428899+0000","last_became_active":"2023-11-28T21:08:10.223472+0000","last_became_peered":"2023-11-28T21:08:10.223472+0000","last_unstale":"2023-11-28T21:08:11.428899+0000","last_undegraded":"2023-11-28T21:08:11.428899+0000","last_fullsized":"2023-11-28T21:08:11.428899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:44.649741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T21:08:10.207024+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-28T21:08:10.207024+0000","last_peered":"2023-11-28T21:08:10.207024+0000","last_clean":"2023-11-28T21:08:10.207024+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-28T21:08:10.207024+0000","last_undegraded":"2023-11-28T21:08:10.207024+0000","last_fullsized":"2023-11-28T21:08:10.207024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427645+0000","last_change":"2023-11-28T21:08:09.410476+0000","last_active":"2023-11-28T21:08:11.427645+0000","last_peered":"2023-11-28T21:08:11.427645+0000","last_clean":"2023-11-28T21:08:11.427645+0000","last_became_active":"2023-11-28T21:08:09.410187+0000","last_became_peered":"2023-11-28T21:08:09.410187+0000","last_unstale":"2023-11-28T21:08:11.427645+0000","last_undegraded":"2023-11-28T21:08:11.427645+0000","last_fullsized":"2023-11-28T21:08:11.427645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:30.479292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427140+0000","last_change":"2023-11-28T21:08:10.217383+0000","last_active":"2023-11-28T21:08:11.427140+0000","last_peered":"2023-11-28T21:08:11.427140+0000","last_clean":"2023-11-28T21:08:11.427140+0000","last_became_active":"2023-11-28T21:08:10.216734+0000","last_became_peered":"2023-11-28T21:08:10.216734+0000","last_unstale":"2023-11-28T21:08:11.427140+0000","last_undegraded":"2023-11-28T21:08:11.427140+0000","last_fullsized":"2023-11-28T21:08:11.427140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:01.305338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427737+0000","last_change":"2023-11-28T21:08:09.420964+0000","last_active":"2023-11-28T21:08:11.427737+0000","last_peered":"2023-11-28T21:08:11.427737+0000","last_clean":"2023-11-28T21:08:11.427737+0000","last_became_active":"2023-11-28T21:08:09.420579+0000","last_became_peered":"2023-11-28T21:08:09.420579+0000","last_unstale":"2023-11-28T21:08:11.427737+0000","last_undegraded":"2023-11-28T21:08:11.427737+0000","last_fullsized":"2023-11-28T21:08:11.427737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425829+0000","last_change":"2023-11-28T21:08:10.204009+0000","last_active":"2023-11-28T21:08:11.425829+0000","last_peered":"2023-11-28T21:08:11.425829+0000","last_clean":"2023-11-28T21:08:11.425829+0000","last_became_active":"2023-11-28T21:08:10.203603+0000","last_became_peered":"2023-11-28T21:08:10.203603+0000","last_unstale":"2023-11-28T21:08:11.425829+0000","last_undegraded":"2023-11-28T21:08:11.425829+0000","last_fullsized":"2023-11-28T21:08:11.425829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:53.174867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425911+0000","last_change":"2023-11-28T21:08:09.411899+0000","last_active":"2023-11-28T21:08:11.425911+0000","last_peered":"2023-11-28T21:08:11.425911+0000","last_clean":"2023-11-28T21:08:11.425911+0000","last_became_active":"2023-11-28T21:08:09.411555+0000","last_became_peered":"2023-11-28T21:08:09.411555+0000","last_unstale":"2023-11-28T21:08:11.425911+0000","last_undegraded":"2023-11-28T21:08:11.425911+0000","last_fullsized":"2023-11-28T21:08:11.425911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:41.385513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192833+0000","last_change":"2023-11-28T21:08:10.209590+0000","last_active":"2023-11-28T21:08:11.192833+0000","last_peered":"2023-11-28T21:08:11.192833+0000","last_clean":"2023-11-28T21:08:11.192833+0000","last_became_active":"2023-11-28T21:08:10.209147+0000","last_became_peered":"2023-11-28T21:08:10.209147+0000","last_unstale":"2023-11-28T21:08:11.192833+0000","last_undegraded":"2023-11-28T21:08:11.192833+0000","last_fullsized":"2023-11-28T21:08:11.192833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:31.482317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428982+0000","last_change":"2023-11-28T21:08:09.410466+0000","last_active":"2023-11-28T21:08:11.428982+0000","last_peered":"2023-11-28T21:08:11.428982+0000","last_clean":"2023-11-28T21:08:11.428982+0000","last_became_active":"2023-11-28T21:08:09.407914+0000","last_became_peered":"2023-11-28T21:08:09.407914+0000","last_unstale":"2023-11-28T21:08:11.428982+0000","last_undegraded":"2023-11-28T21:08:11.428982+0000","last_fullsized":"2023-11-28T21:08:11.428982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:43.201299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197885+0000","last_change":"2023-11-28T21:08:10.207622+0000","last_active":"2023-11-28T21:08:11.197885+0000","last_peered":"2023-11-28T21:08:11.197885+0000","last_clean":"2023-11-28T21:08:11.197885+0000","last_became_active":"2023-11-28T21:08:10.207211+0000","last_became_peered":"2023-11-28T21:08:10.207211+0000","last_unstale":"2023-11-28T21:08:11.197885+0000","last_undegraded":"2023-11-28T21:08:11.197885+0000","last_fullsized":"2023-11-28T21:08:11.197885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:19.158104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193185+0000","last_change":"2023-11-28T21:08:09.409041+0000","last_active":"2023-11-28T21:08:11.193185+0000","last_peered":"2023-11-28T21:08:11.193185+0000","last_clean":"2023-11-28T21:08:11.193185+0000","last_became_active":"2023-11-28T21:08:09.408341+0000","last_became_peered":"2023-11-28T21:08:09.408341+0000","last_unstale":"2023-11-28T21:08:11.193185+0000","last_undegraded":"2023-11-28T21:08:11.193185+0000","last_fullsized":"2023-11-28T21:08:11.193185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:00.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428794+0000","last_change":"2023-11-28T21:08:10.214773+0000","last_active":"2023-11-28T21:08:11.428794+0000","last_peered":"2023-11-28T21:08:11.428794+0000","last_clean":"2023-11-28T21:08:11.428794+0000","last_became_active":"2023-11-28T21:08:10.213536+0000","last_became_peered":"2023-11-28T21:08:10.213536+0000","last_unstale":"2023-11-28T21:08:11.428794+0000","last_undegraded":"2023-11-28T21:08:11.428794+0000","last_fullsized":"2023-11-28T21:08:11.428794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:01.331246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429147+0000","last_change":"2023-11-28T21:08:09.420838+0000","last_active":"2023-11-28T21:08:11.429147+0000","last_peered":"2023-11-28T21:08:11.429147+0000","last_clean":"2023-11-28T21:08:11.429147+0000","last_became_active":"2023-11-28T21:08:09.420573+0000","last_became_peered":"2023-11-28T21:08:09.420573+0000","last_unstale":"2023-11-28T21:08:11.429147+0000","last_undegraded":"2023-11-28T21:08:11.429147+0000","last_fullsized":"2023-11-28T21:08:11.429147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:21.623627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193010+0000","last_change":"2023-11-28T21:08:10.210874+0000","last_active":"2023-11-28T21:08:11.193010+0000","last_peered":"2023-11-28T21:08:11.193010+0000","last_clean":"2023-11-28T21:08:11.193010+0000","last_became_active":"2023-11-28T21:08:10.210568+0000","last_became_peered":"2023-11-28T21:08:10.210568+0000","last_unstale":"2023-11-28T21:08:11.193010+0000","last_undegraded":"2023-11-28T21:08:11.193010+0000","last_fullsized":"2023-11-28T21:08:11.193010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:44.204323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.681453+0000","last_change":"2023-11-28T21:08:09.401418+0000","last_active":"2023-11-28T21:08:11.681453+0000","last_peered":"2023-11-28T21:08:11.681453+0000","last_clean":"2023-11-28T21:08:11.681453+0000","last_became_active":"2023-11-28T21:08:09.400985+0000","last_became_peered":"2023-11-28T21:08:09.400985+0000","last_unstale":"2023-11-28T21:08:11.681453+0000","last_undegraded":"2023-11-28T21:08:11.681453+0000","last_fullsized":"2023-11-28T21:08:11.681453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:37.553726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427625+0000","last_change":"2023-11-28T21:08:10.226340+0000","last_active":"2023-11-28T21:08:11.427625+0000","last_peered":"2023-11-28T21:08:11.427625+0000","last_clean":"2023-11-28T21:08:11.427625+0000","last_became_active":"2023-11-28T21:08:10.226076+0000","last_became_peered":"2023-11-28T21:08:10.226076+0000","last_unstale":"2023-11-28T21:08:11.427625+0000","last_undegraded":"2023-11-28T21:08:11.427625+0000","last_fullsized":"2023-11-28T21:08:11.427625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:55:43.036114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198424+0000","last_change":"2023-11-28T21:08:09.412010+0000","last_active":"2023-11-28T21:08:11.198424+0000","last_peered":"2023-11-28T21:08:11.198424+0000","last_clean":"2023-11-28T21:08:11.198424+0000","last_became_active":"2023-11-28T21:08:09.411717+0000","last_became_peered":"2023-11-28T21:08:09.411717+0000","last_unstale":"2023-11-28T21:08:11.198424+0000","last_undegraded":"2023-11-28T21:08:11.198424+0000","last_fullsized":"2023-11-28T21:08:11.198424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426552+0000","last_change":"2023-11-28T21:08:10.212660+0000","last_active":"2023-11-28T21:08:11.426552+0000","last_peered":"2023-11-28T21:08:11.426552+0000","last_clean":"2023-11-28T21:08:11.426552+0000","last_became_active":"2023-11-28T21:08:10.212355+0000","last_became_peered":"2023-11-28T21:08:10.212355+0000","last_unstale":"2023-11-28T21:08:11.426552+0000","last_undegraded":"2023-11-28T21:08:11.426552+0000","last_fullsized":"2023-11-28T21:08:11.426552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:01.305338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427462+0000","last_change":"2023-11-28T21:08:09.419375+0000","last_active":"2023-11-28T21:08:11.427462+0000","last_peered":"2023-11-28T21:08:11.427462+0000","last_clean":"2023-11-28T21:08:11.427462+0000","last_became_active":"2023-11-28T21:08:09.419142+0000","last_became_peered":"2023-11-28T21:08:09.419142+0000","last_unstale":"2023-11-28T21:08:11.427462+0000","last_undegraded":"2023-11-28T21:08:11.427462+0000","last_fullsized":"2023-11-28T21:08:11.427462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197815+0000","last_change":"2023-11-28T21:08:10.214305+0000","last_active":"2023-11-28T21:08:11.197815+0000","last_peered":"2023-11-28T21:08:11.197815+0000","last_clean":"2023-11-28T21:08:11.197815+0000","last_became_active":"2023-11-28T21:08:10.211723+0000","last_became_peered":"2023-11-28T21:08:10.211723+0000","last_unstale":"2023-11-28T21:08:11.197815+0000","last_undegraded":"2023-11-28T21:08:11.197815+0000","last_fullsized":"2023-11-28T21:08:11.197815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:42.388537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192883+0000","last_change":"2023-11-28T21:08:09.405284+0000","last_active":"2023-11-28T21:08:11.192883+0000","last_peered":"2023-11-28T21:08:11.192883+0000","last_clean":"2023-11-28T21:08:11.192883+0000","last_became_active":"2023-11-28T21:08:09.404853+0000","last_became_peered":"2023-11-28T21:08:09.404853+0000","last_unstale":"2023-11-28T21:08:11.192883+0000","last_undegraded":"2023-11-28T21:08:11.192883+0000","last_fullsized":"2023-11-28T21:08:11.192883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:41:22.294086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426947+0000","last_change":"2023-11-28T21:08:10.214946+0000","last_active":"2023-11-28T21:08:11.426947+0000","last_peered":"2023-11-28T21:08:11.426947+0000","last_clean":"2023-11-28T21:08:11.426947+0000","last_became_active":"2023-11-28T21:08:10.214613+0000","last_became_peered":"2023-11-28T21:08:10.214613+0000","last_unstale":"2023-11-28T21:08:11.426947+0000","last_undegraded":"2023-11-28T21:08:11.426947+0000","last_fullsized":"2023-11-28T21:08:11.426947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:43:54.997585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193073+0000","last_change":"2023-11-28T21:08:09.414632+0000","last_active":"2023-11-28T21:08:11.193073+0000","last_peered":"2023-11-28T21:08:11.193073+0000","last_clean":"2023-11-28T21:08:11.193073+0000","last_became_active":"2023-11-28T21:08:09.414302+0000","last_became_peered":"2023-11-28T21:08:09.414302+0000","last_unstale":"2023-11-28T21:08:11.193073+0000","last_undegraded":"2023-11-28T21:08:11.193073+0000","last_fullsized":"2023-11-28T21:08:11.193073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:41.385513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427365+0000","last_change":"2023-11-28T21:08:10.215986+0000","last_active":"2023-11-28T21:08:11.427365+0000","last_peered":"2023-11-28T21:08:11.427365+0000","last_clean":"2023-11-28T21:08:11.427365+0000","last_became_active":"2023-11-28T21:08:10.215655+0000","last_became_peered":"2023-11-28T21:08:10.215655+0000","last_unstale":"2023-11-28T21:08:11.427365+0000","last_undegraded":"2023-11-28T21:08:11.427365+0000","last_fullsized":"2023-11-28T21:08:11.427365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:22:29.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428073+0000","last_change":"2023-11-28T21:08:09.418940+0000","last_active":"2023-11-28T21:08:11.428073+0000","last_peered":"2023-11-28T21:08:11.428073+0000","last_clean":"2023-11-28T21:08:11.428073+0000","last_became_active":"2023-11-28T21:08:09.418536+0000","last_became_peered":"2023-11-28T21:08:09.418536+0000","last_unstale":"2023-11-28T21:08:11.428073+0000","last_undegraded":"2023-11-28T21:08:11.428073+0000","last_fullsized":"2023-11-28T21:08:11.428073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:37.553726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197420+0000","last_change":"2023-11-28T21:08:10.207057+0000","last_active":"2023-11-28T21:08:11.197420+0000","last_peered":"2023-11-28T21:08:11.197420+0000","last_clean":"2023-11-28T21:08:11.197420+0000","last_became_active":"2023-11-28T21:08:10.206752+0000","last_became_peered":"2023-11-28T21:08:10.206752+0000","last_unstale":"2023-11-28T21:08:11.197420+0000","last_undegraded":"2023-11-28T21:08:11.197420+0000","last_fullsized":"2023-11-28T21:08:11.197420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:31.482317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428649+0000","last_change":"2023-11-28T21:08:10.218700+0000","last_active":"2023-11-28T21:08:11.428649+0000","last_peered":"2023-11-28T21:08:11.428649+0000","last_clean":"2023-11-28T21:08:11.428649+0000","last_became_active":"2023-11-28T21:08:10.218416+0000","last_became_peered":"2023-11-28T21:08:10.218416+0000","last_unstale":"2023-11-28T21:08:11.428649+0000","last_undegraded":"2023-11-28T21:08:11.428649+0000","last_fullsized":"2023-11-28T21:08:11.428649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:22.992496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428489+0000","last_change":"2023-11-28T21:08:09.419949+0000","last_active":"2023-11-28T21:08:11.428489+0000","last_peered":"2023-11-28T21:08:11.428489+0000","last_clean":"2023-11-28T21:08:11.428489+0000","last_became_active":"2023-11-28T21:08:09.419653+0000","last_became_peered":"2023-11-28T21:08:09.419653+0000","last_unstale":"2023-11-28T21:08:11.428489+0000","last_undegraded":"2023-11-28T21:08:11.428489+0000","last_fullsized":"2023-11-28T21:08:11.428489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:26.041569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428123+0000","last_change":"2023-11-28T21:08:10.222142+0000","last_active":"2023-11-28T21:08:11.428123+0000","last_peered":"2023-11-28T21:08:11.428123+0000","last_clean":"2023-11-28T21:08:11.428123+0000","last_became_active":"2023-11-28T21:08:10.221893+0000","last_became_peered":"2023-11-28T21:08:10.221893+0000","last_unstale":"2023-11-28T21:08:11.428123+0000","last_undegraded":"2023-11-28T21:08:11.428123+0000","last_fullsized":"2023-11-28T21:08:11.428123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:04.834063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428997+0000","last_change":"2023-11-28T21:08:09.418923+0000","last_active":"2023-11-28T21:08:11.428997+0000","last_peered":"2023-11-28T21:08:11.428997+0000","last_clean":"2023-11-28T21:08:11.428997+0000","last_became_active":"2023-11-28T21:08:09.418551+0000","last_became_peered":"2023-11-28T21:08:09.418551+0000","last_unstale":"2023-11-28T21:08:11.428997+0000","last_undegraded":"2023-11-28T21:08:11.428997+0000","last_fullsized":"2023-11-28T21:08:11.428997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:06.363411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426640+0000","last_change":"2023-11-28T21:08:10.220292+0000","last_active":"2023-11-28T21:08:11.426640+0000","last_peered":"2023-11-28T21:08:11.426640+0000","last_clean":"2023-11-28T21:08:11.426640+0000","last_became_active":"2023-11-28T21:08:10.219942+0000","last_became_peered":"2023-11-28T21:08:10.219942+0000","last_unstale":"2023-11-28T21:08:11.426640+0000","last_undegraded":"2023-11-28T21:08:11.426640+0000","last_fullsized":"2023-11-28T21:08:11.426640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:58.192436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427644+0000","last_change":"2023-11-28T21:08:09.412597+0000","last_active":"2023-11-28T21:08:11.427644+0000","last_peered":"2023-11-28T21:08:11.427644+0000","last_clean":"2023-11-28T21:08:11.427644+0000","last_became_active":"2023-11-28T21:08:09.412283+0000","last_became_peered":"2023-11-28T21:08:09.412283+0000","last_unstale":"2023-11-28T21:08:11.427644+0000","last_undegraded":"2023-11-28T21:08:11.427644+0000","last_fullsized":"2023-11-28T21:08:11.427644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:48.155910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427484+0000","last_change":"2023-11-28T21:08:10.213534+0000","last_active":"2023-11-28T21:08:11.427484+0000","last_peered":"2023-11-28T21:08:11.427484+0000","last_clean":"2023-11-28T21:08:11.427484+0000","last_became_active":"2023-11-28T21:08:10.213241+0000","last_became_peered":"2023-11-28T21:08:10.213241+0000","last_unstale":"2023-11-28T21:08:11.427484+0000","last_undegraded":"2023-11-28T21:08:11.427484+0000","last_fullsized":"2023-11-28T21:08:11.427484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426727+0000","last_change":"2023-11-28T21:08:09.410083+0000","last_active":"2023-11-28T21:08:11.426727+0000","last_peered":"2023-11-28T21:08:11.426727+0000","last_clean":"2023-11-28T21:08:11.426727+0000","last_became_active":"2023-11-28T21:08:09.409731+0000","last_became_peered":"2023-11-28T21:08:09.409731+0000","last_unstale":"2023-11-28T21:08:11.426727+0000","last_undegraded":"2023-11-28T21:08:11.426727+0000","last_fullsized":"2023-11-28T21:08:11.426727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.177983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":72305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":72341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.637}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.113}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.4770000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0789999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5730000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7190000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7350000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4640000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":663221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:08:19.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:08:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.455+0000 7fc8882fd640 1 Processor -- start 2023-11-28T21:08:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.455+0000 7fc8882fd640 1 -- start start 2023-11-28T21:08:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc8882fd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc880142da0 0x7fc880071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc8882fd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc88006dd90 0x7fc8800b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc8882fd640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88015e340 con 0x7fc88015e7d0 2023-11-28T21:08:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc8882fd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88015dae0 con 0x7fc880142da0 2023-11-28T21:08:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc8882fd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8800b39b0 con 0x7fc88006dd90 2023-11-28T21:08:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc886099640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc880142da0 0x7fc880071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc885898640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc88015e7d0 0x7fc88006d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40276/0 (socket says 172.21.15.6:40276) 2023-11-28T21:08:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc885898640 1 -- 172.21.15.6:0/3641181267 learned_addr learned my addr 172.21.15.6:0/3641181267 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc88689a640 1 --2- 172.21.15.6:0/3641181267 >> v2:172.21.15.31:3300/0 conn(0x7fc88006dd90 0x7fc8800b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc886099640 1 -- 172.21.15.6:0/3641181267 >> v2:172.21.15.31:3300/0 conn(0x7fc88006dd90 msgr2=0x7fc8800b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc886099640 1 --2- 172.21.15.6:0/3641181267 >> v2:172.21.15.31:3300/0 conn(0x7fc88006dd90 0x7fc8800b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc886099640 1 -- 172.21.15.6:0/3641181267 >> v1:172.21.15.6:6789/0 conn(0x7fc88015e7d0 legacy=0x7fc88006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.459+0000 7fc886099640 1 -- 172.21.15.6:0/3641181267 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880143440 con 0x7fc880142da0 2023-11-28T21:08:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc886099640 1 --2- 172.21.15.6:0/3641181267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 0x7fc880071fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8800b1980 tx=0x7fc87c01e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db83b27158651af7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc885097640 1 -- 172.21.15.6:0/3641181267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0a8610 con 0x7fc880142da0 2023-11-28T21:08:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc885097640 1 -- 172.21.15.6:0/3641181267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c0a8770 con 0x7fc880142da0 2023-11-28T21:08:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc885097640 1 -- 172.21.15.6:0/3641181267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0a8b00 con 0x7fc880142da0 2023-11-28T21:08:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 -- 172.21.15.6:0/3641181267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 msgr2=0x7fc880071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 --2- 172.21.15.6:0/3641181267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 0x7fc880071fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8800b1980 tx=0x7fc87c01e640 comp rx=0 tx=0).stop 2023-11-28T21:08:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 -- 172.21.15.6:0/3641181267 shutdown_connections 2023-11-28T21:08:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 --2- 172.21.15.6:0/3641181267 >> v2:172.21.15.31:3300/0 conn(0x7fc88006dd90 0x7fc8800b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 --2- 172.21.15.6:0/3641181267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 0x7fc880071fb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 -- 172.21.15.6:0/3641181267 >> 172.21.15.6:0/3641181267 conn(0x7fc88006ab80 msgr2=0x7fc8800b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:19.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 -- 172.21.15.6:0/3641181267 shutdown_connections 2023-11-28T21:08:19.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 -- 172.21.15.6:0/3641181267 wait complete. 2023-11-28T21:08:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 Processor -- start 2023-11-28T21:08:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.463+0000 7fc8882fd640 1 -- start start 2023-11-28T21:08:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc8882fd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88006dd90 0x7fc8801329f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc8882fd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 0x7fc8800cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc8882fd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015e7d0 0x7fc8800cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc8882fd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800cf300 con 0x7fc880142da0 2023-11-28T21:08:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc8882fd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88015b4f0 con 0x7fc88006dd90 2023-11-28T21:08:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc8882fd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88015b7d0 con 0x7fc88015e7d0 2023-11-28T21:08:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc885898640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 0x7fc8800cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc885898640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 0x7fc8800cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49264/0 (socket says 172.21.15.6:49264) 2023-11-28T21:08:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc885898640 1 -- 172.21.15.6:0/2314538120 learned_addr learned my addr 172.21.15.6:0/2314538120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc886099640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88006dd90 0x7fc8801329f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc88689a640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015e7d0 0x7fc8800cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc885898640 1 -- 172.21.15.6:0/2314538120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015e7d0 msgr2=0x7fc8800cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc885898640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015e7d0 0x7fc8800cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc885898640 1 -- 172.21.15.6:0/2314538120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88006dd90 msgr2=0x7fc8801329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc885898640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88006dd90 0x7fc8801329f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc885898640 1 -- 172.21.15.6:0/2314538120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c009420 con 0x7fc880142da0 2023-11-28T21:08:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc885898640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 0x7fc8800cd080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc87000c400 tx=0x7fc87000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc876ffd640 1 -- 172.21.15.6:0/2314538120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870005cf0 con 0x7fc880142da0 2023-11-28T21:08:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc876ffd640 1 -- 172.21.15.6:0/2314538120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc870005e50 con 0x7fc880142da0 2023-11-28T21:08:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc876ffd640 1 -- 172.21.15.6:0/2314538120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700072d0 con 0x7fc880142da0 2023-11-28T21:08:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8800cc5a0 con 0x7fc880142da0 2023-11-28T21:08:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8800ccb60 con 0x7fc880142da0 2023-11-28T21:08:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8800674d0 con 0x7fc880142da0 2023-11-28T21:08:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.467+0000 7fc876ffd640 1 -- 172.21.15.6:0/2314538120 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc870007430 con 0x7fc880142da0 2023-11-28T21:08:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.471+0000 7fc876ffd640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc864066470 0x7fc864068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.471+0000 7fc876ffd640 1 -- 172.21.15.6:0/2314538120 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc870083340 con 0x7fc880142da0 2023-11-28T21:08:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.471+0000 7fc886099640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc864066470 0x7fc864068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.471+0000 7fc886099640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc864066470 0x7fc864068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0b1000 tx=0x7fc87c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.475+0000 7fc876ffd640 1 -- 172.21.15.6:0/2314538120 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc870050870 con 0x7fc880142da0 2023-11-28T21:08:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.627+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8800b3010 con 0x7fc864066470 2023-11-28T21:08:19.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc876ffd640 1 -- 172.21.15.6:0/2314538120 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264524 (secure 0 0 0) 0x7fc8800b3010 con 0x7fc864066470 2023-11-28T21:08:19.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-28T21:08:19.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc864066470 msgr2=0x7fc864068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc864066470 0x7fc864068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0b1000 tx=0x7fc87c008040 comp rx=0 tx=0).stop 2023-11-28T21:08:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 msgr2=0x7fc8800cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 0x7fc8800cd080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc87000c400 tx=0x7fc87000c8c0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 shutdown_connections 2023-11-28T21:08:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc864066470 0x7fc864068930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015e7d0 0x7fc8800cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880142da0 0x7fc8800cd080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 --2- 172.21.15.6:0/2314538120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88006dd90 0x7fc8801329f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 >> 172.21.15.6:0/2314538120 conn(0x7fc88006ab80 msgr2=0x7fc8800af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 shutdown_connections 2023-11-28T21:08:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.635+0000 7fc8882fd640 1 -- 172.21.15.6:0/2314538120 wait complete. 2023-11-28T21:08:19.663 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-28T21:08:18.659425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2924544,"data_stored":1763276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.469172"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428684+0000","last_change":"2023-11-28T21:08:10.226585+0000","last_active":"2023-11-28T21:08:11.428684+0000","last_peered":"2023-11-28T21:08:11.428684+0000","last_clean":"2023-11-28T21:08:11.428684+0000","last_became_active":"2023-11-28T21:08:10.223076+0000","last_became_peered":"2023-11-28T21:08:10.223076+0000","last_unstale":"2023-11-28T21:08:11.428684+0000","last_undegraded":"2023-11-28T21:08:11.428684+0000","last_fullsized":"2023-11-28T21:08:11.428684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:01.331246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193106+0000","last_change":"2023-11-28T21:08:10.219531+0000","last_active":"2023-11-28T21:08:11.193106+0000","last_peered":"2023-11-28T21:08:11.193106+0000","last_clean":"2023-11-28T21:08:11.193106+0000","last_became_active":"2023-11-28T21:08:10.219219+0000","last_became_peered":"2023-11-28T21:08:10.219219+0000","last_unstale":"2023-11-28T21:08:11.193106+0000","last_undegraded":"2023-11-28T21:08:11.193106+0000","last_fullsized":"2023-11-28T21:08:11.193106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426406+0000","last_change":"2023-11-28T21:08:10.214525+0000","last_active":"2023-11-28T21:08:11.426406+0000","last_peered":"2023-11-28T21:08:11.426406+0000","last_clean":"2023-11-28T21:08:11.426406+0000","last_became_active":"2023-11-28T21:08:10.207834+0000","last_became_peered":"2023-11-28T21:08:10.207834+0000","last_unstale":"2023-11-28T21:08:11.426406+0000","last_undegraded":"2023-11-28T21:08:11.426406+0000","last_fullsized":"2023-11-28T21:08:11.426406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:58.849892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427963+0000","last_change":"2023-11-28T21:08:10.218249+0000","last_active":"2023-11-28T21:08:11.427963+0000","last_peered":"2023-11-28T21:08:11.427963+0000","last_clean":"2023-11-28T21:08:11.427963+0000","last_became_active":"2023-11-28T21:08:10.217753+0000","last_became_peered":"2023-11-28T21:08:10.217753+0000","last_unstale":"2023-11-28T21:08:11.427963+0000","last_undegraded":"2023-11-28T21:08:11.427963+0000","last_fullsized":"2023-11-28T21:08:11.427963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:22.626652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428006+0000","last_change":"2023-11-28T21:08:10.226231+0000","last_active":"2023-11-28T21:08:11.428006+0000","last_peered":"2023-11-28T21:08:11.428006+0000","last_clean":"2023-11-28T21:08:11.428006+0000","last_became_active":"2023-11-28T21:08:10.222935+0000","last_became_peered":"2023-11-28T21:08:10.222935+0000","last_unstale":"2023-11-28T21:08:11.428006+0000","last_undegraded":"2023-11-28T21:08:11.428006+0000","last_fullsized":"2023-11-28T21:08:11.428006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:52.316215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428380+0000","last_change":"2023-11-28T21:08:10.221517+0000","last_active":"2023-11-28T21:08:11.428380+0000","last_peered":"2023-11-28T21:08:11.428380+0000","last_clean":"2023-11-28T21:08:11.428380+0000","last_became_active":"2023-11-28T21:08:10.221308+0000","last_became_peered":"2023-11-28T21:08:10.221308+0000","last_unstale":"2023-11-28T21:08:11.428380+0000","last_undegraded":"2023-11-28T21:08:11.428380+0000","last_fullsized":"2023-11-28T21:08:11.428380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:52.862412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427554+0000","last_change":"2023-11-28T21:08:10.224411+0000","last_active":"2023-11-28T21:08:11.427554+0000","last_peered":"2023-11-28T21:08:11.427554+0000","last_clean":"2023-11-28T21:08:11.427554+0000","last_became_active":"2023-11-28T21:08:10.222988+0000","last_became_peered":"2023-11-28T21:08:10.222988+0000","last_unstale":"2023-11-28T21:08:11.427554+0000","last_undegraded":"2023-11-28T21:08:11.427554+0000","last_fullsized":"2023-11-28T21:08:11.427554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:04.834063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426821+0000","last_change":"2023-11-28T21:08:10.219243+0000","last_active":"2023-11-28T21:08:11.426821+0000","last_peered":"2023-11-28T21:08:11.426821+0000","last_clean":"2023-11-28T21:08:11.426821+0000","last_became_active":"2023-11-28T21:08:10.218641+0000","last_became_peered":"2023-11-28T21:08:10.218641+0000","last_unstale":"2023-11-28T21:08:11.426821+0000","last_undegraded":"2023-11-28T21:08:11.426821+0000","last_fullsized":"2023-11-28T21:08:11.426821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:47:10.269501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428832+0000","last_change":"2023-11-28T21:08:10.226553+0000","last_active":"2023-11-28T21:08:11.428832+0000","last_peered":"2023-11-28T21:08:11.428832+0000","last_clean":"2023-11-28T21:08:11.428832+0000","last_became_active":"2023-11-28T21:08:10.224176+0000","last_became_peered":"2023-11-28T21:08:10.224176+0000","last_unstale":"2023-11-28T21:08:11.428832+0000","last_undegraded":"2023-11-28T21:08:11.428832+0000","last_fullsized":"2023-11-28T21:08:11.428832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:32:56.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198381+0000","last_change":"2023-11-28T21:08:10.221489+0000","last_active":"2023-11-28T21:08:11.198381+0000","last_peered":"2023-11-28T21:08:11.198381+0000","last_clean":"2023-11-28T21:08:11.198381+0000","last_became_active":"2023-11-28T21:08:10.221213+0000","last_became_peered":"2023-11-28T21:08:10.221213+0000","last_unstale":"2023-11-28T21:08:11.198381+0000","last_undegraded":"2023-11-28T21:08:11.198381+0000","last_fullsized":"2023-11-28T21:08:11.198381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:07.366435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198075+0000","last_change":"2023-11-28T21:08:10.220463+0000","last_active":"2023-11-28T21:08:11.198075+0000","last_peered":"2023-11-28T21:08:11.198075+0000","last_clean":"2023-11-28T21:08:11.198075+0000","last_became_active":"2023-11-28T21:08:10.220156+0000","last_became_peered":"2023-11-28T21:08:10.220156+0000","last_unstale":"2023-11-28T21:08:11.198075+0000","last_undegraded":"2023-11-28T21:08:11.198075+0000","last_fullsized":"2023-11-28T21:08:11.198075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:44.030281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197586+0000","last_change":"2023-11-28T21:08:10.199948+0000","last_active":"2023-11-28T21:08:11.197586+0000","last_peered":"2023-11-28T21:08:11.197586+0000","last_clean":"2023-11-28T21:08:11.197586+0000","last_became_active":"2023-11-28T21:08:10.199532+0000","last_became_peered":"2023-11-28T21:08:10.199532+0000","last_unstale":"2023-11-28T21:08:11.197586+0000","last_undegraded":"2023-11-28T21:08:11.197586+0000","last_fullsized":"2023-11-28T21:08:11.197586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:27.044594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427310+0000","last_change":"2023-11-28T21:08:10.214392+0000","last_active":"2023-11-28T21:08:11.427310+0000","last_peered":"2023-11-28T21:08:11.427310+0000","last_clean":"2023-11-28T21:08:11.427310+0000","last_became_active":"2023-11-28T21:08:10.214074+0000","last_became_peered":"2023-11-28T21:08:10.214074+0000","last_unstale":"2023-11-28T21:08:11.427310+0000","last_undegraded":"2023-11-28T21:08:11.427310+0000","last_fullsized":"2023-11-28T21:08:11.427310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:58.192436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426020+0000","last_change":"2023-11-28T21:08:10.215067+0000","last_active":"2023-11-28T21:08:11.426020+0000","last_peered":"2023-11-28T21:08:11.426020+0000","last_clean":"2023-11-28T21:08:11.426020+0000","last_became_active":"2023-11-28T21:08:10.209787+0000","last_became_peered":"2023-11-28T21:08:10.209787+0000","last_unstale":"2023-11-28T21:08:11.426020+0000","last_undegraded":"2023-11-28T21:08:11.426020+0000","last_fullsized":"2023-11-28T21:08:11.426020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:25.410328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192859+0000","last_change":"2023-11-28T21:08:10.204388+0000","last_active":"2023-11-28T21:08:11.192859+0000","last_peered":"2023-11-28T21:08:11.192859+0000","last_clean":"2023-11-28T21:08:11.192859+0000","last_became_active":"2023-11-28T21:08:10.204131+0000","last_became_peered":"2023-11-28T21:08:10.204131+0000","last_unstale":"2023-11-28T21:08:11.192859+0000","last_undegraded":"2023-11-28T21:08:11.192859+0000","last_fullsized":"2023-11-28T21:08:11.192859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:44.030281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427959+0000","last_change":"2023-11-28T21:08:10.221483+0000","last_active":"2023-11-28T21:08:11.427959+0000","last_peered":"2023-11-28T21:08:11.427959+0000","last_clean":"2023-11-28T21:08:11.427959+0000","last_became_active":"2023-11-28T21:08:10.220760+0000","last_became_peered":"2023-11-28T21:08:10.220760+0000","last_unstale":"2023-11-28T21:08:11.427959+0000","last_undegraded":"2023-11-28T21:08:11.427959+0000","last_fullsized":"2023-11-28T21:08:11.427959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428971+0000","last_change":"2023-11-28T21:08:10.225874+0000","last_active":"2023-11-28T21:08:11.428971+0000","last_peered":"2023-11-28T21:08:11.428971+0000","last_clean":"2023-11-28T21:08:11.428971+0000","last_became_active":"2023-11-28T21:08:10.225479+0000","last_became_peered":"2023-11-28T21:08:10.225479+0000","last_unstale":"2023-11-28T21:08:11.428971+0000","last_undegraded":"2023-11-28T21:08:11.428971+0000","last_fullsized":"2023-11-28T21:08:11.428971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:28.425251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425760+0000","last_change":"2023-11-28T21:08:10.211031+0000","last_active":"2023-11-28T21:08:11.425760+0000","last_peered":"2023-11-28T21:08:11.425760+0000","last_clean":"2023-11-28T21:08:11.425760+0000","last_became_active":"2023-11-28T21:08:10.210800+0000","last_became_peered":"2023-11-28T21:08:10.210800+0000","last_unstale":"2023-11-28T21:08:11.425760+0000","last_undegraded":"2023-11-28T21:08:11.425760+0000","last_fullsized":"2023-11-28T21:08:11.425760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:38.556751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429133+0000","last_change":"2023-11-28T21:08:10.227036+0000","last_active":"2023-11-28T21:08:11.429133+0000","last_peered":"2023-11-28T21:08:11.429133+0000","last_clean":"2023-11-28T21:08:11.429133+0000","last_became_active":"2023-11-28T21:08:10.225399+0000","last_became_peered":"2023-11-28T21:08:10.225399+0000","last_unstale":"2023-11-28T21:08:11.429133+0000","last_undegraded":"2023-11-28T21:08:11.429133+0000","last_fullsized":"2023-11-28T21:08:11.429133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:18.468892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198186+0000","last_change":"2023-11-28T21:08:10.203332+0000","last_active":"2023-11-28T21:08:11.198186+0000","last_peered":"2023-11-28T21:08:11.198186+0000","last_clean":"2023-11-28T21:08:11.198186+0000","last_became_active":"2023-11-28T21:08:10.202618+0000","last_became_peered":"2023-11-28T21:08:10.202618+0000","last_unstale":"2023-11-28T21:08:11.198186+0000","last_undegraded":"2023-11-28T21:08:11.198186+0000","last_fullsized":"2023-11-28T21:08:11.198186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:44.204323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426278+0000","last_change":"2023-11-28T21:08:10.213322+0000","last_active":"2023-11-28T21:08:11.426278+0000","last_peered":"2023-11-28T21:08:11.426278+0000","last_clean":"2023-11-28T21:08:11.426278+0000","last_became_active":"2023-11-28T21:08:10.212677+0000","last_became_peered":"2023-11-28T21:08:10.212677+0000","last_unstale":"2023-11-28T21:08:11.426278+0000","last_undegraded":"2023-11-28T21:08:11.426278+0000","last_fullsized":"2023-11-28T21:08:11.426278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:47:10.269501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428778+0000","last_change":"2023-11-28T21:08:10.232806+0000","last_active":"2023-11-28T21:08:11.428778+0000","last_peered":"2023-11-28T21:08:11.428778+0000","last_clean":"2023-11-28T21:08:11.428778+0000","last_became_active":"2023-11-28T21:08:10.232447+0000","last_became_peered":"2023-11-28T21:08:10.232447+0000","last_unstale":"2023-11-28T21:08:11.428778+0000","last_undegraded":"2023-11-28T21:08:11.428778+0000","last_fullsized":"2023-11-28T21:08:11.428778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:03.816068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426930+0000","last_change":"2023-11-28T21:08:10.213764+0000","last_active":"2023-11-28T21:08:11.426930+0000","last_peered":"2023-11-28T21:08:11.426930+0000","last_clean":"2023-11-28T21:08:11.426930+0000","last_became_active":"2023-11-28T21:08:10.213514+0000","last_became_peered":"2023-11-28T21:08:10.213514+0000","last_unstale":"2023-11-28T21:08:11.426930+0000","last_undegraded":"2023-11-28T21:08:11.426930+0000","last_fullsized":"2023-11-28T21:08:11.426930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:13:58.849892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428091+0000","last_change":"2023-11-28T21:08:10.216604+0000","last_active":"2023-11-28T21:08:11.428091+0000","last_peered":"2023-11-28T21:08:11.428091+0000","last_clean":"2023-11-28T21:08:11.428091+0000","last_became_active":"2023-11-28T21:08:10.216256+0000","last_became_peered":"2023-11-28T21:08:10.216256+0000","last_unstale":"2023-11-28T21:08:11.428091+0000","last_undegraded":"2023-11-28T21:08:11.428091+0000","last_fullsized":"2023-11-28T21:08:11.428091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:49:34.820109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427556+0000","last_change":"2023-11-28T21:08:10.225157+0000","last_active":"2023-11-28T21:08:11.427556+0000","last_peered":"2023-11-28T21:08:11.427556+0000","last_clean":"2023-11-28T21:08:11.427556+0000","last_became_active":"2023-11-28T21:08:10.224943+0000","last_became_peered":"2023-11-28T21:08:10.224943+0000","last_unstale":"2023-11-28T21:08:11.427556+0000","last_undegraded":"2023-11-28T21:08:11.427556+0000","last_fullsized":"2023-11-28T21:08:11.427556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:39.372238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198391+0000","last_change":"2023-11-28T21:08:10.213317+0000","last_active":"2023-11-28T21:08:11.198391+0000","last_peered":"2023-11-28T21:08:11.198391+0000","last_clean":"2023-11-28T21:08:11.198391+0000","last_became_active":"2023-11-28T21:08:10.212825+0000","last_became_peered":"2023-11-28T21:08:10.212825+0000","last_unstale":"2023-11-28T21:08:11.198391+0000","last_undegraded":"2023-11-28T21:08:11.198391+0000","last_fullsized":"2023-11-28T21:08:11.198391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:16.389655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193012+0000","last_change":"2023-11-28T21:08:10.211086+0000","last_active":"2023-11-28T21:08:11.193012+0000","last_peered":"2023-11-28T21:08:11.193012+0000","last_clean":"2023-11-28T21:08:11.193012+0000","last_became_active":"2023-11-28T21:08:10.210680+0000","last_became_peered":"2023-11-28T21:08:10.210680+0000","last_unstale":"2023-11-28T21:08:11.193012+0000","last_undegraded":"2023-11-28T21:08:11.193012+0000","last_fullsized":"2023-11-28T21:08:11.193012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:07.366435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427688+0000","last_change":"2023-11-28T21:08:10.222999+0000","last_active":"2023-11-28T21:08:11.427688+0000","last_peered":"2023-11-28T21:08:11.427688+0000","last_clean":"2023-11-28T21:08:11.427688+0000","last_became_active":"2023-11-28T21:08:10.222686+0000","last_became_peered":"2023-11-28T21:08:10.222686+0000","last_unstale":"2023-11-28T21:08:11.427688+0000","last_undegraded":"2023-11-28T21:08:11.427688+0000","last_fullsized":"2023-11-28T21:08:11.427688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:51:15.263435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426287+0000","last_change":"2023-11-28T21:08:10.208621+0000","last_active":"2023-11-28T21:08:11.426287+0000","last_peered":"2023-11-28T21:08:11.426287+0000","last_clean":"2023-11-28T21:08:11.426287+0000","last_became_active":"2023-11-28T21:08:10.206992+0000","last_became_peered":"2023-11-28T21:08:10.206992+0000","last_unstale":"2023-11-28T21:08:11.426287+0000","last_undegraded":"2023-11-28T21:08:11.426287+0000","last_fullsized":"2023-11-28T21:08:11.426287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:58.131504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428613+0000","last_change":"2023-11-28T21:08:10.217326+0000","last_active":"2023-11-28T21:08:11.428613+0000","last_peered":"2023-11-28T21:08:11.428613+0000","last_clean":"2023-11-28T21:08:11.428613+0000","last_became_active":"2023-11-28T21:08:10.216919+0000","last_became_peered":"2023-11-28T21:08:10.216919+0000","last_unstale":"2023-11-28T21:08:11.428613+0000","last_undegraded":"2023-11-28T21:08:11.428613+0000","last_fullsized":"2023-11-28T21:08:11.428613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:21:52.316215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425834+0000","last_change":"2023-11-28T21:08:10.227414+0000","last_active":"2023-11-28T21:08:11.425834+0000","last_peered":"2023-11-28T21:08:11.425834+0000","last_clean":"2023-11-28T21:08:11.425834+0000","last_became_active":"2023-11-28T21:08:10.227158+0000","last_became_peered":"2023-11-28T21:08:10.227158+0000","last_unstale":"2023-11-28T21:08:11.425834+0000","last_undegraded":"2023-11-28T21:08:11.425834+0000","last_fullsized":"2023-11-28T21:08:11.425834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:36:09.278216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.196935+0000","last_change":"2023-11-28T21:08:10.202982+0000","last_active":"2023-11-28T21:08:11.196935+0000","last_peered":"2023-11-28T21:08:11.196935+0000","last_clean":"2023-11-28T21:08:11.196935+0000","last_became_active":"2023-11-28T21:08:10.202638+0000","last_became_peered":"2023-11-28T21:08:10.202638+0000","last_unstale":"2023-11-28T21:08:11.196935+0000","last_undegraded":"2023-11-28T21:08:11.196935+0000","last_fullsized":"2023-11-28T21:08:11.196935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:20:14.317884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197295+0000","last_change":"2023-11-28T21:08:10.214194+0000","last_active":"2023-11-28T21:08:11.197295+0000","last_peered":"2023-11-28T21:08:11.197295+0000","last_clean":"2023-11-28T21:08:11.197295+0000","last_became_active":"2023-11-28T21:08:10.213046+0000","last_became_peered":"2023-11-28T21:08:10.213046+0000","last_unstale":"2023-11-28T21:08:11.197295+0000","last_undegraded":"2023-11-28T21:08:11.197295+0000","last_fullsized":"2023-11-28T21:08:11.197295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:23.822558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427403+0000","last_change":"2023-11-28T21:08:09.408970+0000","last_active":"2023-11-28T21:08:11.427403+0000","last_peered":"2023-11-28T21:08:11.427403+0000","last_clean":"2023-11-28T21:08:11.427403+0000","last_became_active":"2023-11-28T21:08:09.407594+0000","last_became_peered":"2023-11-28T21:08:09.407594+0000","last_unstale":"2023-11-28T21:08:11.427403+0000","last_undegraded":"2023-11-28T21:08:11.427403+0000","last_fullsized":"2023-11-28T21:08:11.427403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:52.171842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426417+0000","last_change":"2023-11-28T21:08:10.206555+0000","last_active":"2023-11-28T21:08:11.426417+0000","last_peered":"2023-11-28T21:08:11.426417+0000","last_clean":"2023-11-28T21:08:11.426417+0000","last_became_active":"2023-11-28T21:08:10.206199+0000","last_became_peered":"2023-11-28T21:08:10.206199+0000","last_unstale":"2023-11-28T21:08:11.426417+0000","last_undegraded":"2023-11-28T21:08:11.426417+0000","last_fullsized":"2023-11-28T21:08:11.426417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:43:54.997585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197850+0000","last_change":"2023-11-28T21:08:09.409806+0000","last_active":"2023-11-28T21:08:11.197850+0000","last_peered":"2023-11-28T21:08:11.197850+0000","last_clean":"2023-11-28T21:08:11.197850+0000","last_became_active":"2023-11-28T21:08:09.409409+0000","last_became_peered":"2023-11-28T21:08:09.409409+0000","last_unstale":"2023-11-28T21:08:11.197850+0000","last_undegraded":"2023-11-28T21:08:11.197850+0000","last_fullsized":"2023-11-28T21:08:11.197850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:00.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427006+0000","last_change":"2023-11-28T21:08:09.411063+0000","last_active":"2023-11-28T21:08:11.427006+0000","last_peered":"2023-11-28T21:08:11.427006+0000","last_clean":"2023-11-28T21:08:11.427006+0000","last_became_active":"2023-11-28T21:08:09.410772+0000","last_became_peered":"2023-11-28T21:08:09.410772+0000","last_unstale":"2023-11-28T21:08:11.427006+0000","last_undegraded":"2023-11-28T21:08:11.427006+0000","last_fullsized":"2023-11-28T21:08:11.427006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:06:24.407303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426871+0000","last_change":"2023-11-28T21:08:10.218510+0000","last_active":"2023-11-28T21:08:11.426871+0000","last_peered":"2023-11-28T21:08:11.426871+0000","last_clean":"2023-11-28T21:08:11.426871+0000","last_became_active":"2023-11-28T21:08:10.216099+0000","last_became_peered":"2023-11-28T21:08:10.216099+0000","last_unstale":"2023-11-28T21:08:11.426871+0000","last_undegraded":"2023-11-28T21:08:11.426871+0000","last_fullsized":"2023-11-28T21:08:11.426871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:05:58.131504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428208+0000","last_change":"2023-11-28T21:08:09.411506+0000","last_active":"2023-11-28T21:08:11.428208+0000","last_peered":"2023-11-28T21:08:11.428208+0000","last_clean":"2023-11-28T21:08:11.428208+0000","last_became_active":"2023-11-28T21:08:09.411121+0000","last_became_peered":"2023-11-28T21:08:09.411121+0000","last_unstale":"2023-11-28T21:08:11.428208+0000","last_undegraded":"2023-11-28T21:08:11.428208+0000","last_fullsized":"2023-11-28T21:08:11.428208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:20:13.314859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192789+0000","last_change":"2023-11-28T21:08:10.208767+0000","last_active":"2023-11-28T21:08:11.192789+0000","last_peered":"2023-11-28T21:08:11.192789+0000","last_clean":"2023-11-28T21:08:11.192789+0000","last_became_active":"2023-11-28T21:08:10.208461+0000","last_became_peered":"2023-11-28T21:08:10.208461+0000","last_unstale":"2023-11-28T21:08:11.192789+0000","last_undegraded":"2023-11-28T21:08:11.192789+0000","last_fullsized":"2023-11-28T21:08:11.192789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:04.311783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198365+0000","last_change":"2023-11-28T21:08:09.413726+0000","last_active":"2023-11-28T21:08:11.198365+0000","last_peered":"2023-11-28T21:08:11.198365+0000","last_clean":"2023-11-28T21:08:11.198365+0000","last_became_active":"2023-11-28T21:08:09.413416+0000","last_became_peered":"2023-11-28T21:08:09.413416+0000","last_unstale":"2023-11-28T21:08:11.198365+0000","last_undegraded":"2023-11-28T21:08:11.198365+0000","last_fullsized":"2023-11-28T21:08:11.198365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:41:22.294086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429381+0000","last_change":"2023-11-28T21:08:10.226078+0000","last_active":"2023-11-28T21:08:11.429381+0000","last_peered":"2023-11-28T21:08:11.429381+0000","last_clean":"2023-11-28T21:08:11.429381+0000","last_became_active":"2023-11-28T21:08:10.225785+0000","last_became_peered":"2023-11-28T21:08:10.225785+0000","last_unstale":"2023-11-28T21:08:11.429381+0000","last_undegraded":"2023-11-28T21:08:11.429381+0000","last_fullsized":"2023-11-28T21:08:11.429381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:44.649741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429363+0000","last_change":"2023-11-28T21:08:09.405377+0000","last_active":"2023-11-28T21:08:11.429363+0000","last_peered":"2023-11-28T21:08:11.429363+0000","last_clean":"2023-11-28T21:08:11.429363+0000","last_became_active":"2023-11-28T21:08:09.405079+0000","last_became_peered":"2023-11-28T21:08:09.405079+0000","last_unstale":"2023-11-28T21:08:11.429363+0000","last_undegraded":"2023-11-28T21:08:11.429363+0000","last_fullsized":"2023-11-28T21:08:11.429363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:03.308758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426696+0000","last_change":"2023-11-28T21:08:10.220356+0000","last_active":"2023-11-28T21:08:11.426696+0000","last_peered":"2023-11-28T21:08:11.426696+0000","last_clean":"2023-11-28T21:08:11.426696+0000","last_became_active":"2023-11-28T21:08:10.220024+0000","last_became_peered":"2023-11-28T21:08:10.220024+0000","last_unstale":"2023-11-28T21:08:11.426696+0000","last_undegraded":"2023-11-28T21:08:11.426696+0000","last_fullsized":"2023-11-28T21:08:11.426696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:22:29.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193017+0000","last_change":"2023-11-28T21:08:09.414108+0000","last_active":"2023-11-28T21:08:11.193017+0000","last_peered":"2023-11-28T21:08:11.193017+0000","last_clean":"2023-11-28T21:08:11.193017+0000","last_became_active":"2023-11-28T21:08:09.413780+0000","last_became_peered":"2023-11-28T21:08:09.413780+0000","last_unstale":"2023-11-28T21:08:11.193017+0000","last_undegraded":"2023-11-28T21:08:11.193017+0000","last_fullsized":"2023-11-28T21:08:11.193017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197987+0000","last_change":"2023-11-28T21:08:10.218932+0000","last_active":"2023-11-28T21:08:11.197987+0000","last_peered":"2023-11-28T21:08:11.197987+0000","last_clean":"2023-11-28T21:08:11.197987+0000","last_became_active":"2023-11-28T21:08:10.218621+0000","last_became_peered":"2023-11-28T21:08:10.218621+0000","last_unstale":"2023-11-28T21:08:11.197987+0000","last_undegraded":"2023-11-28T21:08:11.197987+0000","last_fullsized":"2023-11-28T21:08:11.197987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:38.556751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198214+0000","last_change":"2023-11-28T21:08:09.416708+0000","last_active":"2023-11-28T21:08:11.198214+0000","last_peered":"2023-11-28T21:08:11.198214+0000","last_clean":"2023-11-28T21:08:11.198214+0000","last_became_active":"2023-11-28T21:08:09.416209+0000","last_became_peered":"2023-11-28T21:08:09.416209+0000","last_unstale":"2023-11-28T21:08:11.198214+0000","last_undegraded":"2023-11-28T21:08:11.198214+0000","last_fullsized":"2023-11-28T21:08:11.198214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428761+0000","last_change":"2023-11-28T21:08:10.226709+0000","last_active":"2023-11-28T21:08:11.428761+0000","last_peered":"2023-11-28T21:08:11.428761+0000","last_clean":"2023-11-28T21:08:11.428761+0000","last_became_active":"2023-11-28T21:08:10.223145+0000","last_became_peered":"2023-11-28T21:08:10.223145+0000","last_unstale":"2023-11-28T21:08:11.428761+0000","last_undegraded":"2023-11-28T21:08:11.428761+0000","last_fullsized":"2023-11-28T21:08:11.428761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:58:28.425251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426379+0000","last_change":"2023-11-28T21:08:09.417259+0000","last_active":"2023-11-28T21:08:11.426379+0000","last_peered":"2023-11-28T21:08:11.426379+0000","last_clean":"2023-11-28T21:08:11.426379+0000","last_became_active":"2023-11-28T21:08:09.415186+0000","last_became_peered":"2023-11-28T21:08:09.415186+0000","last_unstale":"2023-11-28T21:08:11.426379+0000","last_undegraded":"2023-11-28T21:08:11.426379+0000","last_fullsized":"2023-11-28T21:08:11.426379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:32:51.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426183+0000","last_change":"2023-11-28T21:08:10.206745+0000","last_active":"2023-11-28T21:08:11.426183+0000","last_peered":"2023-11-28T21:08:11.426183+0000","last_clean":"2023-11-28T21:08:11.426183+0000","last_became_active":"2023-11-28T21:08:10.206444+0000","last_became_peered":"2023-11-28T21:08:10.206444+0000","last_unstale":"2023-11-28T21:08:11.426183+0000","last_undegraded":"2023-11-28T21:08:11.426183+0000","last_fullsized":"2023-11-28T21:08:11.426183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:49.158934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428881+0000","last_change":"2023-11-28T21:08:09.411244+0000","last_active":"2023-11-28T21:08:11.428881+0000","last_peered":"2023-11-28T21:08:11.428881+0000","last_clean":"2023-11-28T21:08:11.428881+0000","last_became_active":"2023-11-28T21:08:09.410896+0000","last_became_peered":"2023-11-28T21:08:09.410896+0000","last_unstale":"2023-11-28T21:08:11.428881+0000","last_undegraded":"2023-11-28T21:08:11.428881+0000","last_fullsized":"2023-11-28T21:08:11.428881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:14:43.027257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428127+0000","last_change":"2023-11-28T21:08:10.228561+0000","last_active":"2023-11-28T21:08:11.428127+0000","last_peered":"2023-11-28T21:08:11.428127+0000","last_clean":"2023-11-28T21:08:11.428127+0000","last_became_active":"2023-11-28T21:08:10.228150+0000","last_became_peered":"2023-11-28T21:08:10.228150+0000","last_unstale":"2023-11-28T21:08:11.428127+0000","last_undegraded":"2023-11-28T21:08:11.428127+0000","last_fullsized":"2023-11-28T21:08:11.428127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:22.992496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197207+0000","last_change":"2023-11-28T21:08:09.411127+0000","last_active":"2023-11-28T21:08:11.197207+0000","last_peered":"2023-11-28T21:08:11.197207+0000","last_clean":"2023-11-28T21:08:11.197207+0000","last_became_active":"2023-11-28T21:08:09.410838+0000","last_became_peered":"2023-11-28T21:08:09.410838+0000","last_unstale":"2023-11-28T21:08:11.197207+0000","last_undegraded":"2023-11-28T21:08:11.197207+0000","last_fullsized":"2023-11-28T21:08:11.197207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:36:08.275191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.196958+0000","last_change":"2023-11-28T21:08:10.204504+0000","last_active":"2023-11-28T21:08:11.196958+0000","last_peered":"2023-11-28T21:08:11.196958+0000","last_clean":"2023-11-28T21:08:11.196958+0000","last_became_active":"2023-11-28T21:08:10.204189+0000","last_became_peered":"2023-11-28T21:08:10.204189+0000","last_unstale":"2023-11-28T21:08:11.196958+0000","last_undegraded":"2023-11-28T21:08:11.196958+0000","last_fullsized":"2023-11-28T21:08:11.196958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:50:04.311783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425946+0000","last_change":"2023-11-28T21:08:09.400060+0000","last_active":"2023-11-28T21:08:11.425946+0000","last_peered":"2023-11-28T21:08:11.425946+0000","last_clean":"2023-11-28T21:08:11.425946+0000","last_became_active":"2023-11-28T21:08:09.399648+0000","last_became_peered":"2023-11-28T21:08:09.399648+0000","last_unstale":"2023-11-28T21:08:11.425946+0000","last_undegraded":"2023-11-28T21:08:11.425946+0000","last_fullsized":"2023-11-28T21:08:11.425946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:50.664387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427688+0000","last_change":"2023-11-28T21:08:10.228574+0000","last_active":"2023-11-28T21:08:11.427688+0000","last_peered":"2023-11-28T21:08:11.427688+0000","last_clean":"2023-11-28T21:08:11.427688+0000","last_became_active":"2023-11-28T21:08:10.228233+0000","last_became_peered":"2023-11-28T21:08:10.228233+0000","last_unstale":"2023-11-28T21:08:11.427688+0000","last_undegraded":"2023-11-28T21:08:11.427688+0000","last_fullsized":"2023-11-28T21:08:11.427688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:55:52.862412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197974+0000","last_change":"2023-11-28T21:08:09.412110+0000","last_active":"2023-11-28T21:08:11.197974+0000","last_peered":"2023-11-28T21:08:11.197974+0000","last_clean":"2023-11-28T21:08:11.197974+0000","last_became_active":"2023-11-28T21:08:09.411775+0000","last_became_peered":"2023-11-28T21:08:09.411775+0000","last_unstale":"2023-11-28T21:08:11.197974+0000","last_undegraded":"2023-11-28T21:08:11.197974+0000","last_fullsized":"2023-11-28T21:08:11.197974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:36:51.690241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428422+0000","last_change":"2023-11-28T21:08:10.226232+0000","last_active":"2023-11-28T21:08:11.428422+0000","last_peered":"2023-11-28T21:08:11.428422+0000","last_clean":"2023-11-28T21:08:11.428422+0000","last_became_active":"2023-11-28T21:08:10.225427+0000","last_became_peered":"2023-11-28T21:08:10.225427+0000","last_unstale":"2023-11-28T21:08:11.428422+0000","last_undegraded":"2023-11-28T21:08:11.428422+0000","last_fullsized":"2023-11-28T21:08:11.428422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:03.816068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425869+0000","last_change":"2023-11-28T21:08:09.414676+0000","last_active":"2023-11-28T21:08:11.425869+0000","last_peered":"2023-11-28T21:08:11.425869+0000","last_clean":"2023-11-28T21:08:11.425869+0000","last_became_active":"2023-11-28T21:08:09.414376+0000","last_became_peered":"2023-11-28T21:08:09.414376+0000","last_unstale":"2023-11-28T21:08:11.425869+0000","last_undegraded":"2023-11-28T21:08:11.425869+0000","last_fullsized":"2023-11-28T21:08:11.425869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:18:25.360796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428963+0000","last_change":"2023-11-28T21:08:10.228599+0000","last_active":"2023-11-28T21:08:11.428963+0000","last_peered":"2023-11-28T21:08:11.428963+0000","last_clean":"2023-11-28T21:08:11.428963+0000","last_became_active":"2023-11-28T21:08:10.228211+0000","last_became_peered":"2023-11-28T21:08:10.228211+0000","last_unstale":"2023-11-28T21:08:11.428963+0000","last_undegraded":"2023-11-28T21:08:11.428963+0000","last_fullsized":"2023-11-28T21:08:11.428963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:06:10.717892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193206+0000","last_change":"2023-11-28T21:08:09.412288+0000","last_active":"2023-11-28T21:08:11.193206+0000","last_peered":"2023-11-28T21:08:11.193206+0000","last_clean":"2023-11-28T21:08:11.193206+0000","last_became_active":"2023-11-28T21:08:09.411979+0000","last_became_peered":"2023-11-28T21:08:09.411979+0000","last_unstale":"2023-11-28T21:08:11.193206+0000","last_undegraded":"2023-11-28T21:08:11.193206+0000","last_fullsized":"2023-11-28T21:08:11.193206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429188+0000","last_change":"2023-11-28T21:08:10.217612+0000","last_active":"2023-11-28T21:08:11.429188+0000","last_peered":"2023-11-28T21:08:11.429188+0000","last_clean":"2023-11-28T21:08:11.429188+0000","last_became_active":"2023-11-28T21:08:10.217135+0000","last_became_peered":"2023-11-28T21:08:10.217135+0000","last_unstale":"2023-11-28T21:08:11.429188+0000","last_undegraded":"2023-11-28T21:08:11.429188+0000","last_fullsized":"2023-11-28T21:08:11.429188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:32:56.497214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425780+0000","last_change":"2023-11-28T21:08:09.412915+0000","last_active":"2023-11-28T21:08:11.425780+0000","last_peered":"2023-11-28T21:08:11.425780+0000","last_clean":"2023-11-28T21:08:11.425780+0000","last_became_active":"2023-11-28T21:08:09.412526+0000","last_became_peered":"2023-11-28T21:08:09.412526+0000","last_unstale":"2023-11-28T21:08:11.425780+0000","last_undegraded":"2023-11-28T21:08:11.425780+0000","last_fullsized":"2023-11-28T21:08:11.425780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:46:22.819533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428899+0000","last_change":"2023-11-28T21:08:10.224859+0000","last_active":"2023-11-28T21:08:11.428899+0000","last_peered":"2023-11-28T21:08:11.428899+0000","last_clean":"2023-11-28T21:08:11.428899+0000","last_became_active":"2023-11-28T21:08:10.223472+0000","last_became_peered":"2023-11-28T21:08:10.223472+0000","last_unstale":"2023-11-28T21:08:11.428899+0000","last_undegraded":"2023-11-28T21:08:11.428899+0000","last_fullsized":"2023-11-28T21:08:11.428899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:58:44.649741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T21:08:10.207024+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-28T21:08:10.207024+0000","last_peered":"2023-11-28T21:08:10.207024+0000","last_clean":"2023-11-28T21:08:10.207024+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-28T21:08:10.207024+0000","last_undegraded":"2023-11-28T21:08:10.207024+0000","last_fullsized":"2023-11-28T21:08:10.207024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427645+0000","last_change":"2023-11-28T21:08:09.410476+0000","last_active":"2023-11-28T21:08:11.427645+0000","last_peered":"2023-11-28T21:08:11.427645+0000","last_clean":"2023-11-28T21:08:11.427645+0000","last_became_active":"2023-11-28T21:08:09.410187+0000","last_became_peered":"2023-11-28T21:08:09.410187+0000","last_unstale":"2023-11-28T21:08:11.427645+0000","last_undegraded":"2023-11-28T21:08:11.427645+0000","last_fullsized":"2023-11-28T21:08:11.427645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:30.479292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427140+0000","last_change":"2023-11-28T21:08:10.217383+0000","last_active":"2023-11-28T21:08:11.427140+0000","last_peered":"2023-11-28T21:08:11.427140+0000","last_clean":"2023-11-28T21:08:11.427140+0000","last_became_active":"2023-11-28T21:08:10.216734+0000","last_became_peered":"2023-11-28T21:08:10.216734+0000","last_unstale":"2023-11-28T21:08:11.427140+0000","last_undegraded":"2023-11-28T21:08:11.427140+0000","last_fullsized":"2023-11-28T21:08:11.427140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:01.305338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427737+0000","last_change":"2023-11-28T21:08:09.420964+0000","last_active":"2023-11-28T21:08:11.427737+0000","last_peered":"2023-11-28T21:08:11.427737+0000","last_clean":"2023-11-28T21:08:11.427737+0000","last_became_active":"2023-11-28T21:08:09.420579+0000","last_became_peered":"2023-11-28T21:08:09.420579+0000","last_unstale":"2023-11-28T21:08:11.427737+0000","last_undegraded":"2023-11-28T21:08:11.427737+0000","last_fullsized":"2023-11-28T21:08:11.427737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:25:09.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425829+0000","last_change":"2023-11-28T21:08:10.204009+0000","last_active":"2023-11-28T21:08:11.425829+0000","last_peered":"2023-11-28T21:08:11.425829+0000","last_clean":"2023-11-28T21:08:11.425829+0000","last_became_active":"2023-11-28T21:08:10.203603+0000","last_became_peered":"2023-11-28T21:08:10.203603+0000","last_unstale":"2023-11-28T21:08:11.425829+0000","last_undegraded":"2023-11-28T21:08:11.425829+0000","last_fullsized":"2023-11-28T21:08:11.425829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:53.174867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.425911+0000","last_change":"2023-11-28T21:08:09.411899+0000","last_active":"2023-11-28T21:08:11.425911+0000","last_peered":"2023-11-28T21:08:11.425911+0000","last_clean":"2023-11-28T21:08:11.425911+0000","last_became_active":"2023-11-28T21:08:09.411555+0000","last_became_peered":"2023-11-28T21:08:09.411555+0000","last_unstale":"2023-11-28T21:08:11.425911+0000","last_undegraded":"2023-11-28T21:08:11.425911+0000","last_fullsized":"2023-11-28T21:08:11.425911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:41.385513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192833+0000","last_change":"2023-11-28T21:08:10.209590+0000","last_active":"2023-11-28T21:08:11.192833+0000","last_peered":"2023-11-28T21:08:11.192833+0000","last_clean":"2023-11-28T21:08:11.192833+0000","last_became_active":"2023-11-28T21:08:10.209147+0000","last_became_peered":"2023-11-28T21:08:10.209147+0000","last_unstale":"2023-11-28T21:08:11.192833+0000","last_undegraded":"2023-11-28T21:08:11.192833+0000","last_fullsized":"2023-11-28T21:08:11.192833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:31.482317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428982+0000","last_change":"2023-11-28T21:08:09.410466+0000","last_active":"2023-11-28T21:08:11.428982+0000","last_peered":"2023-11-28T21:08:11.428982+0000","last_clean":"2023-11-28T21:08:11.428982+0000","last_became_active":"2023-11-28T21:08:09.407914+0000","last_became_peered":"2023-11-28T21:08:09.407914+0000","last_unstale":"2023-11-28T21:08:11.428982+0000","last_undegraded":"2023-11-28T21:08:11.428982+0000","last_fullsized":"2023-11-28T21:08:11.428982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:43.201299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197885+0000","last_change":"2023-11-28T21:08:10.207622+0000","last_active":"2023-11-28T21:08:11.197885+0000","last_peered":"2023-11-28T21:08:11.197885+0000","last_clean":"2023-11-28T21:08:11.197885+0000","last_became_active":"2023-11-28T21:08:10.207211+0000","last_became_peered":"2023-11-28T21:08:10.207211+0000","last_unstale":"2023-11-28T21:08:11.197885+0000","last_undegraded":"2023-11-28T21:08:11.197885+0000","last_fullsized":"2023-11-28T21:08:11.197885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:05:19.158104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193185+0000","last_change":"2023-11-28T21:08:09.409041+0000","last_active":"2023-11-28T21:08:11.193185+0000","last_peered":"2023-11-28T21:08:11.193185+0000","last_clean":"2023-11-28T21:08:11.193185+0000","last_became_active":"2023-11-28T21:08:09.408341+0000","last_became_peered":"2023-11-28T21:08:09.408341+0000","last_unstale":"2023-11-28T21:08:11.193185+0000","last_undegraded":"2023-11-28T21:08:11.193185+0000","last_fullsized":"2023-11-28T21:08:11.193185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:53:00.960088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428794+0000","last_change":"2023-11-28T21:08:10.214773+0000","last_active":"2023-11-28T21:08:11.428794+0000","last_peered":"2023-11-28T21:08:11.428794+0000","last_clean":"2023-11-28T21:08:11.428794+0000","last_became_active":"2023-11-28T21:08:10.213536+0000","last_became_peered":"2023-11-28T21:08:10.213536+0000","last_unstale":"2023-11-28T21:08:11.428794+0000","last_undegraded":"2023-11-28T21:08:11.428794+0000","last_fullsized":"2023-11-28T21:08:11.428794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:01.331246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.429147+0000","last_change":"2023-11-28T21:08:09.420838+0000","last_active":"2023-11-28T21:08:11.429147+0000","last_peered":"2023-11-28T21:08:11.429147+0000","last_clean":"2023-11-28T21:08:11.429147+0000","last_became_active":"2023-11-28T21:08:09.420573+0000","last_became_peered":"2023-11-28T21:08:09.420573+0000","last_unstale":"2023-11-28T21:08:11.429147+0000","last_undegraded":"2023-11-28T21:08:11.429147+0000","last_fullsized":"2023-11-28T21:08:11.429147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:21.623627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193010+0000","last_change":"2023-11-28T21:08:10.210874+0000","last_active":"2023-11-28T21:08:11.193010+0000","last_peered":"2023-11-28T21:08:11.193010+0000","last_clean":"2023-11-28T21:08:11.193010+0000","last_became_active":"2023-11-28T21:08:10.210568+0000","last_became_peered":"2023-11-28T21:08:10.210568+0000","last_unstale":"2023-11-28T21:08:11.193010+0000","last_undegraded":"2023-11-28T21:08:11.193010+0000","last_fullsized":"2023-11-28T21:08:11.193010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:14:44.204323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.681453+0000","last_change":"2023-11-28T21:08:09.401418+0000","last_active":"2023-11-28T21:08:11.681453+0000","last_peered":"2023-11-28T21:08:11.681453+0000","last_clean":"2023-11-28T21:08:11.681453+0000","last_became_active":"2023-11-28T21:08:09.400985+0000","last_became_peered":"2023-11-28T21:08:09.400985+0000","last_unstale":"2023-11-28T21:08:11.681453+0000","last_undegraded":"2023-11-28T21:08:11.681453+0000","last_fullsized":"2023-11-28T21:08:11.681453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:37.553726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427625+0000","last_change":"2023-11-28T21:08:10.226340+0000","last_active":"2023-11-28T21:08:11.427625+0000","last_peered":"2023-11-28T21:08:11.427625+0000","last_clean":"2023-11-28T21:08:11.427625+0000","last_became_active":"2023-11-28T21:08:10.226076+0000","last_became_peered":"2023-11-28T21:08:10.226076+0000","last_unstale":"2023-11-28T21:08:11.427625+0000","last_undegraded":"2023-11-28T21:08:11.427625+0000","last_fullsized":"2023-11-28T21:08:11.427625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:55:43.036114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.198424+0000","last_change":"2023-11-28T21:08:09.412010+0000","last_active":"2023-11-28T21:08:11.198424+0000","last_peered":"2023-11-28T21:08:11.198424+0000","last_clean":"2023-11-28T21:08:11.198424+0000","last_became_active":"2023-11-28T21:08:09.411717+0000","last_became_peered":"2023-11-28T21:08:09.411717+0000","last_unstale":"2023-11-28T21:08:11.198424+0000","last_undegraded":"2023-11-28T21:08:11.198424+0000","last_fullsized":"2023-11-28T21:08:11.198424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426552+0000","last_change":"2023-11-28T21:08:10.212660+0000","last_active":"2023-11-28T21:08:11.426552+0000","last_peered":"2023-11-28T21:08:11.426552+0000","last_clean":"2023-11-28T21:08:11.426552+0000","last_became_active":"2023-11-28T21:08:10.212355+0000","last_became_peered":"2023-11-28T21:08:10.212355+0000","last_unstale":"2023-11-28T21:08:11.426552+0000","last_undegraded":"2023-11-28T21:08:11.426552+0000","last_fullsized":"2023-11-28T21:08:11.426552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:00:01.305338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427462+0000","last_change":"2023-11-28T21:08:09.419375+0000","last_active":"2023-11-28T21:08:11.427462+0000","last_peered":"2023-11-28T21:08:11.427462+0000","last_clean":"2023-11-28T21:08:11.427462+0000","last_became_active":"2023-11-28T21:08:09.419142+0000","last_became_peered":"2023-11-28T21:08:09.419142+0000","last_unstale":"2023-11-28T21:08:11.427462+0000","last_undegraded":"2023-11-28T21:08:11.427462+0000","last_fullsized":"2023-11-28T21:08:11.427462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:42:10.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197815+0000","last_change":"2023-11-28T21:08:10.214305+0000","last_active":"2023-11-28T21:08:11.197815+0000","last_peered":"2023-11-28T21:08:11.197815+0000","last_clean":"2023-11-28T21:08:11.197815+0000","last_became_active":"2023-11-28T21:08:10.211723+0000","last_became_peered":"2023-11-28T21:08:10.211723+0000","last_unstale":"2023-11-28T21:08:11.197815+0000","last_undegraded":"2023-11-28T21:08:11.197815+0000","last_fullsized":"2023-11-28T21:08:11.197815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:42.388537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.192883+0000","last_change":"2023-11-28T21:08:09.405284+0000","last_active":"2023-11-28T21:08:11.192883+0000","last_peered":"2023-11-28T21:08:11.192883+0000","last_clean":"2023-11-28T21:08:11.192883+0000","last_became_active":"2023-11-28T21:08:09.404853+0000","last_became_peered":"2023-11-28T21:08:09.404853+0000","last_unstale":"2023-11-28T21:08:11.192883+0000","last_undegraded":"2023-11-28T21:08:11.192883+0000","last_fullsized":"2023-11-28T21:08:11.192883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:41:22.294086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426947+0000","last_change":"2023-11-28T21:08:10.214946+0000","last_active":"2023-11-28T21:08:11.426947+0000","last_peered":"2023-11-28T21:08:11.426947+0000","last_clean":"2023-11-28T21:08:11.426947+0000","last_became_active":"2023-11-28T21:08:10.214613+0000","last_became_peered":"2023-11-28T21:08:10.214613+0000","last_unstale":"2023-11-28T21:08:11.426947+0000","last_undegraded":"2023-11-28T21:08:11.426947+0000","last_fullsized":"2023-11-28T21:08:11.426947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:43:54.997585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.193073+0000","last_change":"2023-11-28T21:08:09.414632+0000","last_active":"2023-11-28T21:08:11.193073+0000","last_peered":"2023-11-28T21:08:11.193073+0000","last_clean":"2023-11-28T21:08:11.193073+0000","last_became_active":"2023-11-28T21:08:09.414302+0000","last_became_peered":"2023-11-28T21:08:09.414302+0000","last_unstale":"2023-11-28T21:08:11.193073+0000","last_undegraded":"2023-11-28T21:08:11.193073+0000","last_fullsized":"2023-11-28T21:08:11.193073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:10:41.385513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427365+0000","last_change":"2023-11-28T21:08:10.215986+0000","last_active":"2023-11-28T21:08:11.427365+0000","last_peered":"2023-11-28T21:08:11.427365+0000","last_clean":"2023-11-28T21:08:11.427365+0000","last_became_active":"2023-11-28T21:08:10.215655+0000","last_became_peered":"2023-11-28T21:08:10.215655+0000","last_unstale":"2023-11-28T21:08:11.427365+0000","last_undegraded":"2023-11-28T21:08:11.427365+0000","last_fullsized":"2023-11-28T21:08:11.427365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:22:29.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428073+0000","last_change":"2023-11-28T21:08:09.418940+0000","last_active":"2023-11-28T21:08:11.428073+0000","last_peered":"2023-11-28T21:08:11.428073+0000","last_clean":"2023-11-28T21:08:11.428073+0000","last_became_active":"2023-11-28T21:08:09.418536+0000","last_became_peered":"2023-11-28T21:08:09.418536+0000","last_unstale":"2023-11-28T21:08:11.428073+0000","last_undegraded":"2023-11-28T21:08:11.428073+0000","last_fullsized":"2023-11-28T21:08:11.428073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:48:37.553726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.197420+0000","last_change":"2023-11-28T21:08:10.207057+0000","last_active":"2023-11-28T21:08:11.197420+0000","last_peered":"2023-11-28T21:08:11.197420+0000","last_clean":"2023-11-28T21:08:11.197420+0000","last_became_active":"2023-11-28T21:08:10.206752+0000","last_became_peered":"2023-11-28T21:08:10.206752+0000","last_unstale":"2023-11-28T21:08:11.197420+0000","last_undegraded":"2023-11-28T21:08:11.197420+0000","last_fullsized":"2023-11-28T21:08:11.197420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:34:31.482317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428649+0000","last_change":"2023-11-28T21:08:10.218700+0000","last_active":"2023-11-28T21:08:11.428649+0000","last_peered":"2023-11-28T21:08:11.428649+0000","last_clean":"2023-11-28T21:08:11.428649+0000","last_became_active":"2023-11-28T21:08:10.218416+0000","last_became_peered":"2023-11-28T21:08:10.218416+0000","last_unstale":"2023-11-28T21:08:11.428649+0000","last_undegraded":"2023-11-28T21:08:11.428649+0000","last_fullsized":"2023-11-28T21:08:11.428649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:56:22.992496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428489+0000","last_change":"2023-11-28T21:08:09.419949+0000","last_active":"2023-11-28T21:08:11.428489+0000","last_peered":"2023-11-28T21:08:11.428489+0000","last_clean":"2023-11-28T21:08:11.428489+0000","last_became_active":"2023-11-28T21:08:09.419653+0000","last_became_peered":"2023-11-28T21:08:09.419653+0000","last_unstale":"2023-11-28T21:08:11.428489+0000","last_undegraded":"2023-11-28T21:08:11.428489+0000","last_fullsized":"2023-11-28T21:08:11.428489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:26.041569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428123+0000","last_change":"2023-11-28T21:08:10.222142+0000","last_active":"2023-11-28T21:08:11.428123+0000","last_peered":"2023-11-28T21:08:11.428123+0000","last_clean":"2023-11-28T21:08:11.428123+0000","last_became_active":"2023-11-28T21:08:10.221893+0000","last_became_peered":"2023-11-28T21:08:10.221893+0000","last_unstale":"2023-11-28T21:08:11.428123+0000","last_undegraded":"2023-11-28T21:08:11.428123+0000","last_fullsized":"2023-11-28T21:08:11.428123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:38:04.834063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.428997+0000","last_change":"2023-11-28T21:08:09.418923+0000","last_active":"2023-11-28T21:08:11.428997+0000","last_peered":"2023-11-28T21:08:11.428997+0000","last_clean":"2023-11-28T21:08:11.428997+0000","last_became_active":"2023-11-28T21:08:09.418551+0000","last_became_peered":"2023-11-28T21:08:09.418551+0000","last_unstale":"2023-11-28T21:08:11.428997+0000","last_undegraded":"2023-11-28T21:08:11.428997+0000","last_fullsized":"2023-11-28T21:08:11.428997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:06.363411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426640+0000","last_change":"2023-11-28T21:08:10.220292+0000","last_active":"2023-11-28T21:08:11.426640+0000","last_peered":"2023-11-28T21:08:11.426640+0000","last_clean":"2023-11-28T21:08:11.426640+0000","last_became_active":"2023-11-28T21:08:10.219942+0000","last_became_peered":"2023-11-28T21:08:10.219942+0000","last_unstale":"2023-11-28T21:08:11.426640+0000","last_undegraded":"2023-11-28T21:08:11.426640+0000","last_fullsized":"2023-11-28T21:08:11.426640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:58.192436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427644+0000","last_change":"2023-11-28T21:08:09.412597+0000","last_active":"2023-11-28T21:08:11.427644+0000","last_peered":"2023-11-28T21:08:11.427644+0000","last_clean":"2023-11-28T21:08:11.427644+0000","last_became_active":"2023-11-28T21:08:09.412283+0000","last_became_peered":"2023-11-28T21:08:09.412283+0000","last_unstale":"2023-11-28T21:08:11.427644+0000","last_undegraded":"2023-11-28T21:08:11.427644+0000","last_fullsized":"2023-11-28T21:08:11.427644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:08:48.155910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.427484+0000","last_change":"2023-11-28T21:08:10.213534+0000","last_active":"2023-11-28T21:08:11.427484+0000","last_peered":"2023-11-28T21:08:11.427484+0000","last_clean":"2023-11-28T21:08:11.427484+0000","last_became_active":"2023-11-28T21:08:10.213241+0000","last_became_peered":"2023-11-28T21:08:10.213241+0000","last_unstale":"2023-11-28T21:08:11.427484+0000","last_undegraded":"2023-11-28T21:08:11.427484+0000","last_fullsized":"2023-11-28T21:08:11.427484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:09.374791+0000","last_clean_scrub_stamp":"2023-11-28T21:08:09.374791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T21:08:11.426727+0000","last_change":"2023-11-28T21:08:09.410083+0000","last_active":"2023-11-28T21:08:11.426727+0000","last_peered":"2023-11-28T21:08:11.426727+0000","last_clean":"2023-11-28T21:08:11.426727+0000","last_became_active":"2023-11-28T21:08:09.409731+0000","last_became_peered":"2023-11-28T21:08:09.409731+0000","last_unstale":"2023-11-28T21:08:11.426727+0000","last_undegraded":"2023-11-28T21:08:11.426727+0000","last_fullsized":"2023-11-28T21:08:11.426727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:08:08.371766+0000","last_clean_scrub_stamp":"2023-11-28T21:08:08.371766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:15:05.177983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":72305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":72341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.637}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":72215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.113}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.4770000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0789999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5730000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7190000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7350000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4640000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":663221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:08:19.672 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T21:08:19.672 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T21:08:19.672 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T21:08:19.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T21:08:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df6fe6640 1 Processor -- start 2023-11-28T21:08:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df6fe6640 1 -- start start 2023-11-28T21:08:19.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df6fe6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df0160ac0 0x7f0df00d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df6fe6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0df00cfb10 0x7f0df00cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df6fe6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00d4050 con 0x7f0df00ce810 2023-11-28T21:08:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df6fe6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00d0500 con 0x7f0df00cfb10 2023-11-28T21:08:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df6fe6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00b43b0 con 0x7f0df0160ac0 2023-11-28T21:08:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0deffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0df00ce810 0x7f0df00b5f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40292/0 (socket says 172.21.15.6:40292) 2023-11-28T21:08:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0deffff640 1 -- 172.21.15.6:0/380736281 learned_addr learned my addr 172.21.15.6:0/380736281 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df4d82640 1 --2- 172.21.15.6:0/380736281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df0160ac0 0x7f0df00d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df5583640 1 --2- 172.21.15.6:0/380736281 >> v2:172.21.15.31:3300/0 conn(0x7f0df00cfb10 0x7f0df00cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0def7fe640 1 -- 172.21.15.6:0/380736281 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291643672 0 0) 0x7f0ddc001120 con 0x7f0df00ce810 2023-11-28T21:08:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0def7fe640 1 -- 172.21.15.6:0/380736281 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de0003530 con 0x7f0df00ce810 2023-11-28T21:08:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df5583640 1 -- 172.21.15.6:0/380736281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df0160ac0 msgr2=0x7f0df00d3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df5583640 1 --2- 172.21.15.6:0/380736281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df0160ac0 0x7f0df00d3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df5583640 1 -- 172.21.15.6:0/380736281 >> v1:172.21.15.6:6789/0 conn(0x7f0df00ce810 legacy=0x7f0df00b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.843+0000 7f0df5583640 1 -- 172.21.15.6:0/380736281 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df00cecf0 con 0x7f0df00cfb10 2023-11-28T21:08:19.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0df5583640 1 --2- 172.21.15.6:0/380736281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0df00cfb10 0x7f0df00cffc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009d90 tx=0x7f0de801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad545a5644a2f84 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0def7fe640 1 -- 172.21.15.6:0/380736281 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de80a5900 con 0x7f0df00cfb10 2023-11-28T21:08:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0def7fe640 1 -- 172.21.15.6:0/380736281 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de80a5a60 con 0x7f0df00cfb10 2023-11-28T21:08:19.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0def7fe640 1 -- 172.21.15.6:0/380736281 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de80a5df0 con 0x7f0df00cfb10 2023-11-28T21:08:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0df6fe6640 1 -- 172.21.15.6:0/380736281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0df00cfb10 msgr2=0x7f0df00cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0df6fe6640 1 --2- 172.21.15.6:0/380736281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0df00cfb10 0x7f0df00cffc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009d90 tx=0x7f0de801c950 comp rx=0 tx=0).stop 2023-11-28T21:08:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0df6fe6640 1 -- 172.21.15.6:0/380736281 shutdown_connections 2023-11-28T21:08:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0df6fe6640 1 --2- 172.21.15.6:0/380736281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0df00cfb10 0x7f0df00cffc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0df6fe6640 1 --2- 172.21.15.6:0/380736281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df0160ac0 0x7f0df00d3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0df6fe6640 1 -- 172.21.15.6:0/380736281 >> 172.21.15.6:0/380736281 conn(0x7f0df009c480 msgr2=0x7f0df00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0df6fe6640 1 -- 172.21.15.6:0/380736281 shutdown_connections 2023-11-28T21:08:19.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.847+0000 7f0df6fe6640 1 -- 172.21.15.6:0/380736281 wait complete. 2023-11-28T21:08:19.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df6fe6640 1 Processor -- start 2023-11-28T21:08:19.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df6fe6640 1 -- start start 2023-11-28T21:08:19.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df6fe6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0df00ce810 0x7f0df00cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df6fe6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df00cfb10 0x7f0df01f9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df6fe6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df0160ac0 0x7f0df01f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df6fe6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df015b430 con 0x7f0df0160ac0 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df6fe6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df015bf20 con 0x7f0df00ce810 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df6fe6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df015b680 con 0x7f0df00cfb10 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df5583640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df0160ac0 0x7f0df01f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df5583640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df0160ac0 0x7f0df01f9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49266/0 (socket says 172.21.15.6:49266) 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df5583640 1 -- 172.21.15.6:0/973829129 learned_addr learned my addr 172.21.15.6:0/973829129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df4d82640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0df00ce810 0x7f0df00cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0deffff640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df00cfb10 0x7f0df01f9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df5583640 1 -- 172.21.15.6:0/973829129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df00cfb10 msgr2=0x7f0df01f9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df5583640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df00cfb10 0x7f0df01f9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df5583640 1 -- 172.21.15.6:0/973829129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0df00ce810 msgr2=0x7f0df00cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df5583640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0df00ce810 0x7f0df00cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df5583640 1 -- 172.21.15.6:0/973829129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8009a70 con 0x7f0df0160ac0 2023-11-28T21:08:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0deffff640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df00cfb10 0x7f0df01f9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df5583640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df0160ac0 0x7f0df01f9a40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009d90 tx=0x7f0de80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0ded7fa640 1 -- 172.21.15.6:0/973829129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de80b9860 con 0x7f0df0160ac0 2023-11-28T21:08:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0ded7fa640 1 -- 172.21.15.6:0/973829129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de80b99c0 con 0x7f0df0160ac0 2023-11-28T21:08:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0ded7fa640 1 -- 172.21.15.6:0/973829129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de80b9d70 con 0x7f0df0160ac0 2023-11-28T21:08:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.851+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df015b960 con 0x7f0df0160ac0 2023-11-28T21:08:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.855+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df00cb3a0 con 0x7f0df0160ac0 2023-11-28T21:08:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.855+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df00cb590 con 0x7f0df0160ac0 2023-11-28T21:08:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.855+0000 7f0ded7fa640 1 -- 172.21.15.6:0/973829129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0de80ad440 con 0x7f0df0160ac0 2023-11-28T21:08:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.855+0000 7f0ded7fa640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0dd40664a0 0x7f0dd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.855+0000 7f0ded7fa640 1 -- 172.21.15.6:0/973829129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0de811eae0 con 0x7f0df0160ac0 2023-11-28T21:08:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.855+0000 7f0df4d82640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0dd40664a0 0x7f0dd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.855+0000 7f0df4d82640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0dd40664a0 0x7f0dd4068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0df015c4f0 tx=0x7f0de4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:19.859+0000 7f0ded7fa640 1 -- 172.21.15.6:0/973829129 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0df00cb590 con 0x7f0df0160ac0 2023-11-28T21:08:20.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.051+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0df00cb590 con 0x7f0df0160ac0 2023-11-28T21:08:20.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0ded7fa640 1 -- 172.21.15.6:0/973829129 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0df00cb590 con 0x7f0df0160ac0 2023-11-28T21:08:20.059 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:20.060 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T21:08:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0dd40664a0 msgr2=0x7f0dd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0dd40664a0 0x7f0dd4068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0df015c4f0 tx=0x7f0de4009190 comp rx=0 tx=0).stop 2023-11-28T21:08:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df0160ac0 msgr2=0x7f0df01f9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df0160ac0 0x7f0df01f9a40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009d90 tx=0x7f0de80196f0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 shutdown_connections 2023-11-28T21:08:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0dd40664a0 0x7f0dd4068960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df0160ac0 0x7f0df01f9a40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0df00cfb10 0x7f0df01f9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 --2- 172.21.15.6:0/973829129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0df00ce810 0x7f0df00cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 >> 172.21.15.6:0/973829129 conn(0x7f0df009c480 msgr2=0x7f0df00b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 shutdown_connections 2023-11-28T21:08:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.055+0000 7f0df6fe6640 1 -- 172.21.15.6:0/973829129 wait complete. 2023-11-28T21:08:20.081 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T21:08:20.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.219+0000 7f2c15bf8640 1 Processor -- start 2023-11-28T21:08:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.219+0000 7f2c15bf8640 1 -- start start 2023-11-28T21:08:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c15bf8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c1013cf70 0x7f2c100cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c15bf8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c100cbce0 0x7f2c1015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c15bf8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c100cc140 con 0x7f2c1015abe0 2023-11-28T21:08:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c15bf8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1013f6f0 con 0x7f2c1013cf70 2023-11-28T21:08:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c15bf8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1013f900 con 0x7f2c100cbce0 2023-11-28T21:08:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c0effd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c100cbce0 0x7f2c1015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c0f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c1013cf70 0x7f2c100cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c0effd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c100cbce0 0x7f2c1015a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:39446/0 (socket says 172.21.15.6:39446) 2023-11-28T21:08:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c0effd640 1 -- 172.21.15.6:0/3537326049 learned_addr learned my addr 172.21.15.6:0/3537326049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c0effd640 1 -- 172.21.15.6:0/3537326049 >> v2:172.21.15.31:3300/0 conn(0x7f2c1013cf70 msgr2=0x7f2c100cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c0effd640 1 --2- 172.21.15.6:0/3537326049 >> v2:172.21.15.31:3300/0 conn(0x7f2c1013cf70 0x7f2c100cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c0effd640 1 -- 172.21.15.6:0/3537326049 >> v1:172.21.15.31:6789/0 conn(0x7f2c1015abe0 legacy=0x7f2c1015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c0e7fc640 1 -- 172.21.15.6:0/3537326049 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826197791 0 0) 0x7f2c100cc140 con 0x7f2c1015abe0 2023-11-28T21:08:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.223+0000 7f2c0effd640 1 -- 172.21.15.6:0/3537326049 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1013fbe0 con 0x7f2c100cbce0 2023-11-28T21:08:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c0effd640 1 --2- 172.21.15.6:0/3537326049 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c100cbce0 0x7f2c1015a6a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009870 tx=0x7f2c0401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572bb5b910a1927d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c0e7fc640 1 -- 172.21.15.6:0/3537326049 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c040a8a30 con 0x7f2c100cbce0 2023-11-28T21:08:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c0e7fc640 1 -- 172.21.15.6:0/3537326049 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c040a8b90 con 0x7f2c100cbce0 2023-11-28T21:08:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c0e7fc640 1 -- 172.21.15.6:0/3537326049 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c040b0440 con 0x7f2c100cbce0 2023-11-28T21:08:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3537326049 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c100cbce0 msgr2=0x7f2c1015a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c15bf8640 1 --2- 172.21.15.6:0/3537326049 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c100cbce0 0x7f2c1015a6a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009870 tx=0x7f2c0401ed30 comp rx=0 tx=0).stop 2023-11-28T21:08:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3537326049 shutdown_connections 2023-11-28T21:08:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c15bf8640 1 --2- 172.21.15.6:0/3537326049 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c100cbce0 0x7f2c1015a6a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c15bf8640 1 --2- 172.21.15.6:0/3537326049 >> v2:172.21.15.31:3300/0 conn(0x7f2c1013cf70 0x7f2c100cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3537326049 >> 172.21.15.6:0/3537326049 conn(0x7f2c1006c5c0 msgr2=0x7f2c1006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3537326049 shutdown_connections 2023-11-28T21:08:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.227+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3537326049 wait complete. 2023-11-28T21:08:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 Processor -- start 2023-11-28T21:08:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 -- start start 2023-11-28T21:08:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c100cbce0 0x7f2c100b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c1013cf70 0x7f2c101572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c1015abe0 0x7f2c10142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100afe60 con 0x7f2c1015abe0 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100b0140 con 0x7f2c100cbce0 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10137320 con 0x7f2c1013cf70 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c1015abe0 0x7f2c10142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c1015abe0 0x7f2c10142ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49280/0 (socket says 172.21.15.6:49280) 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0ffff640 1 -- 172.21.15.6:0/3547364564 learned_addr learned my addr 172.21.15.6:0/3547364564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0f7fe640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c100cbce0 0x7f2c100b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0effd640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c1013cf70 0x7f2c101572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0ffff640 1 -- 172.21.15.6:0/3547364564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c1013cf70 msgr2=0x7f2c101572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0ffff640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c1013cf70 0x7f2c101572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0ffff640 1 -- 172.21.15.6:0/3547364564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c100cbce0 msgr2=0x7f2c100b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0ffff640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c100cbce0 0x7f2c100b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0ffff640 1 -- 172.21.15.6:0/3547364564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c040094d0 con 0x7f2c1015abe0 2023-11-28T21:08:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c0ffff640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c1015abe0 0x7f2c10142ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2c08002240 tx=0x7f2c0800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2bf7fff640 1 -- 172.21.15.6:0/3547364564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08003db0 con 0x7f2c1015abe0 2023-11-28T21:08:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2bf7fff640 1 -- 172.21.15.6:0/3547364564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800ce30 con 0x7f2c1015abe0 2023-11-28T21:08:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2bf7fff640 1 -- 172.21.15.6:0/3547364564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08005270 con 0x7f2c1015abe0 2023-11-28T21:08:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c10137600 con 0x7f2c1015abe0 2023-11-28T21:08:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c10157820 con 0x7f2c1015abe0 2023-11-28T21:08:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.231+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c100cc0c0 con 0x7f2c1015abe0 2023-11-28T21:08:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.235+0000 7f2bf7fff640 1 -- 172.21.15.6:0/3547364564 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c080053d0 con 0x7f2c1015abe0 2023-11-28T21:08:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.235+0000 7f2bf7fff640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2bfc066470 0x7f2bfc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.235+0000 7f2bf7fff640 1 -- 172.21.15.6:0/3547364564 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c08083580 con 0x7f2c1015abe0 2023-11-28T21:08:20.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.235+0000 7f2c0f7fe640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2bfc066470 0x7f2bfc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.235+0000 7f2c0f7fe640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2bfc066470 0x7f2bfc068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009b60 tx=0x7f2c00009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.239+0000 7f2bf7fff640 1 -- 172.21.15.6:0/3547364564 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c08050aa0 con 0x7f2c1015abe0 2023-11-28T21:08:20.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c10137180 con 0x7f2c1015abe0 2023-11-28T21:08:20.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2bf7fff640 1 -- 172.21.15.6:0/3547364564 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f2c10137180 con 0x7f2c1015abe0 2023-11-28T21:08:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:20.405 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:20.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2bfc066470 msgr2=0x7f2bfc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2bfc066470 0x7f2bfc068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009b60 tx=0x7f2c00009190 comp rx=0 tx=0).stop 2023-11-28T21:08:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c1015abe0 msgr2=0x7f2c10142ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c1015abe0 0x7f2c10142ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2c08002240 tx=0x7f2c0800cbe0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 shutdown_connections 2023-11-28T21:08:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2bfc066470 0x7f2bfc068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c1015abe0 0x7f2c10142ed0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c1013cf70 0x7f2c101572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 --2- 172.21.15.6:0/3547364564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c100cbce0 0x7f2c100b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 >> 172.21.15.6:0/3547364564 conn(0x7f2c1006c5c0 msgr2=0x7f2c1013eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:20.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 shutdown_connections 2023-11-28T21:08:20.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.399+0000 7f2c15bf8640 1 -- 172.21.15.6:0/3547364564 wait complete. 2023-11-28T21:08:20.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:20.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b7caaa640 1 Processor -- start 2023-11-28T21:08:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b7caaa640 1 -- start start 2023-11-28T21:08:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b7caaa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b780b42e0 0x7f7b7806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b7caaa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b7815e270 0x7f7b7806aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b7caaa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b78157bd0 con 0x7f7b7815d780 2023-11-28T21:08:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b7caaa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7806b000 con 0x7f7b7815e270 2023-11-28T21:08:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b7caaa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7806b2b0 con 0x7f7b780b42e0 2023-11-28T21:08:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b780b42e0 0x7f7b7806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b76d9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b7815e270 0x7f7b7806aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b780b42e0 0x7f7b7806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:39456/0 (socket says 172.21.15.6:39456) 2023-11-28T21:08:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b6ffff640 1 -- 172.21.15.6:0/3160920212 learned_addr learned my addr 172.21.15.6:0/3160920212 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b76d9d640 1 -- 172.21.15.6:0/3160920212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b780b42e0 msgr2=0x7f7b7806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b76d9d640 1 --2- 172.21.15.6:0/3160920212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b780b42e0 0x7f7b7806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b76d9d640 1 -- 172.21.15.6:0/3160920212 >> v1:172.21.15.31:6789/0 conn(0x7f7b7815d780 legacy=0x7f7b7815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b76d9d640 1 -- 172.21.15.6:0/3160920212 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7806b590 con 0x7f7b7815e270 2023-11-28T21:08:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.567+0000 7f7b75d9b640 1 -- 172.21.15.6:0/3160920212 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222805483 0 0) 0x7f7b78157bd0 con 0x7f7b7815d780 2023-11-28T21:08:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b76d9d640 1 --2- 172.21.15.6:0/3160920212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7815e270 0x7f7b7806aac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009d90 tx=0x7f7b7001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6edcaf2af970a5b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b75d9b640 1 -- 172.21.15.6:0/3160920212 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700a59e0 con 0x7f7b7815e270 2023-11-28T21:08:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b75d9b640 1 -- 172.21.15.6:0/3160920212 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b700a5b40 con 0x7f7b7815e270 2023-11-28T21:08:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b75d9b640 1 -- 172.21.15.6:0/3160920212 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700ad440 con 0x7f7b7815e270 2023-11-28T21:08:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b7caaa640 1 -- 172.21.15.6:0/3160920212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7815e270 msgr2=0x7f7b7806aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b7caaa640 1 --2- 172.21.15.6:0/3160920212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7815e270 0x7f7b7806aac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009d90 tx=0x7f7b7001c920 comp rx=0 tx=0).stop 2023-11-28T21:08:20.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b7caaa640 1 -- 172.21.15.6:0/3160920212 shutdown_connections 2023-11-28T21:08:20.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b7caaa640 1 --2- 172.21.15.6:0/3160920212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7815e270 0x7f7b7806aac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b7caaa640 1 --2- 172.21.15.6:0/3160920212 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b780b42e0 0x7f7b7806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b7caaa640 1 -- 172.21.15.6:0/3160920212 >> 172.21.15.6:0/3160920212 conn(0x7f7b780b1670 msgr2=0x7f7b780b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b7caaa640 1 -- 172.21.15.6:0/3160920212 shutdown_connections 2023-11-28T21:08:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.571+0000 7f7b7caaa640 1 -- 172.21.15.6:0/3160920212 wait complete. 2023-11-28T21:08:20.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7caaa640 1 Processor -- start 2023-11-28T21:08:20.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7caaa640 1 -- start start 2023-11-28T21:08:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7caaa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b780b42e0 0x7f7b78155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7caaa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b7815d780 0x7f7b7814c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7caaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7815e270 0x7f7b78156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7caaa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78155410 con 0x7f7b7815e270 2023-11-28T21:08:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7caaa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78157300 con 0x7f7b780b42e0 2023-11-28T21:08:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7caaa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b781575e0 con 0x7f7b7815d780 2023-11-28T21:08:20.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b76d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7815e270 0x7f7b78156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b76d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7815e270 0x7f7b78156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49284/0 (socket says 172.21.15.6:49284) 2023-11-28T21:08:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b76d9d640 1 -- 172.21.15.6:0/1379926233 learned_addr learned my addr 172.21.15.6:0/1379926233 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:20.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b6ffff640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b7815d780 0x7f7b7814c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7659c640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b780b42e0 0x7f7b78155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b76d9d640 1 -- 172.21.15.6:0/1379926233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b7815d780 msgr2=0x7f7b7814c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b76d9d640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b7815d780 0x7f7b7814c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b76d9d640 1 -- 172.21.15.6:0/1379926233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b780b42e0 msgr2=0x7f7b78155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b76d9d640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b780b42e0 0x7f7b78155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b76d9d640 1 -- 172.21.15.6:0/1379926233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b70009a70 con 0x7f7b7815e270 2023-11-28T21:08:20.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b76d9d640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7815e270 0x7f7b78156840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b7001a550 tx=0x7f7b700196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:20.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b6effd640 1 -- 172.21.15.6:0/1379926233 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70009450 con 0x7f7b7815e270 2023-11-28T21:08:20.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b6effd640 1 -- 172.21.15.6:0/1379926233 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b700adb70 con 0x7f7b7815e270 2023-11-28T21:08:20.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b6effd640 1 -- 172.21.15.6:0/1379926233 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700b8420 con 0x7f7b7815e270 2023-11-28T21:08:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.575+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b78155620 con 0x7f7b7815e270 2023-11-28T21:08:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.579+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7814e490 con 0x7f7b7815e270 2023-11-28T21:08:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.579+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b78155b40 con 0x7f7b7815e270 2023-11-28T21:08:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.579+0000 7f7b6effd640 1 -- 172.21.15.6:0/1379926233 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b700b8580 con 0x7f7b7815e270 2023-11-28T21:08:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.579+0000 7f7b6effd640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b58066470 0x7f7b58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.579+0000 7f7b6effd640 1 -- 172.21.15.6:0/1379926233 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b7011f470 con 0x7f7b7815e270 2023-11-28T21:08:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.579+0000 7f7b7659c640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b58066470 0x7f7b58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.579+0000 7f7b7659c640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b58066470 0x7f7b58068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b68000f70 tx=0x7f7b68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.583+0000 7f7b6effd640 1 -- 172.21.15.6:0/1379926233 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b78155b40 con 0x7f7b7815e270 2023-11-28T21:08:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.743+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b78155b40 con 0x7f7b7815e270 2023-11-28T21:08:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.743+0000 7f7b6effd640 1 -- 172.21.15.6:0/1379926233 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b78155b40 con 0x7f7b7815e270 2023-11-28T21:08:20.750 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b58066470 msgr2=0x7f7b58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b58066470 0x7f7b58068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b68000f70 tx=0x7f7b68009040 comp rx=0 tx=0).stop 2023-11-28T21:08:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7815e270 msgr2=0x7f7b78156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7815e270 0x7f7b78156840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b7001a550 tx=0x7f7b700196c0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 shutdown_connections 2023-11-28T21:08:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b58066470 0x7f7b58068930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7815e270 0x7f7b78156840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7b7815d780 0x7f7b7814c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 --2- 172.21.15.6:0/1379926233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b780b42e0 0x7f7b78155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 >> 172.21.15.6:0/1379926233 conn(0x7f7b780b1670 msgr2=0x7f7b780b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:20.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 shutdown_connections 2023-11-28T21:08:20.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.747+0000 7f7b7caaa640 1 -- 172.21.15.6:0/1379926233 wait complete. 2023-11-28T21:08:20.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:20.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.911+0000 7fb1657f8640 1 Processor -- start 2023-11-28T21:08:20.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.911+0000 7fb1657f8640 1 -- start start 2023-11-28T21:08:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb1657f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb16015d450 0x7fb1600cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb1657f8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600cee80 con 0x7fb1600b3320 2023-11-28T21:08:20.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb1657f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600b2170 con 0x7fb160161140 2023-11-28T21:08:20.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb1657f8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16015d880 con 0x7fb16015d450 2023-11-28T21:08:20.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1600b3320 0x7fb16015cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40304/0 (socket says 172.21.15.6:40304) 2023-11-28T21:08:20.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15f7fe640 1 -- 172.21.15.6:0/2394725064 learned_addr learned my addr 172.21.15.6:0/2394725064 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:20.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb164ff7640 1 --2- 172.21.15.6:0/2394725064 >> v2:172.21.15.31:3300/0 conn(0x7fb16015d450 0x7fb1600cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389031094 0 0) 0x7fb1600cee80 con 0x7fb1600b3320 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb148003530 con 0x7fb1600b3320 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 268636628 0 0) 0x7fb148003530 con 0x7fb1600b3320 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 >> v2:172.21.15.31:3300/0 conn(0x7fb16015d450 msgr2=0x7fb1600cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 --2- 172.21.15.6:0/2394725064 >> v2:172.21.15.31:3300/0 conn(0x7fb16015d450 0x7fb1600cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 >> v1:172.21.15.31:6789/0 conn(0x7fb160161140 legacy=0x7fb160161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16006c0a0 con 0x7fb1600b3320 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fb154001680 con 0x7fb1600b3320 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 >> v1:172.21.15.6:6789/0 conn(0x7fb1600b3320 legacy=0x7fb16015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1480039d0 0x7fb148003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1480047d0 0x7fb148004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb148005190 0x7fb14800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16015d880 con 0x7fb1480039d0 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14800c090 con 0x7fb148005190 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14800c250 con 0x7fb1480047d0 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15ffff640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1480039d0 0x7fb148003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15f7fe640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1480047d0 0x7fb148004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb164ff7640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb148005190 0x7fb14800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15ffff640 1 -- 172.21.15.6:0/2394725064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1480047d0 msgr2=0x7fb148004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15ffff640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1480047d0 0x7fb148004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15ffff640 1 -- 172.21.15.6:0/2394725064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb148005190 msgr2=0x7fb14800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15ffff640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb148005190 0x7fb14800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb15ffff640 1 -- 172.21.15.6:0/2394725064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148003530 con 0x7fb1480039d0 2023-11-28T21:08:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.915+0000 7fb164ff7640 1 -- 172.21.15.6:0/2394725064 reap_dead start 2023-11-28T21:08:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb15ffff640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1480039d0 0x7fb148003df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb150001780 tx=0x7fb15001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbde647abbb71c84 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1500052d0 con 0x7fb1480039d0 2023-11-28T21:08:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1500a7050 con 0x7fb1480039d0 2023-11-28T21:08:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb15effd640 1 -- 172.21.15.6:0/2394725064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150003600 con 0x7fb1480039d0 2023-11-28T21:08:20.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb1657f8640 1 -- 172.21.15.6:0/2394725064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1480039d0 msgr2=0x7fb148003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb1657f8640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1480039d0 0x7fb148003df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb150001780 tx=0x7fb15001c3b0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb1657f8640 1 -- 172.21.15.6:0/2394725064 shutdown_connections 2023-11-28T21:08:20.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb1657f8640 1 --2- 172.21.15.6:0/2394725064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1480039d0 0x7fb148003df0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb1657f8640 1 -- 172.21.15.6:0/2394725064 >> 172.21.15.6:0/2394725064 conn(0x7fb1600b2800 msgr2=0x7fb1600b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:20.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb1657f8640 1 -- 172.21.15.6:0/2394725064 shutdown_connections 2023-11-28T21:08:20.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb1657f8640 1 -- 172.21.15.6:0/2394725064 wait complete. 2023-11-28T21:08:20.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.919+0000 7fb1657f8640 1 Processor -- start 2023-11-28T21:08:20.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 -- start start 2023-11-28T21:08:20.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1480039d0 0x7fb16014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb160150680 0x7fb16015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb16015e510 0x7fb1600d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16014fbe0 con 0x7fb160150680 2023-11-28T21:08:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16015ea00 con 0x7fb16015e510 2023-11-28T21:08:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16014fe80 con 0x7fb1480039d0 2023-11-28T21:08:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb160150680 0x7fb16015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb160150680 0x7fb16015dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49298/0 (socket says 172.21.15.6:49298) 2023-11-28T21:08:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15f7fe640 1 -- 172.21.15.6:0/516648110 learned_addr learned my addr 172.21.15.6:0/516648110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:20.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15f7fe640 1 -- 172.21.15.6:0/516648110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1480039d0 msgr2=0x7fb16014e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15f7fe640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1480039d0 0x7fb16014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15f7fe640 1 -- 172.21.15.6:0/516648110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb16015e510 msgr2=0x7fb1600d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb164ff7640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb16015e510 0x7fb1600d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15f7fe640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb16015e510 0x7fb1600d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15f7fe640 1 -- 172.21.15.6:0/516648110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160150160 con 0x7fb160150680 2023-11-28T21:08:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15f7fe640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb160150680 0x7fb16015dfd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb154000c10 tx=0x7fb154007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15cff9640 1 -- 172.21.15.6:0/516648110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15400f730 con 0x7fb160150680 2023-11-28T21:08:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15cff9640 1 -- 172.21.15.6:0/516648110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15400f8b0 con 0x7fb160150680 2023-11-28T21:08:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb15cff9640 1 -- 172.21.15.6:0/516648110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15400fc60 con 0x7fb160150680 2023-11-28T21:08:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16015ece0 con 0x7fb160150680 2023-11-28T21:08:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16014e720 con 0x7fb160150680 2023-11-28T21:08:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.923+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16004e850 con 0x7fb160150680 2023-11-28T21:08:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.927+0000 7fb15cff9640 1 -- 172.21.15.6:0/516648110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb15401d460 con 0x7fb160150680 2023-11-28T21:08:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.927+0000 7fb15cff9640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb14c0664a0 0x7fb14c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.927+0000 7fb15cff9640 1 -- 172.21.15.6:0/516648110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb154083f80 con 0x7fb160150680 2023-11-28T21:08:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.927+0000 7fb15ffff640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb14c0664a0 0x7fb14c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.927+0000 7fb15ffff640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb14c0664a0 0x7fb14c068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb150001750 tx=0x7fb150001130 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:20.931+0000 7fb15cff9640 1 -- 172.21.15.6:0/516648110 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb154051360 con 0x7fb160150680 2023-11-28T21:08:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.095+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1600d0810 con 0x7fb160150680 2023-11-28T21:08:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.095+0000 7fb15cff9640 1 -- 172.21.15.6:0/516648110 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb154054980 con 0x7fb160150680 2023-11-28T21:08:21.101 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.095+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb14c0664a0 msgr2=0x7fb14c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.095+0000 7fb1657f8640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb14c0664a0 0x7fb14c068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb150001750 tx=0x7fb150001130 comp rx=0 tx=0).stop 2023-11-28T21:08:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.095+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb160150680 msgr2=0x7fb16015dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.095+0000 7fb1657f8640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb160150680 0x7fb16015dfd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb154000c10 tx=0x7fb154007430 comp rx=0 tx=0).stop 2023-11-28T21:08:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.099+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 shutdown_connections 2023-11-28T21:08:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.099+0000 7fb1657f8640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb14c0664a0 0x7fb14c068960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.099+0000 7fb1657f8640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb16015e510 0x7fb1600d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.099+0000 7fb1657f8640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb160150680 0x7fb16015dfd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.099+0000 7fb1657f8640 1 --2- 172.21.15.6:0/516648110 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb1480039d0 0x7fb16014e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.099+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 >> 172.21.15.6:0/516648110 conn(0x7fb1600b2800 msgr2=0x7fb1600b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.099+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 shutdown_connections 2023-11-28T21:08:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.099+0000 7fb1657f8640 1 -- 172.21.15.6:0/516648110 wait complete. 2023-11-28T21:08:21.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f480e7d8640 1 Processor -- start 2023-11-28T21:08:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f480e7d8640 1 -- start start 2023-11-28T21:08:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f480e7d8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f48080ce760 0x7f480815af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f480e7d8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48080cd9a0 con 0x7f4808157b50 2023-11-28T21:08:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f480e7d8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48080cdc80 con 0x7f4808072420 2023-11-28T21:08:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f480e7d8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4808157f30 con 0x7f48080ce760 2023-11-28T21:08:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f4807fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4808157b50 0x7f4808071d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40318/0 (socket says 172.21.15.6:40318) 2023-11-28T21:08:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f4807fff640 1 -- 172.21.15.6:0/3828144602 learned_addr learned my addr 172.21.15.6:0/3828144602 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f480cd75640 1 --2- 172.21.15.6:0/3828144602 >> v2:172.21.15.31:3300/0 conn(0x7f48080ce760 0x7f480815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.263+0000 7f4806ffd640 1 -- 172.21.15.6:0/3828144602 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278721309 0 0) 0x7f48080cd9a0 con 0x7f4808157b50 2023-11-28T21:08:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f4806ffd640 1 -- 172.21.15.6:0/3828144602 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47f0003530 con 0x7f4808157b50 2023-11-28T21:08:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f4806ffd640 1 -- 172.21.15.6:0/3828144602 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3733612662 0 0) 0x7f48080cdc80 con 0x7f4808072420 2023-11-28T21:08:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f4806ffd640 1 -- 172.21.15.6:0/3828144602 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48080cd9a0 con 0x7f4808072420 2023-11-28T21:08:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f480cd75640 1 -- 172.21.15.6:0/3828144602 >> v1:172.21.15.31:6789/0 conn(0x7f4808072420 legacy=0x7f480815a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f480cd75640 1 -- 172.21.15.6:0/3828144602 >> v1:172.21.15.6:6789/0 conn(0x7f4808157b50 legacy=0x7f4808071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f480cd75640 1 -- 172.21.15.6:0/3828144602 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48080cdf60 con 0x7f48080ce760 2023-11-28T21:08:21.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f480cd75640 1 --2- 172.21.15.6:0/3828144602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48080ce760 0x7f480815af30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4800009d90 tx=0x7f480001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5123f6f45bc5da01 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:21.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f4806ffd640 1 -- 172.21.15.6:0/3828144602 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48000a5970 con 0x7f48080ce760 2023-11-28T21:08:21.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f4806ffd640 1 -- 172.21.15.6:0/3828144602 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48000a5ad0 con 0x7f48080ce760 2023-11-28T21:08:21.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f4806ffd640 1 -- 172.21.15.6:0/3828144602 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48000a5e40 con 0x7f48080ce760 2023-11-28T21:08:21.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f480e7d8640 1 -- 172.21.15.6:0/3828144602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48080ce760 msgr2=0x7f480815af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.267+0000 7f480e7d8640 1 --2- 172.21.15.6:0/3828144602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48080ce760 0x7f480815af30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4800009d90 tx=0x7f480001c890 comp rx=0 tx=0).stop 2023-11-28T21:08:21.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 -- 172.21.15.6:0/3828144602 shutdown_connections 2023-11-28T21:08:21.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 --2- 172.21.15.6:0/3828144602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48080ce760 0x7f480815af30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 -- 172.21.15.6:0/3828144602 >> 172.21.15.6:0/3828144602 conn(0x7f480806c5c0 msgr2=0x7f480806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:21.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 -- 172.21.15.6:0/3828144602 shutdown_connections 2023-11-28T21:08:21.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 -- 172.21.15.6:0/3828144602 wait complete. 2023-11-28T21:08:21.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 Processor -- start 2023-11-28T21:08:21.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 -- start start 2023-11-28T21:08:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072420 0x7f4808146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48080ce760 0x7f48081f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4808157b50 0x7f48081f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4808146a40 con 0x7f48080ce760 2023-11-28T21:08:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48080b3e80 con 0x7f4808072420 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480e7d8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480814e1e0 con 0x7f4808157b50 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f48077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48080ce760 0x7f48081f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f48077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48080ce760 0x7f48081f9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49304/0 (socket says 172.21.15.6:49304) 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f48077fe640 1 -- 172.21.15.6:0/148836528 learned_addr learned my addr 172.21.15.6:0/148836528 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480cd75640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4808157b50 0x7f48081f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f4807fff640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072420 0x7f4808146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f48077fe640 1 -- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4808157b50 msgr2=0x7f48081f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f48077fe640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4808157b50 0x7f48081f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f48077fe640 1 -- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072420 msgr2=0x7f4808146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f48077fe640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072420 0x7f4808146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f48077fe640 1 -- 172.21.15.6:0/148836528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800009a70 con 0x7f48080ce760 2023-11-28T21:08:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f480cd75640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4808157b50 0x7f48081f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:21.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f4807fff640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072420 0x7f4808146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:21.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.271+0000 7f48077fe640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48080ce760 0x7f48081f9a80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00c3c0 tx=0x7f47fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:21.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f4804ff9640 1 -- 172.21.15.6:0/148836528 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0052d0 con 0x7f48080ce760 2023-11-28T21:08:21.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f4804ff9640 1 -- 172.21.15.6:0/148836528 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc005430 con 0x7f48080ce760 2023-11-28T21:08:21.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480814e4c0 con 0x7f48080ce760 2023-11-28T21:08:21.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f4804ff9640 1 -- 172.21.15.6:0/148836528 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc003840 con 0x7f48080ce760 2023-11-28T21:08:21.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4808156100 con 0x7f48080ce760 2023-11-28T21:08:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480814e9e0 con 0x7f48080ce760 2023-11-28T21:08:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f4804ff9640 1 -- 172.21.15.6:0/148836528 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f47fc0039a0 con 0x7f48080ce760 2023-11-28T21:08:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f4804ff9640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47f4066470 0x7f47f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f4804ff9640 1 -- 172.21.15.6:0/148836528 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47fc0834f0 con 0x7f48080ce760 2023-11-28T21:08:21.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f4807fff640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47f4066470 0x7f47f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.275+0000 7f4807fff640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47f4066470 0x7f47f4068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47f80011f0 tx=0x7f47f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:21.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.279+0000 7f4804ff9640 1 -- 172.21.15.6:0/148836528 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f480814e9e0 con 0x7f48080ce760 2023-11-28T21:08:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.435+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f480814e9e0 con 0x7f48080ce760 2023-11-28T21:08:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f4804ff9640 1 -- 172.21.15.6:0/148836528 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f480814e9e0 con 0x7f48080ce760 2023-11-28T21:08:21.443 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47f4066470 msgr2=0x7f47f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47f4066470 0x7f47f4068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47f80011f0 tx=0x7f47f8009040 comp rx=0 tx=0).stop 2023-11-28T21:08:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48080ce760 msgr2=0x7f48081f9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48080ce760 0x7f48081f9a80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00c3c0 tx=0x7f47fc00c880 comp rx=0 tx=0).stop 2023-11-28T21:08:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 shutdown_connections 2023-11-28T21:08:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47f4066470 0x7f47f4068930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4808157b50 0x7f48081f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48080ce760 0x7f48081f9a80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 --2- 172.21.15.6:0/148836528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072420 0x7f4808146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 >> 172.21.15.6:0/148836528 conn(0x7f480806c5c0 msgr2=0x7f48080adc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 shutdown_connections 2023-11-28T21:08:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.439+0000 7f480e7d8640 1 -- 172.21.15.6:0/148836528 wait complete. 2023-11-28T21:08:21.464 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:08:21.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9792c9640 1 Processor -- start 2023-11-28T21:08:21.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9792c9640 1 -- start start 2023-11-28T21:08:21.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9792c9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9740d0180 0x7ff9740b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9792c9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740b3ba0 0x7ff9740cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9792c9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9740b2700 con 0x7ff97415d5e0 2023-11-28T21:08:21.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9792c9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9740cf1f0 con 0x7ff9740d0180 2023-11-28T21:08:21.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9792c9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740cf490 con 0x7ff9740b3ba0 2023-11-28T21:08:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9727fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9740d0180 0x7ff9740b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9737fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740b3ba0 0x7ff9740cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9727fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9740d0180 0x7ff9740b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:41048/0 (socket says 172.21.15.6:41048) 2023-11-28T21:08:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9727fc640 1 -- 172.21.15.6:0/2859594628 learned_addr learned my addr 172.21.15.6:0/2859594628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff972ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff97415d5e0 0x7ff9740cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:54582/0 (socket says 172.21.15.6:54582) 2023-11-28T21:08:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9737fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740b3ba0 0x7ff9740cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:39502/0 (socket says 172.21.15.6:39502) 2023-11-28T21:08:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9727fc640 1 -- 172.21.15.6:0/2859594628 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740b3ba0 msgr2=0x7ff9740cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9727fc640 1 --2- 172.21.15.6:0/2859594628 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740b3ba0 0x7ff9740cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9727fc640 1 -- 172.21.15.6:0/2859594628 >> v1:172.21.15.31:6789/0 conn(0x7ff97415d5e0 legacy=0x7ff9740cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff9727fc640 1 -- 172.21.15.6:0/2859594628 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9740d1a60 con 0x7ff9740d0180 2023-11-28T21:08:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.603+0000 7ff971ffb640 1 -- 172.21.15.6:0/2859594628 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148220675 0 0) 0x7ff9740b2700 con 0x7ff97415d5e0 2023-11-28T21:08:21.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff9727fc640 1 --2- 172.21.15.6:0/2859594628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740d0180 0x7ff9740b44a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff968009870 tx=0x7ff96801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b7b32043c3689b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:21.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff971ffb640 1 -- 172.21.15.6:0/2859594628 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9680a7070 con 0x7ff9740d0180 2023-11-28T21:08:21.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff971ffb640 1 -- 172.21.15.6:0/2859594628 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9680ab430 con 0x7ff9740d0180 2023-11-28T21:08:21.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff971ffb640 1 -- 172.21.15.6:0/2859594628 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9680ab7c0 con 0x7ff9740d0180 2023-11-28T21:08:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff9792c9640 1 -- 172.21.15.6:0/2859594628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740d0180 msgr2=0x7ff9740b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff9792c9640 1 --2- 172.21.15.6:0/2859594628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740d0180 0x7ff9740b44a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff968009870 tx=0x7ff96801c540 comp rx=0 tx=0).stop 2023-11-28T21:08:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff9792c9640 1 -- 172.21.15.6:0/2859594628 shutdown_connections 2023-11-28T21:08:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff9792c9640 1 --2- 172.21.15.6:0/2859594628 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740b3ba0 0x7ff9740cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff9792c9640 1 --2- 172.21.15.6:0/2859594628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740d0180 0x7ff9740b44a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff9792c9640 1 -- 172.21.15.6:0/2859594628 >> 172.21.15.6:0/2859594628 conn(0x7ff97409c3e0 msgr2=0x7ff9740d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff9792c9640 1 -- 172.21.15.6:0/2859594628 shutdown_connections 2023-11-28T21:08:21.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.607+0000 7ff9792c9640 1 -- 172.21.15.6:0/2859594628 wait complete. 2023-11-28T21:08:21.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 Processor -- start 2023-11-28T21:08:21.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 -- start start 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9740b3ba0 0x7ff9740c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740d0180 0x7ff974153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff97415d5e0 0x7ff974154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740cd500 con 0x7ff9740b3ba0 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff974154990 con 0x7ff97415d5e0 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740c7510 con 0x7ff9740d0180 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff972ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9740b3ba0 0x7ff9740c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff972ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9740b3ba0 0x7ff9740c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49318/0 (socket says 172.21.15.6:49318) 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff972ffd640 1 -- 172.21.15.6:0/1510742411 learned_addr learned my addr 172.21.15.6:0/1510742411 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9727fc640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740d0180 0x7ff974153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9737fe640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff97415d5e0 0x7ff974154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff972ffd640 1 -- 172.21.15.6:0/1510742411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740d0180 msgr2=0x7ff974153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff972ffd640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740d0180 0x7ff974153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff972ffd640 1 -- 172.21.15.6:0/1510742411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff97415d5e0 msgr2=0x7ff974154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff972ffd640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff97415d5e0 0x7ff974154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff972ffd640 1 -- 172.21.15.6:0/1510742411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680094d0 con 0x7ff9740b3ba0 2023-11-28T21:08:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9727fc640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740d0180 0x7ff974153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff972ffd640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9740b3ba0 0x7ff9740c92e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c480 tx=0x7ff96400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff95b7fe640 1 -- 172.21.15.6:0/1510742411 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9640074e0 con 0x7ff9740b3ba0 2023-11-28T21:08:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff95b7fe640 1 -- 172.21.15.6:0/1510742411 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964007660 con 0x7ff9740b3ba0 2023-11-28T21:08:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff974159220 con 0x7ff9740b3ba0 2023-11-28T21:08:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff95b7fe640 1 -- 172.21.15.6:0/1510742411 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964004a30 con 0x7ff9740b3ba0 2023-11-28T21:08:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.611+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9740ccfe0 con 0x7ff9740b3ba0 2023-11-28T21:08:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.615+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97406b610 con 0x7ff9740b3ba0 2023-11-28T21:08:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.615+0000 7ff95b7fe640 1 -- 172.21.15.6:0/1510742411 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff964004b90 con 0x7ff9740b3ba0 2023-11-28T21:08:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.615+0000 7ff95b7fe640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff960066470 0x7ff960068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.615+0000 7ff95b7fe640 1 -- 172.21.15.6:0/1510742411 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff964082ff0 con 0x7ff9740b3ba0 2023-11-28T21:08:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.615+0000 7ff9727fc640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff960066470 0x7ff960068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.615+0000 7ff9727fc640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff960066470 0x7ff960068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff9680af000 tx=0x7ff968008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:21.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.619+0000 7ff95b7fe640 1 -- 172.21.15.6:0/1510742411 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9640b4280 con 0x7ff9740b3ba0 2023-11-28T21:08:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff97404e8c0 con 0x7ff9740b3ba0 2023-11-28T21:08:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff95b7fe640 1 -- 172.21.15.6:0/1510742411 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7ff9640504b0 con 0x7ff9740b3ba0 2023-11-28T21:08:21.818 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:21.818 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2017265312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2017265312},{"type":"v1","addr":"172.21.15.6:6837","nonce":2017265312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2658515931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2658515931},{"type":"v1","addr":"172.21.15.31:6834","nonce":2658515931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3368809777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3368809777},{"type":"v1","addr":"172.21.15.31:6835","nonce":3368809777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:08:09.785431+0000","modified":"2023-11-28T21:08:12.826904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:08:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-11-28T21:08:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff960066470 msgr2=0x7ff960068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff960066470 0x7ff960068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff9680af000 tx=0x7ff968008040 comp rx=0 tx=0).stop 2023-11-28T21:08:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9740b3ba0 msgr2=0x7ff9740c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9740b3ba0 0x7ff9740c92e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c480 tx=0x7ff96400c940 comp rx=0 tx=0).stop 2023-11-28T21:08:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 shutdown_connections 2023-11-28T21:08:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff960066470 0x7ff960068930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff97415d5e0 0x7ff974154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9740d0180 0x7ff974153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 --2- 172.21.15.6:0/1510742411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9740b3ba0 0x7ff9740c92e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 >> 172.21.15.6:0/1510742411 conn(0x7ff97409c3e0 msgr2=0x7ff9740d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 shutdown_connections 2023-11-28T21:08:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.811+0000 7ff9792c9640 1 -- 172.21.15.6:0/1510742411 wait complete. 2023-11-28T21:08:21.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea33aa640 1 Processor -- start 2023-11-28T21:08:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea33aa640 1 -- start start 2023-11-28T21:08:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea33aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 0x7f0e9c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea33aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e9c070cf0 0x7f0e9c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea33aa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9c0b32c0 con 0x7f0e9c162890 2023-11-28T21:08:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea33aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c15f610 con 0x7f0e9c070cf0 2023-11-28T21:08:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea33aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0b26f0 con 0x7f0e9c15f230 2023-11-28T21:08:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea1947640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e9c070cf0 0x7f0e9c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea1947640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e9c070cf0 0x7f0e9c06c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49322/0 (socket says 172.21.15.6:49322) 2023-11-28T21:08:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.975+0000 7f0ea1947640 1 -- 172.21.15.6:0/1965777383 learned_addr learned my addr 172.21.15.6:0/1965777383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea1146640 1 --2- 172.21.15.6:0/1965777383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 0x7f0e9c0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea1947640 1 -- 172.21.15.6:0/1965777383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 msgr2=0x7f0e9c0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea1947640 1 --2- 172.21.15.6:0/1965777383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 0x7f0e9c0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea1947640 1 -- 172.21.15.6:0/1965777383 >> v1:172.21.15.31:6789/0 conn(0x7f0e9c162890 legacy=0x7f0e9c0705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea1947640 1 -- 172.21.15.6:0/1965777383 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c0b2990 con 0x7f0e9c070cf0 2023-11-28T21:08:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea1947640 1 --2- 172.21.15.6:0/1965777383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c070cf0 0x7f0e9c06c570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009e50 tx=0x7f0e9401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32e0af43aecbb1a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0e93fff640 1 -- 172.21.15.6:0/1965777383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940a58a0 con 0x7f0e9c070cf0 2023-11-28T21:08:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0e93fff640 1 -- 172.21.15.6:0/1965777383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e940a5a00 con 0x7f0e9c070cf0 2023-11-28T21:08:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0e93fff640 1 -- 172.21.15.6:0/1965777383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940a5d90 con 0x7f0e9c070cf0 2023-11-28T21:08:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea33aa640 1 -- 172.21.15.6:0/1965777383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c070cf0 msgr2=0x7f0e9c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea33aa640 1 --2- 172.21.15.6:0/1965777383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c070cf0 0x7f0e9c06c570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009e50 tx=0x7f0e9401c9e0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea33aa640 1 -- 172.21.15.6:0/1965777383 shutdown_connections 2023-11-28T21:08:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea33aa640 1 --2- 172.21.15.6:0/1965777383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c070cf0 0x7f0e9c06c570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.979+0000 7f0ea33aa640 1 --2- 172.21.15.6:0/1965777383 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 0x7f0e9c0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 -- 172.21.15.6:0/1965777383 >> 172.21.15.6:0/1965777383 conn(0x7f0e9c06ab80 msgr2=0x7f0e9c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 -- 172.21.15.6:0/1965777383 shutdown_connections 2023-11-28T21:08:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 -- 172.21.15.6:0/1965777383 wait complete. 2023-11-28T21:08:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 Processor -- start 2023-11-28T21:08:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 -- start start 2023-11-28T21:08:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e9c070cf0 0x7f0e9c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 0x7f0e9c15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c162890 0x7f0e9c1631b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0cbee0 con 0x7f0e9c162890 2023-11-28T21:08:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0cbbe0 con 0x7f0e9c070cf0 2023-11-28T21:08:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea33aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c1566e0 con 0x7f0e9c15f230 2023-11-28T21:08:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1947640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c162890 0x7f0e9c1631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1947640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c162890 0x7f0e9c1631b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49324/0 (socket says 172.21.15.6:49324) 2023-11-28T21:08:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1947640 1 -- 172.21.15.6:0/3390035441 learned_addr learned my addr 172.21.15.6:0/3390035441 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1146640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e9c070cf0 0x7f0e9c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea0945640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 0x7f0e9c15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1947640 1 -- 172.21.15.6:0/3390035441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 msgr2=0x7f0e9c15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1947640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 0x7f0e9c15abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1947640 1 -- 172.21.15.6:0/3390035441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e9c070cf0 msgr2=0x7f0e9c1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1947640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e9c070cf0 0x7f0e9c1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1947640 1 -- 172.21.15.6:0/3390035441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94009b30 con 0x7f0e9c162890 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1146640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e9c070cf0 0x7f0e9c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0ea1947640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c162890 0x7f0e9c1631b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009e50 tx=0x7f0e94019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.983+0000 7f0e91ffb640 1 -- 172.21.15.6:0/3390035441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940b8670 con 0x7f0e9c162890 2023-11-28T21:08:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0e91ffb640 1 -- 172.21.15.6:0/3390035441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e940b8810 con 0x7f0e9c162890 2023-11-28T21:08:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0e91ffb640 1 -- 172.21.15.6:0/3390035441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940b8bc0 con 0x7f0e9c162890 2023-11-28T21:08:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c15b5f0 con 0x7f0e9c162890 2023-11-28T21:08:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c15bbb0 con 0x7f0e9c162890 2023-11-28T21:08:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9c0cc090 con 0x7f0e9c162890 2023-11-28T21:08:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0e91ffb640 1 -- 172.21.15.6:0/3390035441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e940b8d20 con 0x7f0e9c162890 2023-11-28T21:08:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0e91ffb640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0e800664a0 0x7f0e80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0e91ffb640 1 -- 172.21.15.6:0/3390035441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e9411f0f0 con 0x7f0e9c162890 2023-11-28T21:08:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0ea1146640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0e800664a0 0x7f0e80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.987+0000 7f0ea1146640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0e800664a0 0x7f0e80068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e98007a70 tx=0x7f0e98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:21.991+0000 7f0e91ffb640 1 -- 172.21.15.6:0/3390035441 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e9c0cc090 con 0x7f0e9c162890 2023-11-28T21:08:22.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.151+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e9c0cc090 con 0x7f0e9c162890 2023-11-28T21:08:22.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.151+0000 7f0e91ffb640 1 -- 172.21.15.6:0/3390035441 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f0e9c0cc090 con 0x7f0e9c162890 2023-11-28T21:08:22.158 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:22.158 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:22.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0e800664a0 msgr2=0x7f0e80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0e800664a0 0x7f0e80068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e98007a70 tx=0x7f0e98008040 comp rx=0 tx=0).stop 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c162890 msgr2=0x7f0e9c1631b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c162890 0x7f0e9c1631b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009e50 tx=0x7f0e94019780 comp rx=0 tx=0).stop 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 shutdown_connections 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0e800664a0 0x7f0e80068960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e9c162890 0x7f0e9c1631b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e9c15f230 0x7f0e9c15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 --2- 172.21.15.6:0/3390035441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e9c070cf0 0x7f0e9c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 >> 172.21.15.6:0/3390035441 conn(0x7f0e9c06ab80 msgr2=0x7f0e9c15ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 shutdown_connections 2023-11-28T21:08:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.155+0000 7f0ea33aa640 1 -- 172.21.15.6:0/3390035441 wait complete. 2023-11-28T21:08:22.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:22.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:22.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.319+0000 7fe0db180640 1 Processor -- start 2023-11-28T21:08:22.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.319+0000 7fe0db180640 1 -- start start 2023-11-28T21:08:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.319+0000 7fe0db180640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0d40cc3f0 0x7fe0d415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0db180640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d415c270 0x7fe0d415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0db180640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d40cc8a0 con 0x7fe0d406ca00 2023-11-28T21:08:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0db180640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d40cd400 con 0x7fe0d40cc3f0 2023-11-28T21:08:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0db180640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d415c700 con 0x7fe0d415c270 2023-11-28T21:08:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d8f1c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe0d406ca00 0x7fe0d406cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40324/0 (socket says 172.21.15.6:40324) 2023-11-28T21:08:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0d40cc3f0 0x7fe0d415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d8f1c640 1 -- 172.21.15.6:0/779501603 learned_addr learned my addr 172.21.15.6:0/779501603 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d971d640 1 --2- 172.21.15.6:0/779501603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d415c270 0x7fe0d415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d3fff640 1 -- 172.21.15.6:0/779501603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d415c270 msgr2=0x7fe0d415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d3fff640 1 --2- 172.21.15.6:0/779501603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d415c270 0x7fe0d415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d3fff640 1 -- 172.21.15.6:0/779501603 >> v1:172.21.15.6:6789/0 conn(0x7fe0d406ca00 legacy=0x7fe0d406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d3fff640 1 -- 172.21.15.6:0/779501603 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d40ccb60 con 0x7fe0d40cc3f0 2023-11-28T21:08:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d971d640 1 --2- 172.21.15.6:0/779501603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d415c270 0x7fe0d415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d37fe640 1 -- 172.21.15.6:0/779501603 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563626452 0 0) 0x7fe0d40cc8a0 con 0x7fe0d406ca00 2023-11-28T21:08:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d3fff640 1 --2- 172.21.15.6:0/779501603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d40cc3f0 0x7fe0d415bd30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009820 tx=0x7fe0c001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890e6d1880016ab6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d37fe640 1 -- 172.21.15.6:0/779501603 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00ac600 con 0x7fe0d40cc3f0 2023-11-28T21:08:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.323+0000 7fe0d37fe640 1 -- 172.21.15.6:0/779501603 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c00a8050 con 0x7fe0d40cc3f0 2023-11-28T21:08:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0d37fe640 1 -- 172.21.15.6:0/779501603 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00ac980 con 0x7fe0d40cc3f0 2023-11-28T21:08:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 -- 172.21.15.6:0/779501603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d40cc3f0 msgr2=0x7fe0d415bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 --2- 172.21.15.6:0/779501603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d40cc3f0 0x7fe0d415bd30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009820 tx=0x7fe0c001c3a0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 -- 172.21.15.6:0/779501603 shutdown_connections 2023-11-28T21:08:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 --2- 172.21.15.6:0/779501603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d415c270 0x7fe0d415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 --2- 172.21.15.6:0/779501603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d40cc3f0 0x7fe0d415bd30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 -- 172.21.15.6:0/779501603 >> 172.21.15.6:0/779501603 conn(0x7fe0d406a980 msgr2=0x7fe0d406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 -- 172.21.15.6:0/779501603 shutdown_connections 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 -- 172.21.15.6:0/779501603 wait complete. 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 Processor -- start 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 -- start start 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d406ca00 0x7fe0d40acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d40cc3f0 0x7fe0d414c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0d415c270 0x7fe0d414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d415b370 con 0x7fe0d406ca00 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4070810 con 0x7fe0d415c270 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0db180640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40b25f0 con 0x7fe0d40cc3f0 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0d8f1c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d406ca00 0x7fe0d40acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0d8f1c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d406ca00 0x7fe0d40acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49344/0 (socket says 172.21.15.6:49344) 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0d8f1c640 1 -- 172.21.15.6:0/709328147 learned_addr learned my addr 172.21.15.6:0/709328147 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0d3fff640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d40cc3f0 0x7fe0d414c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.327+0000 7fe0d971d640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0d415c270 0x7fe0d414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d8f1c640 1 -- 172.21.15.6:0/709328147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d40cc3f0 msgr2=0x7fe0d414c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d8f1c640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d40cc3f0 0x7fe0d414c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d8f1c640 1 -- 172.21.15.6:0/709328147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0d415c270 msgr2=0x7fe0d414d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d8f1c640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0d415c270 0x7fe0d414d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d8f1c640 1 -- 172.21.15.6:0/709328147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0009420 con 0x7fe0d406ca00 2023-11-28T21:08:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d3fff640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d40cc3f0 0x7fe0d414c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d8f1c640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d406ca00 0x7fe0d40acb80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c520 tx=0x7fe0c800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d17fa640 1 -- 172.21.15.6:0/709328147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80074e0 con 0x7fe0d406ca00 2023-11-28T21:08:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d17fa640 1 -- 172.21.15.6:0/709328147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c8007640 con 0x7fe0d406ca00 2023-11-28T21:08:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d17fa640 1 -- 172.21.15.6:0/709328147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80049f0 con 0x7fe0d406ca00 2023-11-28T21:08:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d40b22e0 con 0x7fe0d406ca00 2023-11-28T21:08:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d4070530 con 0x7fe0d406ca00 2023-11-28T21:08:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d4068710 con 0x7fe0d406ca00 2023-11-28T21:08:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d17fa640 1 -- 172.21.15.6:0/709328147 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0c8004b50 con 0x7fe0d406ca00 2023-11-28T21:08:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d17fa640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0b8066470 0x7fe0b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d17fa640 1 -- 172.21.15.6:0/709328147 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0c8082fe0 con 0x7fe0d406ca00 2023-11-28T21:08:22.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.331+0000 7fe0d3fff640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0b8066470 0x7fe0b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.335+0000 7fe0d3fff640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0b8066470 0x7fe0b8068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00ae000 tx=0x7fe0c00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:22.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.335+0000 7fe0d17fa640 1 -- 172.21.15.6:0/709328147 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0c8050560 con 0x7fe0d406ca00 2023-11-28T21:08:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.495+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0d4070390 con 0x7fe0d406ca00 2023-11-28T21:08:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.495+0000 7fe0d17fa640 1 -- 172.21.15.6:0/709328147 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0c8018020 con 0x7fe0d406ca00 2023-11-28T21:08:22.503 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0b8066470 msgr2=0x7fe0b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0b8066470 0x7fe0b8068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00ae000 tx=0x7fe0c00a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:22.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d406ca00 msgr2=0x7fe0d40acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d406ca00 0x7fe0d40acb80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c520 tx=0x7fe0c800c9e0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 shutdown_connections 2023-11-28T21:08:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe0b8066470 0x7fe0b8068930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0d415c270 0x7fe0d414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0d40cc3f0 0x7fe0d414c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 --2- 172.21.15.6:0/709328147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d406ca00 0x7fe0d40acb80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 >> 172.21.15.6:0/709328147 conn(0x7fe0d406a980 msgr2=0x7fe0d415e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 shutdown_connections 2023-11-28T21:08:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.499+0000 7fe0db180640 1 -- 172.21.15.6:0/709328147 wait complete. 2023-11-28T21:08:22.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce15d57640 1 Processor -- start 2023-11-28T21:08:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce15d57640 1 -- start start 2023-11-28T21:08:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce15d57640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce100cbf40 0x7fce100ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce15d57640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 0x7fce1015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce15d57640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1015b510 con 0x7fce1015e370 2023-11-28T21:08:22.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce15d57640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce100cd730 con 0x7fce100cbf40 2023-11-28T21:08:22.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce15d57640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1013d450 con 0x7fce1015e750 2023-11-28T21:08:22.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce0effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce100cbf40 0x7fce100ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce0f7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fce1015e370 0x7fce100cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:54590/0 (socket says 172.21.15.6:54590) 2023-11-28T21:08:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce0ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 0x7fce1015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce0f7fe640 1 -- 172.21.15.6:0/342932731 learned_addr learned my addr 172.21.15.6:0/342932731 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce0effd640 1 -- 172.21.15.6:0/342932731 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 msgr2=0x7fce1015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce0effd640 1 --2- 172.21.15.6:0/342932731 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 0x7fce1015a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce0effd640 1 -- 172.21.15.6:0/342932731 >> v1:172.21.15.31:6789/0 conn(0x7fce1015e370 legacy=0x7fce100cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.667+0000 7fce0effd640 1 -- 172.21.15.6:0/342932731 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100cd940 con 0x7fce100cbf40 2023-11-28T21:08:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce0effd640 1 --2- 172.21.15.6:0/342932731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce100cbf40 0x7fce100ce700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce040097c0 tx=0x7fce0401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58911e81dc90b906 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:22.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce0e7fc640 1 -- 172.21.15.6:0/342932731 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040ab600 con 0x7fce100cbf40 2023-11-28T21:08:22.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce0e7fc640 1 -- 172.21.15.6:0/342932731 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce040a7050 con 0x7fce100cbf40 2023-11-28T21:08:22.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce0e7fc640 1 -- 172.21.15.6:0/342932731 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040ab980 con 0x7fce100cbf40 2023-11-28T21:08:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce15d57640 1 -- 172.21.15.6:0/342932731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce100cbf40 msgr2=0x7fce100ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce15d57640 1 --2- 172.21.15.6:0/342932731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce100cbf40 0x7fce100ce700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce040097c0 tx=0x7fce0401c480 comp rx=0 tx=0).stop 2023-11-28T21:08:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce15d57640 1 -- 172.21.15.6:0/342932731 shutdown_connections 2023-11-28T21:08:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce15d57640 1 --2- 172.21.15.6:0/342932731 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 0x7fce1015a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce15d57640 1 --2- 172.21.15.6:0/342932731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce100cbf40 0x7fce100ce700 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce15d57640 1 -- 172.21.15.6:0/342932731 >> 172.21.15.6:0/342932731 conn(0x7fce1006a980 msgr2=0x7fce1006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce15d57640 1 -- 172.21.15.6:0/342932731 shutdown_connections 2023-11-28T21:08:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce15d57640 1 -- 172.21.15.6:0/342932731 wait complete. 2023-11-28T21:08:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.671+0000 7fce15d57640 1 Processor -- start 2023-11-28T21:08:22.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 -- start start 2023-11-28T21:08:22.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce100cbf40 0x7fce101324b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1015e370 0x7fce1013d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 0x7fce1013fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce101329f0 con 0x7fce1015e370 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100b0490 con 0x7fce100cbf40 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce101339d0 con 0x7fce1015e750 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1015e370 0x7fce1013d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1015e370 0x7fce1013d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49356/0 (socket says 172.21.15.6:49356) 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0effd640 1 -- 172.21.15.6:0/4075987882 learned_addr learned my addr 172.21.15.6:0/4075987882 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0f7fe640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce100cbf40 0x7fce101324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0ffff640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 0x7fce1013fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0effd640 1 -- 172.21.15.6:0/4075987882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 msgr2=0x7fce1013fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0effd640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 0x7fce1013fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0effd640 1 -- 172.21.15.6:0/4075987882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce100cbf40 msgr2=0x7fce101324b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0effd640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce100cbf40 0x7fce101324b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0effd640 1 -- 172.21.15.6:0/4075987882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009420 con 0x7fce1015e370 2023-11-28T21:08:22.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce0effd640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1015e370 0x7fce1013d590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce0401a0b0 tx=0x7fce04019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:22.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fcdf7fff640 1 -- 172.21.15.6:0/4075987882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040b4410 con 0x7fce1015e370 2023-11-28T21:08:22.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fcdf7fff640 1 -- 172.21.15.6:0/4075987882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce040b4570 con 0x7fce1015e370 2023-11-28T21:08:22.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fcdf7fff640 1 -- 172.21.15.6:0/4075987882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040b4920 con 0x7fce1015e370 2023-11-28T21:08:22.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce10133cb0 con 0x7fce1015e370 2023-11-28T21:08:22.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce100b0a10 con 0x7fce1015e370 2023-11-28T21:08:22.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.675+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce100b0c00 con 0x7fce1015e370 2023-11-28T21:08:22.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.679+0000 7fcdf7fff640 1 -- 172.21.15.6:0/4075987882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce040b2040 con 0x7fce1015e370 2023-11-28T21:08:22.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.679+0000 7fcdf7fff640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcdfc066470 0x7fcdfc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:22.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.679+0000 7fcdf7fff640 1 -- 172.21.15.6:0/4075987882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce0411dcc0 con 0x7fce1015e370 2023-11-28T21:08:22.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.679+0000 7fce0f7fe640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcdfc066470 0x7fcdfc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:22.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.679+0000 7fce0f7fe640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcdfc066470 0x7fcdfc068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce00005890 tx=0x7fce00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.683+0000 7fcdf7fff640 1 -- 172.21.15.6:0/4075987882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce040eb1f0 con 0x7fce1015e370 2023-11-28T21:08:22.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.839+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce10072b90 con 0x7fce1015e370 2023-11-28T21:08:22.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.839+0000 7fcdf7fff640 1 -- 172.21.15.6:0/4075987882 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce040b00a0 con 0x7fce1015e370 2023-11-28T21:08:22.846 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcdfc066470 msgr2=0x7fcdfc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcdfc066470 0x7fcdfc068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce00005890 tx=0x7fce00009040 comp rx=0 tx=0).stop 2023-11-28T21:08:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1015e370 msgr2=0x7fce1013d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1015e370 0x7fce1013d590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce0401a0b0 tx=0x7fce04019220 comp rx=0 tx=0).stop 2023-11-28T21:08:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 shutdown_connections 2023-11-28T21:08:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcdfc066470 0x7fcdfc068930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce1015e750 0x7fce1013fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1015e370 0x7fce1013d590 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 --2- 172.21.15.6:0/4075987882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce100cbf40 0x7fce101324b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 >> 172.21.15.6:0/4075987882 conn(0x7fce1006a980 msgr2=0x7fce100b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 shutdown_connections 2023-11-28T21:08:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:22.843+0000 7fce15d57640 1 -- 172.21.15.6:0/4075987882 wait complete. 2023-11-28T21:08:22.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.007+0000 7feeb8e5a640 1 Processor -- start 2023-11-28T21:08:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.007+0000 7feeb8e5a640 1 -- start start 2023-11-28T21:08:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb8e5a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb40cc3f0 0x7feeb415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb8e5a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feeb415c270 0x7feeb415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb8e5a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb40ccb60 con 0x7feeb406ca00 2023-11-28T21:08:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb8e5a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb40cd400 con 0x7feeb415c270 2023-11-28T21:08:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb8e5a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb415c700 con 0x7feeb40cc3f0 2023-11-28T21:08:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7feeb406ca00 0x7feeb406cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40338/0 (socket says 172.21.15.6:40338) 2023-11-28T21:08:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb259c640 1 -- 172.21.15.6:0/4117781306 learned_addr learned my addr 172.21.15.6:0/4117781306 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb2d9d640 1 --2- 172.21.15.6:0/4117781306 >> v2:172.21.15.31:3300/0 conn(0x7feeb415c270 0x7feeb415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeabfff640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb40cc3f0 0x7feeb415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234552723 0 0) 0x7feeb40ccb60 con 0x7feeb406ca00 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea0003530 con 0x7feeb406ca00 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2960797471 0 0) 0x7feea0003530 con 0x7feeb406ca00 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb40cc3f0 msgr2=0x7feeb415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb40cc3f0 0x7feeb415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 >> v2:172.21.15.31:3300/0 conn(0x7feeb415c270 msgr2=0x7feeb415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 --2- 172.21.15.6:0/4117781306 >> v2:172.21.15.31:3300/0 conn(0x7feeb415c270 0x7feeb415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40cce40 con 0x7feeb406ca00 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7feea4001680 con 0x7feeb406ca00 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb2d9d640 1 --2- 172.21.15.6:0/4117781306 >> v2:172.21.15.31:3300/0 conn(0x7feeb415c270 0x7feeb415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:23.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 >> v1:172.21.15.6:6789/0 conn(0x7feeb406ca00 legacy=0x7feeb406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb40cc3f0 0x7feea00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea0003f30 0x7feea00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feea0004d10 0x7feea0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40cd400 con 0x7feea0004d10 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb415c700 con 0x7feea0003f30 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea000ba10 con 0x7feeb40cc3f0 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb2d9d640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feea0004d10 0x7feea0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb259c640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb40cc3f0 0x7feea00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeabfff640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea0003f30 0x7feea00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb2d9d640 1 -- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb40cc3f0 msgr2=0x7feea00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb2d9d640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feeb40cc3f0 0x7feea00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb2d9d640 1 -- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea0003f30 msgr2=0x7feea00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb2d9d640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea0003f30 0x7feea00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.011+0000 7feeb2d9d640 1 -- 172.21.15.6:0/4117781306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0003530 con 0x7feea0004d10 2023-11-28T21:08:23.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb2d9d640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feea0004d10 0x7feea0005190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feeac00e350 tx=0x7feeac01ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b15a59767fec1ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0a5d70 con 0x7feea0004d10 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac00f040 con 0x7feea0004d10 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb1d9b640 1 -- 172.21.15.6:0/4117781306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0ad640 con 0x7feea0004d10 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb8e5a640 1 -- 172.21.15.6:0/4117781306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feea0004d10 msgr2=0x7feea0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb8e5a640 1 --2- 172.21.15.6:0/4117781306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feea0004d10 0x7feea0005190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feeac00e350 tx=0x7feeac01ce60 comp rx=0 tx=0).stop 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb2d9d640 1 -- 172.21.15.6:0/4117781306 reap_dead start 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb8e5a640 1 -- 172.21.15.6:0/4117781306 shutdown_connections 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb8e5a640 1 -- 172.21.15.6:0/4117781306 >> 172.21.15.6:0/4117781306 conn(0x7feeb406a980 msgr2=0x7feeb406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb8e5a640 1 -- 172.21.15.6:0/4117781306 shutdown_connections 2023-11-28T21:08:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb8e5a640 1 -- 172.21.15.6:0/4117781306 wait complete. 2023-11-28T21:08:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb8e5a640 1 Processor -- start 2023-11-28T21:08:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.015+0000 7feeb8e5a640 1 -- start start 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb8e5a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea0004d10 0x7feeb41f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb8e5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb41f3070 0x7feeb41565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb8e5a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb4156b20 0x7feeb40b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb8e5a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb4156fa0 con 0x7feeb4156b20 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb8e5a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40b0b50 con 0x7feeb41f3070 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb8e5a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40b0da0 con 0x7feea0004d10 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb4156b20 0x7feeb40b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb4156b20 0x7feeb40b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49364/0 (socket says 172.21.15.6:49364) 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb2d9d640 1 -- 172.21.15.6:0/2966857858 learned_addr learned my addr 172.21.15.6:0/2966857858 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb259c640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea0004d10 0x7feeb41f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeabfff640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb41f3070 0x7feeb41565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb2d9d640 1 -- 172.21.15.6:0/2966857858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea0004d10 msgr2=0x7feeb41f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb2d9d640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea0004d10 0x7feeb41f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb2d9d640 1 -- 172.21.15.6:0/2966857858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb41f3070 msgr2=0x7feeb41565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb2d9d640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb41f3070 0x7feeb41565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb2d9d640 1 -- 172.21.15.6:0/2966857858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40b1080 con 0x7feeb4156b20 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb2d9d640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb4156b20 0x7feeb40b31e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feeac002240 tx=0x7feeac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeaaffd640 1 -- 172.21.15.6:0/2966857858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0ba070 con 0x7feeb4156b20 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeaaffd640 1 -- 172.21.15.6:0/2966857858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac0039a0 con 0x7feeb4156b20 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeaaffd640 1 -- 172.21.15.6:0/2966857858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac003b50 con 0x7feeb4156b20 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb40b1360 con 0x7feeb4156b20 2023-11-28T21:08:23.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb40b1920 con 0x7feeb4156b20 2023-11-28T21:08:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb4072b90 con 0x7feeb4156b20 2023-11-28T21:08:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.019+0000 7feeaaffd640 1 -- 172.21.15.6:0/2966857858 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feeac0b4040 con 0x7feeb4156b20 2023-11-28T21:08:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.023+0000 7feeaaffd640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fee940664a0 0x7fee94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.023+0000 7feeaaffd640 1 -- 172.21.15.6:0/2966857858 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeac11df10 con 0x7feeb4156b20 2023-11-28T21:08:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.023+0000 7feeb259c640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fee940664a0 0x7fee94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.023+0000 7feeb259c640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fee940664a0 0x7fee94068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feea40051a0 tx=0x7feea4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.027+0000 7feeaaffd640 1 -- 172.21.15.6:0/2966857858 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feeac0eb260 con 0x7feeb4156b20 2023-11-28T21:08:23.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.183+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feeb4072b90 con 0x7feeb4156b20 2023-11-28T21:08:23.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.183+0000 7feeaaffd640 1 -- 172.21.15.6:0/2966857858 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7feeac0b20a0 con 0x7feeb4156b20 2023-11-28T21:08:23.191 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fee940664a0 msgr2=0x7fee94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fee940664a0 0x7fee94068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feea40051a0 tx=0x7feea4009040 comp rx=0 tx=0).stop 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb4156b20 msgr2=0x7feeb40b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb4156b20 0x7feeb40b31e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feeac002240 tx=0x7feeac009750 comp rx=0 tx=0).stop 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 shutdown_connections 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fee940664a0 0x7fee94068960 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb4156b20 0x7feeb40b31e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feeb41f3070 0x7feeb41565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 --2- 172.21.15.6:0/2966857858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea0004d10 0x7feeb41f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 >> 172.21.15.6:0/2966857858 conn(0x7feeb406a980 msgr2=0x7feeb4070390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 shutdown_connections 2023-11-28T21:08:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.187+0000 7feeb8e5a640 1 -- 172.21.15.6:0/2966857858 wait complete. 2023-11-28T21:08:23.212 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:08:23.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.351+0000 7fc9becea640 1 Processor -- start 2023-11-28T21:08:23.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.351+0000 7fc9becea640 1 -- start start 2023-11-28T21:08:23.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9becea640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b8142da0 0x7fc9b8071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9becea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9b815e7d0 0x7fc9b806d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9becea640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b815e340 con 0x7fc9b81437f0 2023-11-28T21:08:23.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9becea640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b815dae0 con 0x7fc9b815e7d0 2023-11-28T21:08:23.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9becea640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80b39b0 con 0x7fc9b8142da0 2023-11-28T21:08:23.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9b7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9b815e7d0 0x7fc9b806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9b7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9b815e7d0 0x7fc9b806d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49374/0 (socket says 172.21.15.6:49374) 2023-11-28T21:08:23.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9b7fff640 1 -- 172.21.15.6:0/3819376281 learned_addr learned my addr 172.21.15.6:0/3819376281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:23.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9bca86640 1 --2- 172.21.15.6:0/3819376281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b8142da0 0x7fc9b8071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9b7fff640 1 -- 172.21.15.6:0/3819376281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b8142da0 msgr2=0x7fc9b8071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:23.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/3819376281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b8142da0 0x7fc9b8071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9b7fff640 1 -- 172.21.15.6:0/3819376281 >> v1:172.21.15.31:6789/0 conn(0x7fc9b81437f0 legacy=0x7fc9b80703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.355+0000 7fc9b7fff640 1 -- 172.21.15.6:0/3819376281 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b8143440 con 0x7fc9b815e7d0 2023-11-28T21:08:23.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/3819376281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b815e7d0 0x7fc9b806d680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009870 tx=0x7fc9a401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01d54466a9e3850 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:23.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9b77fe640 1 -- 172.21.15.6:0/3819376281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40ab620 con 0x7fc9b815e7d0 2023-11-28T21:08:23.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9b77fe640 1 -- 172.21.15.6:0/3819376281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a40ab780 con 0x7fc9b815e7d0 2023-11-28T21:08:23.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9b77fe640 1 -- 172.21.15.6:0/3819376281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40abb10 con 0x7fc9b815e7d0 2023-11-28T21:08:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 -- 172.21.15.6:0/3819376281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b815e7d0 msgr2=0x7fc9b806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 --2- 172.21.15.6:0/3819376281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b815e7d0 0x7fc9b806d680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009870 tx=0x7fc9a401c510 comp rx=0 tx=0).stop 2023-11-28T21:08:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 -- 172.21.15.6:0/3819376281 shutdown_connections 2023-11-28T21:08:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 --2- 172.21.15.6:0/3819376281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b815e7d0 0x7fc9b806d680 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 --2- 172.21.15.6:0/3819376281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b8142da0 0x7fc9b8071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 -- 172.21.15.6:0/3819376281 >> 172.21.15.6:0/3819376281 conn(0x7fc9b806ab80 msgr2=0x7fc9b80b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 -- 172.21.15.6:0/3819376281 shutdown_connections 2023-11-28T21:08:23.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 -- 172.21.15.6:0/3819376281 wait complete. 2023-11-28T21:08:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 Processor -- start 2023-11-28T21:08:23.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.359+0000 7fc9becea640 1 -- start start 2023-11-28T21:08:23.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9becea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b8142da0 0x7fc9b8156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9becea640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b81437f0 0x7fc9b813bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9becea640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b815e7d0 0x7fc9b813e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9becea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b815a690 con 0x7fc9b8142da0 2023-11-28T21:08:23.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9becea640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b813c880 con 0x7fc9b81437f0 2023-11-28T21:08:23.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9becea640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80cc630 con 0x7fc9b815e7d0 2023-11-28T21:08:23.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bca86640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b8142da0 0x7fc9b8156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bca86640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b8142da0 0x7fc9b8156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49382/0 (socket says 172.21.15.6:49382) 2023-11-28T21:08:23.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bca86640 1 -- 172.21.15.6:0/2838563008 learned_addr learned my addr 172.21.15.6:0/2838563008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:23.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b81437f0 0x7fc9b813bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bd287640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b815e7d0 0x7fc9b813e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bca86640 1 -- 172.21.15.6:0/2838563008 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b815e7d0 msgr2=0x7fc9b813e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bca86640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b815e7d0 0x7fc9b813e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bca86640 1 -- 172.21.15.6:0/2838563008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b81437f0 msgr2=0x7fc9b813bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bca86640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b81437f0 0x7fc9b813bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bca86640 1 -- 172.21.15.6:0/2838563008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40094d0 con 0x7fc9b8142da0 2023-11-28T21:08:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9bca86640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b8142da0 0x7fc9b8156790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00d800 tx=0x7fc9ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9b57fa640 1 -- 172.21.15.6:0/2838563008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00b6c0 con 0x7fc9b8142da0 2023-11-28T21:08:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9b57fa640 1 -- 172.21.15.6:0/2838563008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac00b860 con 0x7fc9b8142da0 2023-11-28T21:08:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9b57fa640 1 -- 172.21.15.6:0/2838563008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00bc10 con 0x7fc9b8142da0 2023-11-28T21:08:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b80cc910 con 0x7fc9b8142da0 2023-11-28T21:08:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b80cced0 con 0x7fc9b8142da0 2023-11-28T21:08:23.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b80cd0c0 con 0x7fc9b8142da0 2023-11-28T21:08:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.363+0000 7fc9b57fa640 1 -- 172.21.15.6:0/2838563008 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc9ac01e460 con 0x7fc9b8142da0 2023-11-28T21:08:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.367+0000 7fc9b57fa640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc99c066470 0x7fc99c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.367+0000 7fc9b57fa640 1 -- 172.21.15.6:0/2838563008 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9ac0843c0 con 0x7fc9b8142da0 2023-11-28T21:08:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.367+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc99c066470 0x7fc99c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.367+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc99c066470 0x7fc99c068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40af000 tx=0x7fc9a40b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:23.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.371+0000 7fc9b57fa640 1 -- 172.21.15.6:0/2838563008 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9ac051850 con 0x7fc9b8142da0 2023-11-28T21:08:23.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.559+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9b80674d0 con 0x7fc9b8142da0 2023-11-28T21:08:23.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.559+0000 7fc9b57fa640 1 -- 172.21.15.6:0/2838563008 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7fc9ac054e70 con 0x7fc9b8142da0 2023-11-28T21:08:23.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:23.566 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2017265312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2017265312},{"type":"v1","addr":"172.21.15.6:6837","nonce":2017265312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2658515931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2658515931},{"type":"v1","addr":"172.21.15.31:6834","nonce":2658515931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3368809777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3368809777},{"type":"v1","addr":"172.21.15.31:6835","nonce":3368809777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:08:09.785431+0000","modified":"2023-11-28T21:08:12.826904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:08:23.566 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-11-28T21:08:23.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc99c066470 msgr2=0x7fc99c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc99c066470 0x7fc99c068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40af000 tx=0x7fc9a40b6040 comp rx=0 tx=0).stop 2023-11-28T21:08:23.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b8142da0 msgr2=0x7fc9b8156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b8142da0 0x7fc9b8156790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00d800 tx=0x7fc9ac00dcc0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 shutdown_connections 2023-11-28T21:08:23.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc99c066470 0x7fc99c068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc9b815e7d0 0x7fc9b813e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b81437f0 0x7fc9b813bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 --2- 172.21.15.6:0/2838563008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b8142da0 0x7fc9b8156790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 >> 172.21.15.6:0/2838563008 conn(0x7fc9b806ab80 msgr2=0x7fc9b80af200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:23.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 shutdown_connections 2023-11-28T21:08:23.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.563+0000 7fc9becea640 1 -- 172.21.15.6:0/2838563008 wait complete. 2023-11-28T21:08:23.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:23.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc50df80640 1 Processor -- start 2023-11-28T21:08:23.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc50df80640 1 -- start start 2023-11-28T21:08:23.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc50df80640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc508142da0 0x7fc508071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc50df80640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc50806dd90 0x7fc5080b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc50df80640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50815e340 con 0x7fc50815e7d0 2023-11-28T21:08:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc50df80640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50815dae0 con 0x7fc50806dd90 2023-11-28T21:08:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc50df80640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5080b39b0 con 0x7fc508142da0 2023-11-28T21:08:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc507fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc50806dd90 0x7fc5080b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc506ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc50815e7d0 0x7fc50806d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40342/0 (socket says 172.21.15.6:40342) 2023-11-28T21:08:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc506ffd640 1 -- 172.21.15.6:0/1584941415 learned_addr learned my addr 172.21.15.6:0/1584941415 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc5077fe640 1 --2- 172.21.15.6:0/1584941415 >> v2:172.21.15.31:3300/0 conn(0x7fc508142da0 0x7fc508071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc507fff640 1 -- 172.21.15.6:0/1584941415 >> v2:172.21.15.31:3300/0 conn(0x7fc508142da0 msgr2=0x7fc508071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc507fff640 1 --2- 172.21.15.6:0/1584941415 >> v2:172.21.15.31:3300/0 conn(0x7fc508142da0 0x7fc508071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc507fff640 1 -- 172.21.15.6:0/1584941415 >> v1:172.21.15.6:6789/0 conn(0x7fc50815e7d0 legacy=0x7fc50806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc507fff640 1 -- 172.21.15.6:0/1584941415 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508143440 con 0x7fc50806dd90 2023-11-28T21:08:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.727+0000 7fc5067fc640 1 -- 172.21.15.6:0/1584941415 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277965532 0 0) 0x7fc50815e340 con 0x7fc50815e7d0 2023-11-28T21:08:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc507fff640 1 --2- 172.21.15.6:0/1584941415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc50806dd90 0x7fc5080b1d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc50806e8e0 tx=0x7fc50001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72846e7f5ed4ed11 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc5067fc640 1 -- 172.21.15.6:0/1584941415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000a59a0 con 0x7fc50806dd90 2023-11-28T21:08:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc5067fc640 1 -- 172.21.15.6:0/1584941415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5000a5b00 con 0x7fc50806dd90 2023-11-28T21:08:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc5067fc640 1 -- 172.21.15.6:0/1584941415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000a5e90 con 0x7fc50806dd90 2023-11-28T21:08:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc50df80640 1 -- 172.21.15.6:0/1584941415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc50806dd90 msgr2=0x7fc5080b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc50df80640 1 --2- 172.21.15.6:0/1584941415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc50806dd90 0x7fc5080b1d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc50806e8e0 tx=0x7fc50001c8e0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc50df80640 1 -- 172.21.15.6:0/1584941415 shutdown_connections 2023-11-28T21:08:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc50df80640 1 --2- 172.21.15.6:0/1584941415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc50806dd90 0x7fc5080b1d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc50df80640 1 --2- 172.21.15.6:0/1584941415 >> v2:172.21.15.31:3300/0 conn(0x7fc508142da0 0x7fc508071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc50df80640 1 -- 172.21.15.6:0/1584941415 >> 172.21.15.6:0/1584941415 conn(0x7fc50806ab80 msgr2=0x7fc5080b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc50df80640 1 -- 172.21.15.6:0/1584941415 shutdown_connections 2023-11-28T21:08:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc50df80640 1 -- 172.21.15.6:0/1584941415 wait complete. 2023-11-28T21:08:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.731+0000 7fc50df80640 1 Processor -- start 2023-11-28T21:08:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 -- start start 2023-11-28T21:08:23.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50806dd90 0x7fc50813a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508142da0 0x7fc5081672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50815e7d0 0x7fc50814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc508166ec0 con 0x7fc508142da0 2023-11-28T21:08:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc508151970 con 0x7fc50806dd90 2023-11-28T21:08:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50813a7c0 con 0x7fc50815e7d0 2023-11-28T21:08:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc506ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508142da0 0x7fc5081672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc506ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508142da0 0x7fc5081672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49398/0 (socket says 172.21.15.6:49398) 2023-11-28T21:08:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc506ffd640 1 -- 172.21.15.6:0/4263342704 learned_addr learned my addr 172.21.15.6:0/4263342704 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc5077fe640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50806dd90 0x7fc50813a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc507fff640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50815e7d0 0x7fc50814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc506ffd640 1 -- 172.21.15.6:0/4263342704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50815e7d0 msgr2=0x7fc50814c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc506ffd640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50815e7d0 0x7fc50814c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc506ffd640 1 -- 172.21.15.6:0/4263342704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50806dd90 msgr2=0x7fc50813a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc506ffd640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50806dd90 0x7fc50813a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc506ffd640 1 -- 172.21.15.6:0/4263342704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500009a70 con 0x7fc508142da0 2023-11-28T21:08:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc506ffd640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508142da0 0x7fc5081672e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00c480 tx=0x7fc4fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc4effff640 1 -- 172.21.15.6:0/4263342704 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0074e0 con 0x7fc508142da0 2023-11-28T21:08:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc4effff640 1 -- 172.21.15.6:0/4263342704 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc007660 con 0x7fc508142da0 2023-11-28T21:08:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc4effff640 1 -- 172.21.15.6:0/4263342704 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc004a30 con 0x7fc508142da0 2023-11-28T21:08:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc508166240 con 0x7fc508142da0 2023-11-28T21:08:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc508166800 con 0x7fc508142da0 2023-11-28T21:08:23.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.735+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc508167000 con 0x7fc508142da0 2023-11-28T21:08:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.739+0000 7fc4effff640 1 -- 172.21.15.6:0/4263342704 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4fc004b90 con 0x7fc508142da0 2023-11-28T21:08:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.739+0000 7fc4effff640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc4f4066470 0x7fc4f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.739+0000 7fc4effff640 1 -- 172.21.15.6:0/4263342704 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4fc082f70 con 0x7fc508142da0 2023-11-28T21:08:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.739+0000 7fc5077fe640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc4f4066470 0x7fc4f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.739+0000 7fc5077fe640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc4f4066470 0x7fc4f4068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009b60 tx=0x7fc4f8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:23.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.743+0000 7fc4effff640 1 -- 172.21.15.6:0/4263342704 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4fc0b4280 con 0x7fc508142da0 2023-11-28T21:08:23.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.903+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5080674d0 con 0x7fc508142da0 2023-11-28T21:08:23.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.903+0000 7fc4effff640 1 -- 172.21.15.6:0/4263342704 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fc4fc018090 con 0x7fc508142da0 2023-11-28T21:08:23.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:23.910 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:23.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc4f4066470 msgr2=0x7fc4f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc4f4066470 0x7fc4f4068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009b60 tx=0x7fc4f8009190 comp rx=0 tx=0).stop 2023-11-28T21:08:23.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508142da0 msgr2=0x7fc5081672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:23.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508142da0 0x7fc5081672e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00c480 tx=0x7fc4fc00c940 comp rx=0 tx=0).stop 2023-11-28T21:08:23.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 shutdown_connections 2023-11-28T21:08:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc4f4066470 0x7fc4f4068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50815e7d0 0x7fc50814c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508142da0 0x7fc5081672e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 --2- 172.21.15.6:0/4263342704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50806dd90 0x7fc50813a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 >> 172.21.15.6:0/4263342704 conn(0x7fc50806ab80 msgr2=0x7fc5081413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 shutdown_connections 2023-11-28T21:08:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:23.907+0000 7fc50df80640 1 -- 172.21.15.6:0/4263342704 wait complete. 2023-11-28T21:08:23.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:08:24.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc8217640 1 Processor -- start 2023-11-28T21:08:24.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc8217640 1 -- start start 2023-11-28T21:08:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc8217640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdbc015f230 0x7fdbc00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc8217640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbc0070cf0 0x7fdbc006c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc8217640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc00b32c0 con 0x7fdbc0162890 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc8217640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc015f610 con 0x7fdbc0070cf0 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc8217640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc00b26f0 con 0x7fdbc015f230 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc67b4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbc0070cf0 0x7fdbc006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc67b4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbc0070cf0 0x7fdbc006c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49412/0 (socket says 172.21.15.6:49412) 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc67b4640 1 -- 172.21.15.6:0/796110525 learned_addr learned my addr 172.21.15.6:0/796110525 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc5fb3640 1 --2- 172.21.15.6:0/796110525 >> v2:172.21.15.31:3300/0 conn(0x7fdbc015f230 0x7fdbc00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc67b4640 1 -- 172.21.15.6:0/796110525 >> v2:172.21.15.31:3300/0 conn(0x7fdbc015f230 msgr2=0x7fdbc00b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc67b4640 1 --2- 172.21.15.6:0/796110525 >> v2:172.21.15.31:3300/0 conn(0x7fdbc015f230 0x7fdbc00b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc67b4640 1 -- 172.21.15.6:0/796110525 >> v1:172.21.15.31:6789/0 conn(0x7fdbc0162890 legacy=0x7fdbc00705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.071+0000 7fdbc67b4640 1 -- 172.21.15.6:0/796110525 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc00b2990 con 0x7fdbc0070cf0 2023-11-28T21:08:24.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc67b4640 1 --2- 172.21.15.6:0/796110525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0070cf0 0x7fdbc006c570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006e0d0 tx=0x7fdbb801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20558fd1218ea1c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc4fb1640 1 -- 172.21.15.6:0/796110525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80a5820 con 0x7fdbc0070cf0 2023-11-28T21:08:24.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc4fb1640 1 -- 172.21.15.6:0/796110525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb80a5980 con 0x7fdbc0070cf0 2023-11-28T21:08:24.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc4fb1640 1 -- 172.21.15.6:0/796110525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80a5d10 con 0x7fdbc0070cf0 2023-11-28T21:08:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc8217640 1 -- 172.21.15.6:0/796110525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0070cf0 msgr2=0x7fdbc006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc8217640 1 --2- 172.21.15.6:0/796110525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0070cf0 0x7fdbc006c570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006e0d0 tx=0x7fdbb801c960 comp rx=0 tx=0).stop 2023-11-28T21:08:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc8217640 1 -- 172.21.15.6:0/796110525 shutdown_connections 2023-11-28T21:08:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc8217640 1 --2- 172.21.15.6:0/796110525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0070cf0 0x7fdbc006c570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc8217640 1 --2- 172.21.15.6:0/796110525 >> v2:172.21.15.31:3300/0 conn(0x7fdbc015f230 0x7fdbc00b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc8217640 1 -- 172.21.15.6:0/796110525 >> 172.21.15.6:0/796110525 conn(0x7fdbc006ab80 msgr2=0x7fdbc00b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc8217640 1 -- 172.21.15.6:0/796110525 shutdown_connections 2023-11-28T21:08:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.075+0000 7fdbc8217640 1 -- 172.21.15.6:0/796110525 wait complete. 2023-11-28T21:08:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 Processor -- start 2023-11-28T21:08:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 -- start start 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbc0070cf0 0x7fdbc00cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc015f230 0x7fdbc01608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0162890 0x7fdbc0160e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00cea40 con 0x7fdbc0162890 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00cde30 con 0x7fdbc015f230 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00ce110 con 0x7fdbc0070cf0 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc67b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0162890 0x7fdbc0160e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc67b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0162890 0x7fdbc0160e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49426/0 (socket says 172.21.15.6:49426) 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc67b4640 1 -- 172.21.15.6:0/3175411247 learned_addr learned my addr 172.21.15.6:0/3175411247 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc5fb3640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbc0070cf0 0x7fdbc00cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc57b2640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc015f230 0x7fdbc01608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc67b4640 1 -- 172.21.15.6:0/3175411247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbc0070cf0 msgr2=0x7fdbc00cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc67b4640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbc0070cf0 0x7fdbc00cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc67b4640 1 -- 172.21.15.6:0/3175411247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc015f230 msgr2=0x7fdbc01608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc67b4640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc015f230 0x7fdbc01608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc67b4640 1 -- 172.21.15.6:0/3175411247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8009b30 con 0x7fdbc0162890 2023-11-28T21:08:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc67b4640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0162890 0x7fdbc0160e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80af040 tx=0x7fdbb8019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbb67fc640 1 -- 172.21.15.6:0/3175411247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80b8670 con 0x7fdbc0162890 2023-11-28T21:08:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbb67fc640 1 -- 172.21.15.6:0/3175411247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb80b87d0 con 0x7fdbc0162890 2023-11-28T21:08:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc00ce3f0 con 0x7fdbc0162890 2023-11-28T21:08:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbb67fc640 1 -- 172.21.15.6:0/3175411247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80b8b80 con 0x7fdbc0162890 2023-11-28T21:08:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.079+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc00cdb40 con 0x7fdbc0162890 2023-11-28T21:08:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.083+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc0158fc0 con 0x7fdbc0162890 2023-11-28T21:08:24.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.083+0000 7fdbb67fc640 1 -- 172.21.15.6:0/3175411247 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdbb80b8ce0 con 0x7fdbc0162890 2023-11-28T21:08:24.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.083+0000 7fdbb67fc640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba4066470 0x7fdba4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.083+0000 7fdbb67fc640 1 -- 172.21.15.6:0/3175411247 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbb811f540 con 0x7fdbc0162890 2023-11-28T21:08:24.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.083+0000 7fdbc5fb3640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba4066470 0x7fdba4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.083+0000 7fdbc5fb3640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba4066470 0x7fdba4068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00b9d0 tx=0x7fdbbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.087+0000 7fdbb67fc640 1 -- 172.21.15.6:0/3175411247 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbc0158fc0 con 0x7fdbc0162890 2023-11-28T21:08:24.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.279+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbc0158fc0 con 0x7fdbc0162890 2023-11-28T21:08:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.279+0000 7fdbb67fc640 1 -- 172.21.15.6:0/3175411247 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7fdbc0158fc0 con 0x7fdbc0162890 2023-11-28T21:08:24.286 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:24.286 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2017265312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2017265312},{"type":"v1","addr":"172.21.15.6:6837","nonce":2017265312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2658515931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2658515931},{"type":"v1","addr":"172.21.15.31:6834","nonce":2658515931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3368809777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3368809777},{"type":"v1","addr":"172.21.15.31:6835","nonce":3368809777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:08:09.785431+0000","modified":"2023-11-28T21:08:12.826904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:08:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-11-28T21:08:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba4066470 msgr2=0x7fdba4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba4066470 0x7fdba4068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00b9d0 tx=0x7fdbbc008040 comp rx=0 tx=0).stop 2023-11-28T21:08:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0162890 msgr2=0x7fdbc0160e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0162890 0x7fdbc0160e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80af040 tx=0x7fdbb8019700 comp rx=0 tx=0).stop 2023-11-28T21:08:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 shutdown_connections 2023-11-28T21:08:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba4066470 0x7fdba4068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbc0162890 0x7fdbc0160e00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbc015f230 0x7fdbc01608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 --2- 172.21.15.6:0/3175411247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbc0070cf0 0x7fdbc00cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 >> 172.21.15.6:0/3175411247 conn(0x7fdbc006ab80 msgr2=0x7fdbc006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 shutdown_connections 2023-11-28T21:08:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.283+0000 7fdbc8217640 1 -- 172.21.15.6:0/3175411247 wait complete. 2023-11-28T21:08:24.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T21:08:09.785431+0000', 'modified': '2023-11-28T21:08:12.826904+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6836/3867201250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 3867201250}, {'type': 'v1', 'addr': '172.21.15.6:6836', 'nonce': 3867201250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T21:08:24.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T21:08:24.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T21:08:24.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f835d4fe640 1 Processor -- start 2023-11-28T21:08:24.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f835d4fe640 1 -- start start 2023-11-28T21:08:24.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f835d4fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f835806ca00 0x7f83580cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f835d4fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f835815c440 0x7f835815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f835d4fe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580cc930 con 0x7f835806cde0 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f835d4fe640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580cd400 con 0x7f835815c440 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f835d4fe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83580ccb60 con 0x7f835806ca00 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f834e7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f835806cde0 0x7f835815bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40348/0 (socket says 172.21.15.6:40348) 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f834e7fc640 1 -- 172.21.15.6:0/1993634547 learned_addr learned my addr 172.21.15.6:0/1993634547 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f835806ca00 0x7f83580cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83577fe640 1 --2- 172.21.15.6:0/1993634547 >> v2:172.21.15.31:3300/0 conn(0x7f835815c440 0x7f835815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188364763 0 0) 0x7f83580cc930 con 0x7f835806cde0 2023-11-28T21:08:24.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8344003530 con 0x7f835806cde0 2023-11-28T21:08:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314041055 0 0) 0x7f8344003530 con 0x7f835806cde0 2023-11-28T21:08:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f835806ca00 msgr2=0x7f83580cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f835806ca00 0x7f83580cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 >> v2:172.21.15.31:3300/0 conn(0x7f835815c440 msgr2=0x7f835815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 --2- 172.21.15.6:0/1993634547 >> v2:172.21.15.31:3300/0 conn(0x7f835815c440 0x7f835815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580cce40 con 0x7f835806cde0 2023-11-28T21:08:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f8340001680 con 0x7f835806cde0 2023-11-28T21:08:24.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 >> v1:172.21.15.6:6789/0 conn(0x7f835806cde0 legacy=0x7f835815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f835806ca00 0x7f8344003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344003f50 0x7f83440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8344004d10 0x7f8344005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580cd400 con 0x7f8344004d10 2023-11-28T21:08:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580ccb60 con 0x7f8344003f50 2023-11-28T21:08:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834400ba40 con 0x7f835806ca00 2023-11-28T21:08:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f83577fe640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8344004d10 0x7f8344005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.851+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f835806ca00 0x7f8344003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f834e7fc640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344003f50 0x7f83440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f8356ffd640 1 -- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344003f50 msgr2=0x7f83440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344003f50 0x7f83440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f8356ffd640 1 -- 172.21.15.6:0/1993634547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8344004d10 msgr2=0x7f8344005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8344004d10 0x7f8344005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f8356ffd640 1 -- 172.21.15.6:0/1993634547 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8344003530 con 0x7f835806ca00 2023-11-28T21:08:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f834e7fc640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344003f50 0x7f83440047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f83577fe640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8344004d10 0x7f8344005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:24.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f835806ca00 0x7f8344003980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8348009ae0 tx=0x7f834801ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c461e436decae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480a5680 con 0x7f835806ca00 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83480a57e0 con 0x7f835806ca00 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.855+0000 7f83567fc640 1 -- 172.21.15.6:0/1993634547 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480a5b90 con 0x7f835806ca00 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 -- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f835806ca00 msgr2=0x7f8344003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 --2- 172.21.15.6:0/1993634547 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f835806ca00 0x7f8344003980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8348009ae0 tx=0x7f834801ca90 comp rx=0 tx=0).stop 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f83577fe640 1 -- 172.21.15.6:0/1993634547 reap_dead start 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 -- 172.21.15.6:0/1993634547 shutdown_connections 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 -- 172.21.15.6:0/1993634547 >> 172.21.15.6:0/1993634547 conn(0x7f835806a980 msgr2=0x7f835806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 -- 172.21.15.6:0/1993634547 shutdown_connections 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 -- 172.21.15.6:0/1993634547 wait complete. 2023-11-28T21:08:24.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 Processor -- start 2023-11-28T21:08:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 -- start start 2023-11-28T21:08:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835806ca00 0x7f83581f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8358150bd0 0x7f835815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8358071640 0x7f835814f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835815b260 con 0x7f835806ca00 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83581f7260 con 0x7f8358071640 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f835d4fe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835815aca0 con 0x7f8358150bd0 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f8356ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835806ca00 0x7f83581f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f8356ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835806ca00 0x7f83581f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49444/0 (socket says 172.21.15.6:49444) 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.859+0000 7f8356ffd640 1 -- 172.21.15.6:0/1475276305 learned_addr learned my addr 172.21.15.6:0/1475276305 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f834e7fc640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8358150bd0 0x7f835815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f83577fe640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8358071640 0x7f835814f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f8356ffd640 1 -- 172.21.15.6:0/1475276305 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8358150bd0 msgr2=0x7f835815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8358150bd0 0x7f835815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f8356ffd640 1 -- 172.21.15.6:0/1475276305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8358071640 msgr2=0x7f835814f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8358071640 0x7f835814f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f8356ffd640 1 -- 172.21.15.6:0/1475276305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835815af80 con 0x7f835806ca00 2023-11-28T21:08:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835806ca00 0x7f83581f6d20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83480b0040 tx=0x7f8344005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f834ffff640 1 -- 172.21.15.6:0/1475276305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348004220 con 0x7f835806ca00 2023-11-28T21:08:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f834ffff640 1 -- 172.21.15.6:0/1475276305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348004380 con 0x7f835806ca00 2023-11-28T21:08:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f834ffff640 1 -- 172.21.15.6:0/1475276305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348003840 con 0x7f835806ca00 2023-11-28T21:08:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f835d4fe640 1 -- 172.21.15.6:0/1475276305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83581f6520 con 0x7f835806ca00 2023-11-28T21:08:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f835d4fe640 1 -- 172.21.15.6:0/1475276305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835815a870 con 0x7f835806ca00 2023-11-28T21:08:24.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.863+0000 7f834ffff640 1 -- 172.21.15.6:0/1475276305 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83480b4040 con 0x7f835806ca00 2023-11-28T21:08:24.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834ffff640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8338066470 0x7f8338068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834ffff640 1 -- 172.21.15.6:0/1475276305 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f834811e1b0 con 0x7f835806ca00 2023-11-28T21:08:24.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8338066470 0x7f8338068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 Processor -- start 2023-11-28T21:08:24.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8338066470 0x7f8338068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83400078f0 tx=0x7f8340001de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 -- start start 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad0af5b0 0x5653ad064de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad065320 0x5653ad065700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653acecf130 con 0x5653ad0af5b0 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653acebc9a0 con 0x5653ad065320 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653aceb9ed0 con 0x5653ad0aec90 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad0af5b0 0x5653ad064de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad0af5b0 0x5653ad064de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49454/0 (socket says 172.21.15.6:49454) 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 -- 172.21.15.6:0/1088917994 learned_addr learned my addr 172.21.15.6:0/1088917994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f83577fe640 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad065320 0x5653ad065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 -- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 msgr2=0x5653ad0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 -- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad065320 msgr2=0x5653ad065700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad065320 0x5653ad065700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 -- 172.21.15.6:0/1088917994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653acbad890 con 0x5653ad0af5b0 2023-11-28T21:08:24.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:24.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f83577fe640 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad065320 0x5653ad065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:24.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834e7fc640 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad0af5b0 0x5653ad064de0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f83400058b0 tx=0x7f8340018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2008c491c0cb67 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834cff9640 1 -- 172.21.15.6:0/1088917994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400179b0 con 0x5653ad0af5b0 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834cff9640 1 -- 172.21.15.6:0/1088917994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340017b10 con 0x5653ad0af5b0 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f834cff9640 1 -- 172.21.15.6:0/1088917994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340017c80 con 0x5653ad0af5b0 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 -- 172.21.15.6:0/1088917994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad0af5b0 msgr2=0x5653ad064de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.867+0000 7f8360868000 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad0af5b0 0x5653ad064de0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f83400058b0 tx=0x7f8340018000 comp rx=0 tx=0).stop 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- 172.21.15.6:0/1088917994 shutdown_connections 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad065320 0x5653ad065700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad0af5b0 0x5653ad064de0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 --2- 172.21.15.6:0/1088917994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- 172.21.15.6:0/1088917994 >> 172.21.15.6:0/1088917994 conn(0x5653ad0612d0 msgr2=0x5653ad0636c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- 172.21.15.6:0/1088917994 shutdown_connections 2023-11-28T21:08:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- 172.21.15.6:0/1088917994 wait complete. 2023-11-28T21:08:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- start start 2023-11-28T21:08:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 Processor -- start 2023-11-28T21:08:24.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad069d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad06a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad07d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653aceb57c0 con 0x5653ad065320 2023-11-28T21:08:24.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ace6dbf0 con 0x5653ad0af5b0 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653ace73a90 con 0x5653ad0aec90 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 10 client.0 _ll_register_callbacks cb 0x5653ad0503c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8356ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8356ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad069d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49464/0 (socket says 172.21.15.6:49464) 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8356ffd640 1 -- 172.21.15.6:0/786536140 learned_addr learned my addr 172.21.15.6:0/786536140 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f834e7fc640 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f83577fe640 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad07d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8356ffd640 1 -- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 msgr2=0x5653ad06a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8356ffd640 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad06a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8356ffd640 1 -- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 msgr2=0x5653ad07d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8356ffd640 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad07d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8356ffd640 1 -- 172.21.15.6:0/786536140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83580cce40 con 0x5653ad065320 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f834e7fc640 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad06a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f83577fe640 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad07d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8356ffd640 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad069d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f834801c8c0 tx=0x7f83480eef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be389652714a7ba8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8335ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8335ffb640 1 -- 172.21.15.6:0/786536140 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480f75e0 con 0x5653ad065320 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8335ffb640 1 -- 172.21.15.6:0/786536140 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83480f3020 con 0x5653ad065320 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- 172.21.15.6:0/786536140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653ace77470 con 0x5653ad065320 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8335ffb640 1 -- 172.21.15.6:0/786536140 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83480f31e0 con 0x5653ad065320 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 10 client.4617 fetch_fsmap learned FSMap version 8 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8360868000 1 -- 172.21.15.6:0/786536140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5653ace76190 con 0x5653ad065320 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8335ffb640 1 -- 172.21.15.6:0/786536140 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653ace77470 con 0x5653ad065320 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.871+0000 7f8335ffb640 1 -- 172.21.15.6:0/786536140 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f834811c240 con 0x5653ad065320 2023-11-28T21:08:24.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 10 client.4617 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 10 client.4617 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 20 client.4617 populate_metadata read hostname 'smithi006' 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] conn(0x5653ad07e320 0x5653ad0c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 4 client.4617 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 -- 172.21.15.6:0/786536140 --> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653ace7ab50 con 0x5653ad07e320 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f834e7fc640 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] conn(0x5653ad07e320 0x5653ad0c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f834e7fc640 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] conn(0x5653ad07e320 0x5653ad0c0f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d2bf31c4c1e3817 server_cookie=f1f553d37ad33ff6 in_seq=0 out_seq=0 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8335ffb640 10 client.4617 ms_handle_connect on v2:172.21.15.6:6834/3867201250 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8335ffb640 1 -- 172.21.15.6:0/786536140 <== mds.0 v2:172.21.15.6:6834/3867201250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5653ace7ab50 con 0x5653ad07e320 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8335ffb640 10 client.4617 handle_command_reply: tid=0 2023-11-28T21:08:24.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 client.4617 shutdown 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 -- 172.21.15.6:0/786536140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 msgr2=0x5653ad069d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad069d40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f834801c8c0 tx=0x7f83480eef90 comp rx=0 tx=0).stop 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 -- 172.21.15.6:0/786536140 shutdown_connections 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] conn(0x5653ad07e320 0x5653ad0c0f50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad07d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad06a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8335ffb640 0 client.4617 ms_handle_reset on v2:172.21.15.6:6834/3867201250 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 --2- 172.21.15.6:0/786536140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad069d40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 -- 172.21.15.6:0/786536140 >> 172.21.15.6:0/786536140 conn(0x5653ad0612d0 msgr2=0x5653ad0636c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 -- 172.21.15.6:0/786536140 shutdown_connections 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 1 -- 172.21.15.6:0/786536140 wait complete. 2023-11-28T21:08:24.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.875+0000 7f8360868000 20 client.4617 trim_cache size 0 max 16384 2023-11-28T21:08:24.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8360868000 1 Processor -- start 2023-11-28T21:08:24.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8360868000 1 -- start start 2023-11-28T21:08:24.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8360868000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8360868000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0ad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8360868000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad0917a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8360868000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653acb6e940 con 0x5653ad065320 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8360868000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653acf3cfa0 con 0x5653ad0af5b0 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8360868000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653aceb4650 con 0x5653ad0aec90 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8356ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8356ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad0acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49476/0 (socket says 172.21.15.6:49476) 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8356ffd640 1 -- 172.21.15.6:0/1417056980 learned_addr learned my addr 172.21.15.6:0/1417056980 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8356ffd640 1 -- 172.21.15.6:0/1417056980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 msgr2=0x5653ad0ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1417056980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8356ffd640 1 -- 172.21.15.6:0/1417056980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 msgr2=0x5653ad0917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1417056980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad0917a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8356ffd640 1 -- 172.21.15.6:0/1417056980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653ace5c490 con 0x5653ad065320 2023-11-28T21:08:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f8356ffd640 1 --2- 172.21.15.6:0/1417056980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad0acb30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f834811c570 tx=0x7f83480ba000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e8ad387de9c61b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f834d7fa640 1 -- 172.21.15.6:0/1417056980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480f75e0 con 0x5653ad065320 2023-11-28T21:08:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f834d7fa640 1 -- 172.21.15.6:0/1417056980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834811c240 con 0x5653ad065320 2023-11-28T21:08:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.891+0000 7f834d7fa640 1 -- 172.21.15.6:0/1417056980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834811c3b0 con 0x5653ad065320 2023-11-28T21:08:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- 172.21.15.6:0/1417056980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 msgr2=0x5653ad0acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 --2- 172.21.15.6:0/1417056980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad0acb30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f834811c570 tx=0x7f83480ba000 comp rx=0 tx=0).stop 2023-11-28T21:08:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- 172.21.15.6:0/1417056980 shutdown_connections 2023-11-28T21:08:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 --2- 172.21.15.6:0/1417056980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad0917a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 --2- 172.21.15.6:0/1417056980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 --2- 172.21.15.6:0/1417056980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad0acb30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- 172.21.15.6:0/1417056980 >> 172.21.15.6:0/1417056980 conn(0x5653ad0612d0 msgr2=0x5653ad0636c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- 172.21.15.6:0/1417056980 shutdown_connections 2023-11-28T21:08:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- 172.21.15.6:0/1417056980 wait complete. 2023-11-28T21:08:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- start start 2023-11-28T21:08:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 Processor -- start 2023-11-28T21:08:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad091bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ace6ed60 con 0x5653ad065320 2023-11-28T21:08:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653ad06c890 con 0x5653ad0af5b0 2023-11-28T21:08:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653ad06afb0 con 0x5653ad0aec90 2023-11-28T21:08:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 10 client.0 _ll_register_callbacks cb 0x5653acf03c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T21:08:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8356ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad091bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8356ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad091bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49478/0 (socket says 172.21.15.6:49478) 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8356ffd640 1 -- 172.21.15.6:0/827999984 learned_addr learned my addr 172.21.15.6:0/827999984 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f83577fe640 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f834e7fc640 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8356ffd640 1 -- 172.21.15.6:0/827999984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 msgr2=0x5653ad0c0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8356ffd640 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0c0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8356ffd640 1 -- 172.21.15.6:0/827999984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 msgr2=0x5653ad0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8356ffd640 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad0c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8356ffd640 1 -- 172.21.15.6:0/827999984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653ace76190 con 0x5653ad065320 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8356ffd640 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad091bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f834801d000 tx=0x7f834811c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db9feb4e51bf81e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8335ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-11-28T21:08:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8335ffb640 1 -- 172.21.15.6:0/827999984 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834811c3b0 con 0x5653ad065320 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8335ffb640 1 -- 172.21.15.6:0/827999984 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83480f75e0 con 0x5653ad065320 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- 172.21.15.6:0/827999984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653ad0695c0 con 0x5653ad065320 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8335ffb640 1 -- 172.21.15.6:0/827999984 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83480eea90 con 0x5653ad065320 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 10 client.4623 fetch_fsmap learned FSMap version 8 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- 172.21.15.6:0/827999984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5653acbadcc0 con 0x5653ad065320 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8335ffb640 1 -- 172.21.15.6:0/827999984 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653ad0695c0 con 0x5653ad065320 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8335ffb640 1 -- 172.21.15.6:0/827999984 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f83480f30d0 con 0x5653ad065320 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 10 client.4623 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 10 client.4623 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 20 client.4623 populate_metadata read hostname 'smithi006' 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] conn(0x5653ad115e30 0x5653ad118220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:24.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 4 client.4623 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.895+0000 7f8360868000 1 -- 172.21.15.6:0/827999984 --> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5653aceb4110 con 0x5653ad115e30 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f834e7fc640 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] conn(0x5653ad115e30 0x5653ad118220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f834e7fc640 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] conn(0x5653ad115e30 0x5653ad118220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9085d836448b136 server_cookie=b43c1149563861d0 in_seq=0 out_seq=0 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8335ffb640 10 client.4623 ms_handle_connect on v2:172.21.15.6:6834/3867201250 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8335ffb640 1 -- 172.21.15.6:0/827999984 <== mds.0 v2:172.21.15.6:6834/3867201250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5653aceb4110 con 0x5653ad115e30 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8335ffb640 10 client.4623 handle_command_reply: tid=0 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 client.4623 shutdown 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 -- 172.21.15.6:0/827999984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 msgr2=0x5653ad091bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad091bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f834801d000 tx=0x7f834811c5a0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 -- 172.21.15.6:0/827999984 shutdown_connections 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.6:6834/3867201250,v1:172.21.15.6:6836/3867201250] conn(0x5653ad115e30 0x5653ad118220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5653ad0af5b0 0x5653ad0c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5653ad0aec90 0x5653ad0c0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 --2- 172.21.15.6:0/827999984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5653ad065320 0x5653ad091bd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 -- 172.21.15.6:0/827999984 >> 172.21.15.6:0/827999984 conn(0x5653ad0612d0 msgr2=0x5653ad063f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8335ffb640 0 client.4623 ms_handle_reset on v2:172.21.15.6:6834/3867201250 2023-11-28T21:08:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 -- 172.21.15.6:0/827999984 shutdown_connections 2023-11-28T21:08:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 1 -- 172.21.15.6:0/827999984 wait complete. 2023-11-28T21:08:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f8360868000 20 client.4623 trim_cache size 0 max 16384 2023-11-28T21:08:24.911 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-28T21:08:24.911 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "3f552c97-91e2-4211-95f6-2c2c108871dc", 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4275, 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 14.494334330999999, 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 8, 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 21, 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 21, 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 21.981844089999999 2023-11-28T21:08:24.912 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-28T21:08:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 -- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8338066470 msgr2=0x7f8338068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8338066470 0x7f8338068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83400078f0 tx=0x7f8340001de0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 -- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835806ca00 msgr2=0x7f83581f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835806ca00 0x7f83581f6d20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83480b0040 tx=0x7f8344005800 comp rx=0 tx=0).stop 2023-11-28T21:08:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 -- 172.21.15.6:0/1475276305 shutdown_connections 2023-11-28T21:08:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8338066470 0x7f8338068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8358071640 0x7f835814f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8358150bd0 0x7f835815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 --2- 172.21.15.6:0/1475276305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835806ca00 0x7f83581f6d20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 -- 172.21.15.6:0/1475276305 >> 172.21.15.6:0/1475276305 conn(0x7f835806a980 msgr2=0x7f835815bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 -- 172.21.15.6:0/1475276305 shutdown_connections 2023-11-28T21:08:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:24.899+0000 7f835d4fe640 1 -- 172.21.15.6:0/1475276305 wait complete. 2023-11-28T21:08:24.924 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-28T21:08:24.948 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-28T21:08:24.948 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-28T21:08:24.948 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-28T21:08:24.948 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T21:08:24.948 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:24.948 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-28T21:08:24.948 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T21:08:24.949 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T21:08:24.949 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-28T21:08:24.949 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T21:08:24.949 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:24.949 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-28T21:08:24.949 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T21:08:24.949 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T21:08:24.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:24.949 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-28T21:08:24.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:24.965 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2023-11-28T21:08:25.034 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2023-11-28T21:08:25.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:08:25.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.037 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-11-28T21:08:25.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-11-28T21:08:25.115 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-11-28T21:08:25.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:08:25.117 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-28T21:08:25.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T21:08:25.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.299+0000 7fdda26dd640 1 Processor -- start 2023-11-28T21:08:25.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.299+0000 7fdda26dd640 1 -- start start 2023-11-28T21:08:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.299+0000 7fdda26dd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 0x7fdd9c1605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdda26dd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd9c0b2550 0x7fdd9c160b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdda26dd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0aff60 con 0x7fdd9c0d3a50 2023-11-28T21:08:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdda26dd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c0b0240 con 0x7fdd9c0b2550 2023-11-28T21:08:25.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdda26dd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0b0520 con 0x7fdd9c0d1880 2023-11-28T21:08:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdd9b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd9c0b2550 0x7fdd9c160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdd9bfff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 0x7fdd9c1605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdda0c7a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdd9c0d3a50 0x7fdd9c0b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:54624/0 (socket says 172.21.15.6:54624) 2023-11-28T21:08:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdda0c7a640 1 -- 172.21.15.6:0/3398788763 learned_addr learned my addr 172.21.15.6:0/3398788763 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdd9bfff640 1 -- 172.21.15.6:0/3398788763 >> v2:172.21.15.31:3300/0 conn(0x7fdd9c0b2550 msgr2=0x7fdd9c160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:25.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdd9bfff640 1 --2- 172.21.15.6:0/3398788763 >> v2:172.21.15.31:3300/0 conn(0x7fdd9c0b2550 0x7fdd9c160b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdd9bfff640 1 -- 172.21.15.6:0/3398788763 >> v1:172.21.15.31:6789/0 conn(0x7fdd9c0d3a50 legacy=0x7fdd9c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdd9bfff640 1 -- 172.21.15.6:0/3398788763 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0b0800 con 0x7fdd9c0d1880 2023-11-28T21:08:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.303+0000 7fdd9b7fe640 1 --2- 172.21.15.6:0/3398788763 >> v2:172.21.15.31:3300/0 conn(0x7fdd9c0b2550 0x7fdd9c160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:25.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdd9bfff640 1 --2- 172.21.15.6:0/3398788763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 0x7fdd9c1605c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0097c0 tx=0x7fdd8c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbeba000e50097d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:25.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdd9affd640 1 -- 172.21.15.6:0/3398788763 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0a6040 con 0x7fdd9c0d1880 2023-11-28T21:08:25.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdd9affd640 1 -- 172.21.15.6:0/3398788763 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c0aa600 con 0x7fdd9c0d1880 2023-11-28T21:08:25.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdd9affd640 1 -- 172.21.15.6:0/3398788763 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0aa990 con 0x7fdd9c0d1880 2023-11-28T21:08:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 -- 172.21.15.6:0/3398788763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 msgr2=0x7fdd9c1605c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 --2- 172.21.15.6:0/3398788763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 0x7fdd9c1605c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0097c0 tx=0x7fdd8c01c480 comp rx=0 tx=0).stop 2023-11-28T21:08:25.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 -- 172.21.15.6:0/3398788763 shutdown_connections 2023-11-28T21:08:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 --2- 172.21.15.6:0/3398788763 >> v2:172.21.15.31:3300/0 conn(0x7fdd9c0b2550 0x7fdd9c160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 --2- 172.21.15.6:0/3398788763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 0x7fdd9c1605c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 -- 172.21.15.6:0/3398788763 >> 172.21.15.6:0/3398788763 conn(0x7fdd9c09c460 msgr2=0x7fdd9c0d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 -- 172.21.15.6:0/3398788763 shutdown_connections 2023-11-28T21:08:25.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 -- 172.21.15.6:0/3398788763 wait complete. 2023-11-28T21:08:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 Processor -- start 2023-11-28T21:08:25.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.307+0000 7fdda26dd640 1 -- start start 2023-11-28T21:08:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda26dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9c0b2550 0x7fdd9c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda26dd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 0x7fdd9c145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda26dd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd9c0d3a50 0x7fdd9c1456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda26dd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c158590 con 0x7fdd9c0b2550 2023-11-28T21:08:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda26dd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c15f0c0 con 0x7fdd9c0d3a50 2023-11-28T21:08:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda26dd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c157ca0 con 0x7fdd9c0d1880 2023-11-28T21:08:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9c0b2550 0x7fdd9c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9c0b2550 0x7fdd9c15eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49492/0 (socket says 172.21.15.6:49492) 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9bfff640 1 -- 172.21.15.6:0/2974066530 learned_addr learned my addr 172.21.15.6:0/2974066530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9b7fe640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 0x7fdd9c145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda0c7a640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd9c0d3a50 0x7fdd9c1456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9bfff640 1 -- 172.21.15.6:0/2974066530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 msgr2=0x7fdd9c145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9bfff640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 0x7fdd9c145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9bfff640 1 -- 172.21.15.6:0/2974066530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd9c0d3a50 msgr2=0x7fdd9c1456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9bfff640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd9c0d3a50 0x7fdd9c1456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9bfff640 1 -- 172.21.15.6:0/2974066530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd90009420 con 0x7fdd9c0b2550 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd9bfff640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9c0b2550 0x7fdd9c15eb80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c01a0b0 tx=0x7fdd8c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd98ff9640 1 -- 172.21.15.6:0/2974066530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0b3800 con 0x7fdd9c0b2550 2023-11-28T21:08:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd98ff9640 1 -- 172.21.15.6:0/2974066530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c0b3960 con 0x7fdd9c0b2550 2023-11-28T21:08:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd98ff9640 1 -- 172.21.15.6:0/2974066530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0b3cf0 con 0x7fdd9c0b2550 2023-11-28T21:08:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c009420 con 0x7fdd9c0b2550 2023-11-28T21:08:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c158220 con 0x7fdd9c0b2550 2023-11-28T21:08:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c0674d0 con 0x7fdd9c0b2550 2023-11-28T21:08:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.311+0000 7fdd98ff9640 1 -- 172.21.15.6:0/2974066530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd9c0b1f40 con 0x7fdd9c0b2550 2023-11-28T21:08:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.315+0000 7fdd98ff9640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdd88066470 0x7fdd88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.315+0000 7fdd98ff9640 1 -- 172.21.15.6:0/2974066530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd8c11e2c0 con 0x7fdd9c0b2550 2023-11-28T21:08:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.315+0000 7fdd9b7fe640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdd88066470 0x7fdd88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:25.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.315+0000 7fdd9b7fe640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdd88066470 0x7fdd88068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0cfcc0 tx=0x7fdd90009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:25.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.319+0000 7fdd98ff9640 1 -- 172.21.15.6:0/2974066530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd8c0eb750 con 0x7fdd9c0b2550 2023-11-28T21:08:25.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdd9c0b77d0 con 0x7fdd9c0b2550 2023-11-28T21:08:25.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdd98ff9640 1 -- 172.21.15.6:0/2974066530 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdd8c0c3060 con 0x7fdd9c0b2550 2023-11-28T21:08:25.521 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T21:08:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdd88066470 msgr2=0x7fdd88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdd88066470 0x7fdd88068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0cfcc0 tx=0x7fdd90009190 comp rx=0 tx=0).stop 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9c0b2550 msgr2=0x7fdd9c15eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9c0b2550 0x7fdd9c15eb80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c01a0b0 tx=0x7fdd8c01acc0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 shutdown_connections 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdd88066470 0x7fdd88068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd9c0d3a50 0x7fdd9c1456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdd9c0d1880 0x7fdd9c145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 --2- 172.21.15.6:0/2974066530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9c0b2550 0x7fdd9c15eb80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.515+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 >> 172.21.15.6:0/2974066530 conn(0x7fdd9c09c460 msgr2=0x7fdd9c15c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.519+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 shutdown_connections 2023-11-28T21:08:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:25.519+0000 7fdda26dd640 1 -- 172.21.15.6:0/2974066530 wait complete. 2023-11-28T21:08:25.542 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T21:08:25.542 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T21:08:25.542 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-11-28T21:08:25.542 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T21:08:25.542 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:25.543 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T21:08:25.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T21:08:25.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T21:08:25.543 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T21:08:25.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.543 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-11-28T21:08:25.553 INFO:teuthology.orchestra.run.smithi006.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42411sec preferred_lft 42411sec 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-11-28T21:08:25.554 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T21:08:25.555 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:e1:03:b3:a2 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:25.555 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T21:08:25.555 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:25.556 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T21:08:25.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.556 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:08:25.556 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:08:25.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-11-28T21:08:25.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-11-28T21:08:25.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-11-28T21:08:25.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T21:08:25.557 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:08:25.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.674 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T21:08:25.695 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-11-28T21:08:25.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.697 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-11-28T21:08:25.776 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-11-28T21:08:25.776 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T21:08:25.776 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T21:08:25.777 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T21:08:25.777 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T21:08:25.777 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T21:08:25.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.777 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:08:25.777 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:08:25.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T21:08:25.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T21:08:25.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T21:08:25.778 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:08:25.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.871 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-11-28T21:08:25.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.882 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-11-28T21:08:25.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:25.932 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:08:25.933 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:08:25.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:25.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T21:08:25.933 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:08:26.020 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T21:08:26.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:26.021 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:08:26.021 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:08:26.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T21:08:26.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T21:08:26.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T21:08:26.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T21:08:26.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T21:08:26.021 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:08:26.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:26.186 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:08:26.186 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:08:26.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-11-28T21:08:26.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T21:08:26.186 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:08:26.232 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T21:08:26.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:08:26.232 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:26.283 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T21:08:26.284 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:08:26.284 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:26.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-11-28T21:08:26.400 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:26.453 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2023-11-28T21:08:26.453 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2023-11-28T21:08:26.453 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2023-11-28T21:08:26.453 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2023-11-28T21:08:26.453 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2023-11-28T21:08:26.453 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2023-11-28T21:08:26.454 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2023-11-28T21:08:26.454 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2023-11-28T21:08:26.454 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2023-11-28T21:08:26.454 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2023-11-28T21:08:26.454 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2023-11-28T21:08:26.454 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2023-11-28T21:08:26.454 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:26.454 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2023-11-28T21:08:26.455 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2023-11-28T21:08:26.455 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2023-11-28T21:08:26.455 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2023-11-28T21:08:26.455 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2023-11-28T21:08:26.455 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:26.455 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2023-11-28T21:08:26.455 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:26.456 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2023-11-28T21:08:26.456 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2023-11-28T21:08:26.456 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2023-11-28T21:08:26.456 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T21:08:26.456 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T21:08:26.456 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T21:08:26.456 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T21:08:26.457 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2023-11-28T21:08:26.457 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:26.457 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:26.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:26.458 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-11-28T21:08:26.511 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T21:08:26.512 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T21:08:26.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-11-28T21:08:26.579 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:26.633 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2023-11-28T21:08:26.633 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2023-11-28T21:08:26.633 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2023-11-28T21:08:26.633 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2023-11-28T21:08:26.633 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2023-11-28T21:08:26.633 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2023-11-28T21:08:26.633 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2023-11-28T21:08:26.633 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2023-11-28T21:08:26.634 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:26.635 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:26.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:26.636 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-11-28T21:08:26.667 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-11-28T21:08:26.659+0000 7f0289b2f580 -1 init, newargv = 0x55cb422b9f50 newargc=15 2023-11-28T21:08:26.667 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[44423]: starting ceph client 2023-11-28T21:08:26.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[44423]: starting fuse 2023-11-28T21:08:27.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-11-28T21:08:27.804 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:27.857 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2023-11-28T21:08:27.858 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T21:08:27.859 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T21:08:27.860 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T21:08:27.860 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2023-11-28T21:08:27.860 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:27.860 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:27.860 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:27.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:27.861 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-11-28T21:08:27.912 INFO:teuthology.orchestra.run.smithi006.stdout:43 2023-11-28T21:08:27.912 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T21:08:27.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2023-11-28T21:08:27.912 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-11-28T21:08:27.912 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-11-28T21:08:27.912 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-11-28T21:08:27.912 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-11-28T21:08:27.912 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:08:27.912 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-11-28T21:08:27.913 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-11-28T21:08:27.914 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-11-28T21:08:27.914 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T21:08:27.914 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:08:27.914 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-11-28T21:08:27.914 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-11-28T21:08:28.051 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.44423.asok 2023-11-28T21:08:28.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T21:08:28.064 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44423.asok 2023-11-28T21:08:28.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:28.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44423.asok status 2023-11-28T21:08:28.242 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "44423", 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-11-28T21:08:28.243 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-11-28T21:08:28.244 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4632, 2023-11-28T21:08:28.244 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-11-28T21:08:28.244 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-11-28T21:08:28.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-11-28T21:08:28.244 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4632 2023-11-28T21:08:28.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:08:28.244 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-11-28T21:08:28.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-11-28T21:08:28.244 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3950084270 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3950084270 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4632 192.168.0.1:0/3950084270", 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/3950084270", 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-11-28T21:08:28.245 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 8, 2023-11-28T21:08:28.246 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 21, 2023-11-28T21:08:28.246 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-11-28T21:08:28.246 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-11-28T21:08:28.246 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-11-28T21:08:28.246 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-28T21:08:28.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T21:08:28.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.395+0000 7f0e157b8640 1 Processor -- start 2023-11-28T21:08:28.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.395+0000 7f0e157b8640 1 -- start start 2023-11-28T21:08:28.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e157b8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e10159c20 0x7f0e100b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:28.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e157b8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10071100 0x7f0e10071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:28.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e157b8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e100703d0 con 0x7f0e100b2f00 2023-11-28T21:08:28.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e157b8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e10071a70 con 0x7f0e10159c20 2023-11-28T21:08:28.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e157b8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100b36a0 con 0x7f0e10071100 2023-11-28T21:08:28.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e0effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e10159c20 0x7f0e100b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:28.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e0f7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10071100 0x7f0e10071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:28.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e0effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e10159c20 0x7f0e100b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:37658/0 (socket says 172.21.15.6:37658) 2023-11-28T21:08:28.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e0effd640 1 -- 172.21.15.6:0/958457086 learned_addr learned my addr 172.21.15.6:0/958457086 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:28.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e0effd640 1 -- 172.21.15.6:0/958457086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10071100 msgr2=0x7f0e10071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:28.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e0effd640 1 --2- 172.21.15.6:0/958457086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10071100 0x7f0e10071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e0effd640 1 -- 172.21.15.6:0/958457086 >> v1:172.21.15.31:6789/0 conn(0x7f0e100b2f00 legacy=0x7f0e1006c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:28.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.399+0000 7f0e0effd640 1 -- 172.21.15.6:0/958457086 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10070620 con 0x7f0e10159c20 2023-11-28T21:08:28.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e0effd640 1 --2- 172.21.15.6:0/958457086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e10159c20 0x7f0e100b3e90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e00009870 tx=0x7f0e0001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ac6b2cbcb11819 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:28.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e0e7fc640 1 -- 172.21.15.6:0/958457086 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e000ab600 con 0x7f0e10159c20 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e0e7fc640 1 -- 172.21.15.6:0/958457086 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e000a7050 con 0x7f0e10159c20 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e0e7fc640 1 -- 172.21.15.6:0/958457086 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e000ab980 con 0x7f0e10159c20 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 -- 172.21.15.6:0/958457086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e10159c20 msgr2=0x7f0e100b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 --2- 172.21.15.6:0/958457086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e10159c20 0x7f0e100b3e90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e00009870 tx=0x7f0e0001c480 comp rx=0 tx=0).stop 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 -- 172.21.15.6:0/958457086 shutdown_connections 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 --2- 172.21.15.6:0/958457086 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10071100 0x7f0e10071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 --2- 172.21.15.6:0/958457086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e10159c20 0x7f0e100b3e90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 -- 172.21.15.6:0/958457086 >> 172.21.15.6:0/958457086 conn(0x7f0e1006ab80 msgr2=0x7f0e100b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 -- 172.21.15.6:0/958457086 shutdown_connections 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 -- 172.21.15.6:0/958457086 wait complete. 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 Processor -- start 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.403+0000 7f0e157b8640 1 -- start start 2023-11-28T21:08:28.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e157b8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e10071100 0x7f0e1014b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e157b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e100b2f00 0x7f0e10144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e157b8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10159c20 0x7f0e10145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e157b8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100cbc60 con 0x7f0e100b2f00 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e157b8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100cbeb0 con 0x7f0e10071100 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e157b8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100cc190 con 0x7f0e10159c20 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e067fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e100b2f00 0x7f0e10144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e067fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e100b2f00 0x7f0e10144b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52046/0 (socket says 172.21.15.6:52046) 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e067fc640 1 -- 172.21.15.6:0/3267476586 learned_addr learned my addr 172.21.15.6:0/3267476586 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e0effd640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e10071100 0x7f0e1014b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e0f7fe640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10159c20 0x7f0e10145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e067fc640 1 -- 172.21.15.6:0/3267476586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10159c20 msgr2=0x7f0e10145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e067fc640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10159c20 0x7f0e10145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e067fc640 1 -- 172.21.15.6:0/3267476586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e10071100 msgr2=0x7f0e1014b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:28.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e067fc640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e10071100 0x7f0e1014b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e067fc640 1 -- 172.21.15.6:0/3267476586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e000094d0 con 0x7f0e100b2f00 2023-11-28T21:08:28.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e067fc640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e100b2f00 0x7f0e10144b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0df800c500 tx=0x7f0df800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:28.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e07fff640 1 -- 172.21.15.6:0/3267476586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8005220 con 0x7f0e100b2f00 2023-11-28T21:08:28.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e07fff640 1 -- 172.21.15.6:0/3267476586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df8005380 con 0x7f0e100b2f00 2023-11-28T21:08:28.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e07fff640 1 -- 172.21.15.6:0/3267476586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8007270 con 0x7f0e100b2f00 2023-11-28T21:08:28.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e100cc470 con 0x7f0e100b2f00 2023-11-28T21:08:28.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e100cca30 con 0x7f0e100b2f00 2023-11-28T21:08:28.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e100ccc50 con 0x7f0e100b2f00 2023-11-28T21:08:28.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.407+0000 7f0e07fff640 1 -- 172.21.15.6:0/3267476586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0df80073d0 con 0x7f0e100b2f00 2023-11-28T21:08:28.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.411+0000 7f0e07fff640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0df0066470 0x7f0df0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:28.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.411+0000 7f0e07fff640 1 -- 172.21.15.6:0/3267476586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0df8083710 con 0x7f0e100b2f00 2023-11-28T21:08:28.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.411+0000 7f0e0effd640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0df0066470 0x7f0df0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:28.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.411+0000 7f0e0effd640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0df0066470 0x7f0df0068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e000ad000 tx=0x7f0e00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:28.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.415+0000 7f0e07fff640 1 -- 172.21.15.6:0/3267476586 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0df8050bb0 con 0x7f0e100b2f00 2023-11-28T21:08:28.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e100674d0 con 0x7f0e100b2f00 2023-11-28T21:08:28.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e07fff640 1 -- 172.21.15.6:0/3267476586 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0df80541d0 con 0x7f0e100b2f00 2023-11-28T21:08:28.612 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T21:08:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0df0066470 msgr2=0x7f0df0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0df0066470 0x7f0df0068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e000ad000 tx=0x7f0e00008040 comp rx=0 tx=0).stop 2023-11-28T21:08:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e100b2f00 msgr2=0x7f0e10144b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e100b2f00 0x7f0e10144b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0df800c500 tx=0x7f0df800c9c0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 shutdown_connections 2023-11-28T21:08:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0df0066470 0x7f0df0068930 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e10159c20 0x7f0e10145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e100b2f00 0x7f0e10144b40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 --2- 172.21.15.6:0/3267476586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e10071100 0x7f0e1014b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 >> 172.21.15.6:0/3267476586 conn(0x7f0e1006ab80 msgr2=0x7f0e101675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 shutdown_connections 2023-11-28T21:08:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:28.607+0000 7f0e157b8640 1 -- 172.21.15.6:0/3267476586 wait complete. 2023-11-28T21:08:28.634 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T21:08:28.634 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T21:08:28.634 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-11-28T21:08:28.634 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-28T21:08:28.635 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T21:08:28.635 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T21:08:28.635 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T21:08:28.635 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T21:08:28.635 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-28T21:08:28.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:28.635 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-11-28T21:08:28.646 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T21:08:28.646 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T21:08:28.646 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T21:08:28.646 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:28.646 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-11-28T21:08:28.647 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:28.647 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:28.647 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:28.647 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-11-28T21:08:28.647 INFO:teuthology.orchestra.run.smithi006.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T21:08:28.647 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:28.647 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-11-28T21:08:28.647 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T21:08:28.647 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42408sec preferred_lft 42408sec 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T21:08:28.648 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:e1:03:b3:a2 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T21:08:28.649 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:28.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:28.650 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T21:08:28.710 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-11-28T21:08:28.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:28.713 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-11-28T21:08:28.765 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-11-28T21:08:28.765 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T21:08:28.765 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T21:08:28.766 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T21:08:28.766 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T21:08:28.766 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T21:08:28.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:28.767 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:08:28.767 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:08:28.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T21:08:28.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T21:08:28.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T21:08:28.768 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:08:28.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:28.860 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-11-28T21:08:28.871 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T21:08:28.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:28.871 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-11-28T21:08:28.927 INFO:teuthology.orchestra.run.smithi006.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-28T21:08:28.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:28.928 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:08:28.928 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:08:28.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:08:28.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-28T21:08:28.928 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:08:29.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:29.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T21:08:29.076 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T21:08:29.077 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T21:08:29.077 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T21:08:29.077 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:29.077 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-11-28T21:08:29.077 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:29.077 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T21:08:29.077 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ba:da:aa:ef:b1:2f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T21:08:29.077 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T21:08:29.077 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:29.078 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::b8da:aaff:feef:b12f/64 scope link 2023-11-28T21:08:29.078 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:29.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:29.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T21:08:29.148 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T21:08:29.149 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T21:08:29.149 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T21:08:29.149 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:29.149 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-11-28T21:08:29.149 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:29.149 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T21:08:29.149 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ba:da:aa:ef:b1:2f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T21:08:29.149 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T21:08:29.150 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:29.150 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::b8da:aaff:feef:b12f/64 scope link 2023-11-28T21:08:29.150 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:29.151 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-28T21:08:29.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:29.151 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:08:29.152 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:08:29.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-28T21:08:29.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T21:08:29.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-28T21:08:29.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-28T21:08:29.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-28T21:08:29.152 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:08:29.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:29.296 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:08:29.296 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:08:29.297 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.1 up 2023-11-28T21:08:29.297 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T21:08:29.297 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:08:29.338 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-28T21:08:29.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:08:29.339 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-28T21:08:29.392 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-28T21:08:29.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:08:29.393 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-28T21:08:29.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-11-28T21:08:29.512 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2023-11-28T21:08:29.565 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:29.566 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:08:29.567 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:08:29.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:29.568 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-11-28T21:08:29.623 INFO:teuthology.orchestra.run.smithi006.stdout:43 2023-11-28T21:08:29.623 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-28T21:08:29.624 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-28T21:08:29.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-11-28T21:08:29.695 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:29.753 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2023-11-28T21:08:29.753 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2023-11-28T21:08:29.753 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2023-11-28T21:08:29.753 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2023-11-28T21:08:29.754 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T21:08:29.755 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2023-11-28T21:08:29.756 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:29.756 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:08:29.756 INFO:teuthology.orchestra.run.smithi006.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:29.756 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:08:29.756 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:08:29.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:29.757 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-11-28T21:08:29.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi006.stderr:2023-11-28T21:08:29.763+0000 7f1e3a22a580 -1 init, newargv = 0x562abef31fe0 newargc=15 2023-11-28T21:08:29.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi006.stderr:ceph-fuse[44561]: starting ceph client 2023-11-28T21:08:29.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi006.stderr:ceph-fuse[44561]: starting fuse 2023-11-28T21:08:29.780 INFO:teuthology.orchestra.run.smithi006.stdout:43 2023-11-28T21:08:29.780 INFO:teuthology.orchestra.run.smithi006.stdout:44 2023-11-28T21:08:29.781 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-28T21:08:29.781 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T21:08:29.782 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:08:29.783 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.2")) 2023-11-28T21:08:29.783 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-11-28T21:08:29.906 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.2.44561.asok 2023-11-28T21:08:29.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T21:08:29.917 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44561.asok 2023-11-28T21:08:29.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:29.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44561.asok status 2023-11-28T21:08:30.096 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-28T21:08:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-11-28T21:08:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T21:08:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T21:08:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "2", 2023-11-28T21:08:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-11-28T21:08:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-28T21:08:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "44561", 2023-11-28T21:08:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4641, 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4641 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-11-28T21:08:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.2:0", 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2340925822 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.2:0", 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2340925822 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4641 192.168.0.2:0/2340925822", 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.2:0/2340925822", 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-11-28T21:08:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 8, 2023-11-28T21:08:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 21, 2023-11-28T21:08:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-11-28T21:08:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-11-28T21:08:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-11-28T21:08:30.099 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-28T21:08:30.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T21:08:30.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.247+0000 7f5c02009640 1 Processor -- start 2023-11-28T21:08:30.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.247+0000 7f5c02009640 1 -- start start 2023-11-28T21:08:30.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5c02009640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bfc140e90 0x7f5bfc165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:30.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5c02009640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bfc0cea50 con 0x7f5bfc15c250 2023-11-28T21:08:30.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5c02009640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bfc0ce1b0 con 0x7f5bfc13e090 2023-11-28T21:08:30.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5c02009640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bfc13e470 con 0x7f5bfc140e90 2023-11-28T21:08:30.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5bfbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bfc140e90 0x7f5bfc165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:30.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5bfaffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5bfc15c250 0x7f5bfc140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35790/0 (socket says 172.21.15.6:35790) 2023-11-28T21:08:30.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5bfaffd640 1 -- 172.21.15.6:0/379710246 learned_addr learned my addr 172.21.15.6:0/379710246 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:30.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5bfbfff640 1 --2- 172.21.15.6:0/379710246 >> v2:172.21.15.6:3300/0 conn(0x7f5bfc140e90 0x7f5bfc165f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52048/0 (socket says 172.21.15.6:52048) 2023-11-28T21:08:30.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5bfbfff640 1 -- 172.21.15.6:0/379710246 >> v1:172.21.15.31:6789/0 conn(0x7f5bfc13e090 legacy=0x7f5bfc0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:30.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5bfbfff640 1 -- 172.21.15.6:0/379710246 >> v1:172.21.15.6:6789/0 conn(0x7f5bfc15c250 legacy=0x7f5bfc140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:30.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5bfa7fc640 1 -- 172.21.15.6:0/379710246 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526247134 0 0) 0x7f5bfc0ce1b0 con 0x7f5bfc13e090 2023-11-28T21:08:30.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.251+0000 7f5bfbfff640 1 -- 172.21.15.6:0/379710246 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc0ce490 con 0x7f5bfc140e90 2023-11-28T21:08:30.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5bfbfff640 1 --2- 172.21.15.6:0/379710246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 0x7f5bfc165f00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009d90 tx=0x7f5bf401c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da86cfc8274f1a1a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:30.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5bfa7fc640 1 -- 172.21.15.6:0/379710246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40a5760 con 0x7f5bfc140e90 2023-11-28T21:08:30.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5bfa7fc640 1 -- 172.21.15.6:0/379710246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf40a58c0 con 0x7f5bfc140e90 2023-11-28T21:08:30.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5bfa7fc640 1 -- 172.21.15.6:0/379710246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40a5c50 con 0x7f5bfc140e90 2023-11-28T21:08:30.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 -- 172.21.15.6:0/379710246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 msgr2=0x7f5bfc165f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:30.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 --2- 172.21.15.6:0/379710246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 0x7f5bfc165f00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009d90 tx=0x7f5bf401c720 comp rx=0 tx=0).stop 2023-11-28T21:08:30.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 -- 172.21.15.6:0/379710246 shutdown_connections 2023-11-28T21:08:30.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 --2- 172.21.15.6:0/379710246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 0x7f5bfc165f00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:30.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 -- 172.21.15.6:0/379710246 >> 172.21.15.6:0/379710246 conn(0x7f5bfc06ab80 msgr2=0x7f5bfc0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:30.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 -- 172.21.15.6:0/379710246 shutdown_connections 2023-11-28T21:08:30.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 -- 172.21.15.6:0/379710246 wait complete. 2023-11-28T21:08:30.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 Processor -- start 2023-11-28T21:08:30.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 -- start start 2023-11-28T21:08:30.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bfc13e090 0x7f5bfc151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:30.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 0x7f5bfc13bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:30.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bfc15c250 0x7f5bfc135820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:30.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0afde0 con 0x7f5bfc140e90 2023-11-28T21:08:30.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc13c290 con 0x7f5bfc15c250 2023-11-28T21:08:30.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.255+0000 7f5c02009640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0af4b0 con 0x7f5bfc13e090 2023-11-28T21:08:30.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 0x7f5bfc13bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:30.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 0x7f5bfc13bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52050/0 (socket says 172.21.15.6:52050) 2023-11-28T21:08:30.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfaffd640 1 -- 172.21.15.6:0/2654189711 learned_addr learned my addr 172.21.15.6:0/2654189711 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:30.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfbfff640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bfc15c250 0x7f5bfc135820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:30.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfb7fe640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bfc13e090 0x7f5bfc151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:30.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfaffd640 1 -- 172.21.15.6:0/2654189711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bfc13e090 msgr2=0x7f5bfc151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:30.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfaffd640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bfc13e090 0x7f5bfc151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfaffd640 1 -- 172.21.15.6:0/2654189711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bfc15c250 msgr2=0x7f5bfc135820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfaffd640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bfc15c250 0x7f5bfc135820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfaffd640 1 -- 172.21.15.6:0/2654189711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4009a70 con 0x7f5bfc140e90 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfb7fe640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bfc13e090 0x7f5bfc151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5bfaffd640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 0x7f5bfc13bd50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c5d0 tx=0x7f5bf000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5be3fff640 1 -- 172.21.15.6:0/2654189711 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00074e0 con 0x7f5bfc140e90 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5be3fff640 1 -- 172.21.15.6:0/2654189711 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0007640 con 0x7f5bfc140e90 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5be3fff640 1 -- 172.21.15.6:0/2654189711 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0004a30 con 0x7f5bfc140e90 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bfc0af790 con 0x7f5bfc140e90 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bfc0b0270 con 0x7f5bfc140e90 2023-11-28T21:08:30.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bfc0674d0 con 0x7f5bfc140e90 2023-11-28T21:08:30.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.259+0000 7f5be3fff640 1 -- 172.21.15.6:0/2654189711 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5bf0004b90 con 0x7f5bfc140e90 2023-11-28T21:08:30.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.263+0000 7f5be3fff640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5be8066470 0x7f5be8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:30.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.263+0000 7f5be3fff640 1 -- 172.21.15.6:0/2654189711 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bf0083280 con 0x7f5bfc140e90 2023-11-28T21:08:30.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.263+0000 7f5bfb7fe640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5be8066470 0x7f5be8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:30.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.263+0000 7f5bfb7fe640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5be8066470 0x7f5be8068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5bec000f70 tx=0x7f5bec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:30.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.267+0000 7f5be3fff640 1 -- 172.21.15.6:0/2654189711 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5bf0050660 con 0x7f5bfc140e90 2023-11-28T21:08:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.459+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5bfc0aff20 con 0x7f5bfc140e90 2023-11-28T21:08:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.459+0000 7f5be3fff640 1 -- 172.21.15.6:0/2654189711 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5bf0018070 con 0x7f5bfc140e90 2023-11-28T21:08:30.466 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T21:08:30.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5be8066470 msgr2=0x7f5be8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:30.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5be8066470 0x7f5be8068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5bec000f70 tx=0x7f5bec009040 comp rx=0 tx=0).stop 2023-11-28T21:08:30.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 msgr2=0x7f5bfc13bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 0x7f5bfc13bd50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c5d0 tx=0x7f5bf000ca90 comp rx=0 tx=0).stop 2023-11-28T21:08:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 shutdown_connections 2023-11-28T21:08:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5be8066470 0x7f5be8068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bfc15c250 0x7f5bfc135820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bfc140e90 0x7f5bfc13bd50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 --2- 172.21.15.6:0/2654189711 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5bfc13e090 0x7f5bfc151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 >> 172.21.15.6:0/2654189711 conn(0x7f5bfc06ab80 msgr2=0x7f5bfc071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 shutdown_connections 2023-11-28T21:08:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:30.463+0000 7f5c02009640 1 -- 172.21.15.6:0/2654189711 wait complete. 2023-11-28T21:08:30.487 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T21:08:30.487 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T21:08:30.487 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-11-28T21:08:30.487 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T21:08:30.487 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:30.488 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T21:08:30.488 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T21:08:30.488 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T21:08:30.488 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T21:08:30.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:30.489 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-11-28T21:08:30.501 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T21:08:30.501 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T21:08:30.501 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T21:08:30.501 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:30.501 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-28T21:08:30.502 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:30.502 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:30.502 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:30.502 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-11-28T21:08:30.502 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:30.503 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:30.503 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-11-28T21:08:30.503 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T21:08:30.503 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:30.503 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-11-28T21:08:30.503 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T21:08:30.503 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42378sec preferred_lft 42378sec 2023-11-28T21:08:30.504 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-11-28T21:08:30.504 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:30.504 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:30.504 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:30.504 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-11-28T21:08:30.504 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T21:08:30.504 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:0a:ef:23:53 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:30.505 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T21:08:30.505 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:30.505 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T21:08:30.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:30.505 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-28T21:08:30.506 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-28T21:08:30.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2023-11-28T21:08:30.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2023-11-28T21:08:30.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2023-11-28T21:08:30.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T21:08:30.506 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-28T21:08:30.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:30.622 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T21:08:30.643 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-11-28T21:08:30.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:30.646 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-11-28T21:08:30.708 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-11-28T21:08:30.708 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T21:08:30.708 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T21:08:30.708 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T21:08:30.708 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T21:08:30.708 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T21:08:30.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:30.709 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-28T21:08:30.709 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-28T21:08:30.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T21:08:30.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T21:08:30.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T21:08:30.709 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-28T21:08:30.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:30.806 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-28T21:08:30.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:30.817 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2023-11-28T21:08:30.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:30.873 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-28T21:08:30.873 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-28T21:08:30.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:30.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T21:08:30.873 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-28T21:08:30.957 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T21:08:30.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:30.957 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-28T21:08:30.957 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-28T21:08:30.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T21:08:30.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T21:08:30.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T21:08:30.958 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T21:08:30.958 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T21:08:30.958 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-28T21:08:31.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:31.128 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-28T21:08:31.128 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-28T21:08:31.128 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2023-11-28T21:08:31.128 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T21:08:31.128 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-28T21:08:31.171 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-28T21:08:31.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:08:31.171 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:31.227 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T21:08:31.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:08:31.228 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:31.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-28T21:08:31.350 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:31.401 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-28T21:08:31.401 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-28T21:08:31.401 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-28T21:08:31.401 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-28T21:08:31.401 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/run/lock 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-28T21:08:31.402 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/fs/nfsd 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/run/rpc_pipefs 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-28T21:08:31.403 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:31.404 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:31.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:31.405 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-28T21:08:31.455 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T21:08:31.456 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-28T21:08:31.502 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-28T21:08:31.524 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:31.577 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-28T21:08:31.577 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/run/lock 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-28T21:08:31.578 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/fs/nfsd 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/run/rpc_pipefs 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-28T21:08:31.579 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T21:08:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T21:08:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T21:08:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T21:08:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-28T21:08:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:31.580 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:31.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:31.581 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-28T21:08:31.608 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:2023-11-28T21:08:31.605+0000 7fbbe3b7e580 -1 init, newargv = 0x564243baa180 newargc=15 2023-11-28T21:08:31.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[44237]: starting ceph client 2023-11-28T21:08:31.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi031.stderr:ceph-fuse[44237]: starting fuse 2023-11-28T21:08:32.719 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-28T21:08:32.743 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:32.802 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-28T21:08:32.803 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-28T21:08:32.803 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-28T21:08:32.804 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-28T21:08:32.804 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-28T21:08:32.804 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-28T21:08:32.804 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-28T21:08:32.804 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-28T21:08:32.804 INFO:teuthology.orchestra.run.smithi031.stdout:/run/lock 2023-11-28T21:08:32.804 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-28T21:08:32.805 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-28T21:08:32.805 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2023-11-28T21:08:32.805 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:32.805 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-28T21:08:32.805 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-28T21:08:32.805 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-28T21:08:32.805 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-28T21:08:32.806 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/fs/nfsd 2023-11-28T21:08:32.806 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:32.806 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-28T21:08:32.806 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:32.806 INFO:teuthology.orchestra.run.smithi031.stdout:/run/rpc_pipefs 2023-11-28T21:08:32.806 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-28T21:08:32.806 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-28T21:08:32.807 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T21:08:32.807 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T21:08:32.807 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T21:08:32.807 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T21:08:32.807 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-28T21:08:32.807 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:32.807 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:32.808 INFO:teuthology.orchestra.run.smithi031.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:32.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:32.809 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-28T21:08:32.865 INFO:teuthology.orchestra.run.smithi031.stdout:43 2023-11-28T21:08:32.865 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> import re 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-28T21:08:32.866 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> return f 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T21:08:32.867 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-28T21:08:32.868 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.1")) 2023-11-28T21:08:32.868 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-11-28T21:08:32.996 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.1.44237.asok 2023-11-28T21:08:32.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:08:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T21:08:33.007 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44237.asok 2023-11-28T21:08:33.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:33.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44237.asok status 2023-11-28T21:08:33.184 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-28T21:08:33.184 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2023-11-28T21:08:33.184 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "1", 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "44237", 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4526, 2023-11-28T21:08:33.185 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4526 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 2297825412 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-28T21:08:33.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 2297825412 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4526 192.168.0.1:0/2297825412", 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/2297825412", 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 8, 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 21, 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2023-11-28T21:08:33.187 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-28T21:08:33.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T21:08:33.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.347+0000 7f93ea432640 1 Processor -- start 2023-11-28T21:08:33.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93ea432640 1 -- start start 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93ea432640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93e413e090 0x7f93e40cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93ea432640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 0x7f93e406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93ea432640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40cea50 con 0x7f93e415c250 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93ea432640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e413e470 con 0x7f93e413e090 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93ea432640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40ce1b0 con 0x7f93e4140e90 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93e3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93e413e090 0x7f93e40cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93e3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93e413e090 0x7f93e40cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52054/0 (socket says 172.21.15.6:52054) 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93e3fff640 1 -- 172.21.15.6:0/3749712296 learned_addr learned my addr 172.21.15.6:0/3749712296 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93dbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f93e415c250 0x7f93e4140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35796/0 (socket says 172.21.15.6:35796) 2023-11-28T21:08:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93e89cf640 1 --2- 172.21.15.6:0/3749712296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 0x7f93e406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:33.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93e3fff640 1 -- 172.21.15.6:0/3749712296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 msgr2=0x7f93e406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:33.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93e3fff640 1 --2- 172.21.15.6:0/3749712296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 0x7f93e406cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:33.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93e3fff640 1 -- 172.21.15.6:0/3749712296 >> v1:172.21.15.6:6789/0 conn(0x7f93e415c250 legacy=0x7f93e4140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:33.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.351+0000 7f93e3fff640 1 -- 172.21.15.6:0/3749712296 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40ce490 con 0x7f93e413e090 2023-11-28T21:08:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93e3fff640 1 --2- 172.21.15.6:0/3749712296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e413e090 0x7f93e40cd740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009870 tx=0x7f93d401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f431c7980f8a468e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93e37fe640 1 -- 172.21.15.6:0/3749712296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40ab680 con 0x7f93e413e090 2023-11-28T21:08:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93e37fe640 1 -- 172.21.15.6:0/3749712296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d40ab7e0 con 0x7f93e413e090 2023-11-28T21:08:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93e37fe640 1 -- 172.21.15.6:0/3749712296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40abb70 con 0x7f93e413e090 2023-11-28T21:08:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 -- 172.21.15.6:0/3749712296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e413e090 msgr2=0x7f93e40cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 --2- 172.21.15.6:0/3749712296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e413e090 0x7f93e40cd740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009870 tx=0x7f93d401c480 comp rx=0 tx=0).stop 2023-11-28T21:08:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 -- 172.21.15.6:0/3749712296 shutdown_connections 2023-11-28T21:08:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 --2- 172.21.15.6:0/3749712296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 0x7f93e406cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 --2- 172.21.15.6:0/3749712296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e413e090 0x7f93e40cd740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 -- 172.21.15.6:0/3749712296 >> 172.21.15.6:0/3749712296 conn(0x7f93e406ab80 msgr2=0x7f93e40b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 -- 172.21.15.6:0/3749712296 shutdown_connections 2023-11-28T21:08:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 -- 172.21.15.6:0/3749712296 wait complete. 2023-11-28T21:08:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 Processor -- start 2023-11-28T21:08:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.355+0000 7f93ea432640 1 -- start start 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93ea432640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e413e090 0x7f93e41431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93ea432640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 0x7f93e4156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93ea432640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e415c250 0x7f93e4154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93ea432640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4143700 con 0x7f93e415c250 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93ea432640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4156d80 con 0x7f93e413e090 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93ea432640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e41438f0 con 0x7f93e4140e90 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e89cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e415c250 0x7f93e4154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e89cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e415c250 0x7f93e4154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52070/0 (socket says 172.21.15.6:52070) 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e89cf640 1 -- 172.21.15.6:0/4250478513 learned_addr learned my addr 172.21.15.6:0/4250478513 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e3fff640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e413e090 0x7f93e41431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93dbfff640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 0x7f93e4156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e89cf640 1 -- 172.21.15.6:0/4250478513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 msgr2=0x7f93e4156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e89cf640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 0x7f93e4156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e89cf640 1 -- 172.21.15.6:0/4250478513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e413e090 msgr2=0x7f93e41431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e89cf640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e413e090 0x7f93e41431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e89cf640 1 -- 172.21.15.6:0/4250478513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d40094d0 con 0x7f93e415c250 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e89cf640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e415c250 0x7f93e4154680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00ef90 tx=0x7f93dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e17fa640 1 -- 172.21.15.6:0/4250478513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc009ca0 con 0x7f93e415c250 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e17fa640 1 -- 172.21.15.6:0/4250478513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc00f040 con 0x7f93e415c250 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93e17fa640 1 -- 172.21.15.6:0/4250478513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc0146c0 con 0x7f93e415c250 2023-11-28T21:08:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e4143bd0 con 0x7f93e415c250 2023-11-28T21:08:33.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e4144190 con 0x7f93e415c250 2023-11-28T21:08:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.359+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e40674d0 con 0x7f93e415c250 2023-11-28T21:08:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.363+0000 7f93e17fa640 1 -- 172.21.15.6:0/4250478513 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93dc014820 con 0x7f93e415c250 2023-11-28T21:08:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.363+0000 7f93e17fa640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f93c40664a0 0x7f93c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.363+0000 7f93e17fa640 1 -- 172.21.15.6:0/4250478513 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93dc084cd0 con 0x7f93e415c250 2023-11-28T21:08:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.363+0000 7f93e3fff640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f93c40664a0 0x7f93c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.363+0000 7f93e3fff640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f93c40664a0 0x7f93c4068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93d40af000 tx=0x7f93d40b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.367+0000 7f93e17fa640 1 -- 172.21.15.6:0/4250478513 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93dc0520d0 con 0x7f93e415c250 2023-11-28T21:08:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.559+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f93e40b1880 con 0x7f93e415c250 2023-11-28T21:08:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.559+0000 7f93e17fa640 1 -- 172.21.15.6:0/4250478513 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f93dc018070 con 0x7f93e415c250 2023-11-28T21:08:33.567 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f93c40664a0 msgr2=0x7f93c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f93c40664a0 0x7f93c4068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93d40af000 tx=0x7f93d40b6040 comp rx=0 tx=0).stop 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e415c250 msgr2=0x7f93e4154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e415c250 0x7f93e4154680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00ef90 tx=0x7f93dc00c490 comp rx=0 tx=0).stop 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 shutdown_connections 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f93c40664a0 0x7f93c4068960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e415c250 0x7f93e4154680 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f93e4140e90 0x7f93e4156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 --2- 172.21.15.6:0/4250478513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e413e090 0x7f93e41431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 >> 172.21.15.6:0/4250478513 conn(0x7f93e406ab80 msgr2=0x7f93e415b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 shutdown_connections 2023-11-28T21:08:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:33.563+0000 7f93ea432640 1 -- 172.21.15.6:0/4250478513 wait complete. 2023-11-28T21:08:33.588 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T21:08:33.588 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T21:08:33.588 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2023-11-28T21:08:33.588 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-28T21:08:33.588 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T21:08:33.589 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T21:08:33.589 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T21:08:33.589 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T21:08:33.589 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-28T21:08:33.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:33.589 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2023-11-28T21:08:33.600 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T21:08:33.600 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T21:08:33.601 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42375sec preferred_lft 42375sec 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:0a:ef:23:53 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:33.602 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T21:08:33.603 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:33.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:33.605 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T21:08:33.671 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-11-28T21:08:33.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:33.673 DEBUG:teuthology.orchestra.run.smithi031:> route 2023-11-28T21:08:33.724 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2023-11-28T21:08:33.725 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T21:08:33.725 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T21:08:33.725 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T21:08:33.725 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T21:08:33.725 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T21:08:33.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:33.725 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-28T21:08:33.725 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-28T21:08:33.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T21:08:33.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T21:08:33.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T21:08:33.726 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-28T21:08:33.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:33.826 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-28T21:08:33.837 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T21:08:33.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:33.838 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2023-11-28T21:08:33.893 INFO:teuthology.orchestra.run.smithi031.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-28T21:08:33.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:33.894 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-28T21:08:33.894 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-28T21:08:33.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T21:08:33.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-28T21:08:33.894 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-28T21:08:33.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:33.976 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T21:08:34.040 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 1e:15:33:ed:da:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::1c15:33ff:feed:da67/64 scope link 2023-11-28T21:08:34.041 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:34.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:34.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T21:08:34.109 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T21:08:34.110 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T21:08:34.110 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T21:08:34.110 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:34.110 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2023-11-28T21:08:34.110 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:34.110 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T21:08:34.110 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 1e:15:33:ed:da:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T21:08:34.110 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T21:08:34.111 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:34.111 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::1c15:33ff:feed:da67/64 scope link 2023-11-28T21:08:34.111 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:08:34.111 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-28T21:08:34.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:34.112 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-28T21:08:34.112 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-28T21:08:34.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-28T21:08:34.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T21:08:34.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-28T21:08:34.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-28T21:08:34.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-28T21:08:34.112 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-28T21:08:34.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:34.256 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2023-11-28T21:08:34.256 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2023-11-28T21:08:34.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.1 up 2023-11-28T21:08:34.257 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T21:08:34.257 DEBUG:teuthology.orchestra.run.smithi031:> ') 2023-11-28T21:08:34.300 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-28T21:08:34.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:08:34.301 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-28T21:08:34.356 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-28T21:08:34.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:08:34.357 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-28T21:08:34.407 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-28T21:08:34.473 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:34.525 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-28T21:08:34.525 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-28T21:08:34.525 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/run/lock 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-28T21:08:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/fs/nfsd 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/run/rpc_pipefs 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T21:08:34.527 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T21:08:34.528 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T21:08:34.528 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-28T21:08:34.528 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:34.528 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:34.528 INFO:teuthology.orchestra.run.smithi031.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:34.528 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T21:08:34.528 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T21:08:34.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:34.529 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-28T21:08:34.583 INFO:teuthology.orchestra.run.smithi031.stdout:43 2023-11-28T21:08:34.584 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-28T21:08:34.584 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-28T21:08:34.630 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2023-11-28T21:08:34.652 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:08:34.705 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2023-11-28T21:08:34.705 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2023-11-28T21:08:34.705 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2023-11-28T21:08:34.705 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/run/lock 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2023-11-28T21:08:34.706 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/fs/nfsd 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/run/rpc_pipefs 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2023-11-28T21:08:34.707 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-4 2023-11-28T21:08:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-5 2023-11-28T21:08:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-6 2023-11-28T21:08:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-7 2023-11-28T21:08:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2023-11-28T21:08:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T21:08:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T21:08:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T21:08:34.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:34.710 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2023-11-28T21:08:34.728 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi031.stderr:2023-11-28T21:08:34.725+0000 7f835af83580 -1 init, newargv = 0x55c8a06acd90 newargc=15 2023-11-28T21:08:34.729 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi031.stderr:ceph-fuse[44349]: starting ceph client 2023-11-28T21:08:34.737 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi031.stderr:ceph-fuse[44349]: starting fuse 2023-11-28T21:08:34.738 INFO:teuthology.orchestra.run.smithi031.stdout:43 2023-11-28T21:08:34.739 INFO:teuthology.orchestra.run.smithi031.stdout:44 2023-11-28T21:08:34.739 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-28T21:08:34.739 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2023-11-28T21:08:34.739 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2023-11-28T21:08:34.739 DEBUG:teuthology.orchestra.run.smithi031:> import re 2023-11-28T21:08:34.739 DEBUG:teuthology.orchestra.run.smithi031:> import os 2023-11-28T21:08:34.739 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2023-11-28T21:08:34.739 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2023-11-28T21:08:34.740 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T21:08:34.741 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T21:08:34.741 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T21:08:34.741 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2023-11-28T21:08:34.741 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2023-11-28T21:08:34.741 DEBUG:teuthology.orchestra.run.smithi031:> return f 2023-11-28T21:08:34.741 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T21:08:34.741 DEBUG:teuthology.orchestra.run.smithi031:> 2023-11-28T21:08:34.741 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.3")) 2023-11-28T21:08:34.741 DEBUG:teuthology.orchestra.run.smithi031:> ' 2023-11-28T21:08:34.867 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.3.44349.asok 2023-11-28T21:08:34.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-28T21:08:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T21:08:34.879 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44349.asok 2023-11-28T21:08:34.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:34.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44349.asok status 2023-11-28T21:08:35.056 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-28T21:08:35.056 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2023-11-28T21:08:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T21:08:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T21:08:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "3", 2023-11-28T21:08:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2023-11-28T21:08:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-28T21:08:35.057 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "44349", 2023-11-28T21:08:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2023-11-28T21:08:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-28T21:08:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2023-11-28T21:08:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2023-11-28T21:08:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4538, 2023-11-28T21:08:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2023-11-28T21:08:35.058 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2023-11-28T21:08:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2023-11-28T21:08:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4538 2023-11-28T21:08:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-28T21:08:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-28T21:08:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-28T21:08:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.2:0", 2023-11-28T21:08:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 2825482606 2023-11-28T21:08:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-28T21:08:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-28T21:08:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2023-11-28T21:08:35.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2023-11-28T21:08:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.2:0", 2023-11-28T21:08:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 2825482606 2023-11-28T21:08:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-28T21:08:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4538 192.168.0.2:0/2825482606", 2023-11-28T21:08:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.2:0/2825482606", 2023-11-28T21:08:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2023-11-28T21:08:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 8, 2023-11-28T21:08:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 21, 2023-11-28T21:08:35.061 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2023-11-28T21:08:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2023-11-28T21:08:35.062 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2023-11-28T21:08:35.062 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-28T21:08:35.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:35.073 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-11-28T21:08:35.073 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:35.084 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-11-28T21:08:35.084 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:35.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:35.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:35.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:35.152 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-11-28T21:08:35.152 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-28T21:08:35.206 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-11-28T21:08:35.206 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-28T21:08:35.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:35.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-28T21:08:35.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:35.278 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2023-11-28T21:08:35.278 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:35.293 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2023-11-28T21:08:35.293 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:35.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:35.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:35.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:35.357 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2023-11-28T21:08:35.357 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-28T21:08:35.412 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2023-11-28T21:08:35.412 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-28T21:08:35.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:35.413 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-28T21:08:35.475 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T21:08:35.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:35.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a0d9d1640 1 Processor -- start 2023-11-28T21:08:35.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a0d9d1640 1 -- start start 2023-11-28T21:08:35.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a0d9d1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a0806c7b0 0x7f7a0806b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a0d9d1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0806bde0 con 0x7f7a080b3530 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a0d9d1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a080d05b0 con 0x7f7a0815d570 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a0d9d1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080cfd10 con 0x7f7a0806c7b0 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a077fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7a080b3530 0x7f7a080cbbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35806/0 (socket says 172.21.15.6:35806) 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a077fe640 1 -- 172.21.15.6:0/691283154 learned_addr learned my addr 172.21.15.6:0/691283154 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f79fffff640 1 --2- 172.21.15.6:0/691283154 >> v2:172.21.15.31:3300/0 conn(0x7f7a0806c7b0 0x7f7a0806b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a067fc640 1 -- 172.21.15.6:0/691283154 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574231013 0 0) 0x7f7a0806bde0 con 0x7f7a080b3530 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f7a067fc640 1 -- 172.21.15.6:0/691283154 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79f4003530 con 0x7f7a080b3530 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f79fffff640 1 -- 172.21.15.6:0/691283154 >> v1:172.21.15.31:6789/0 conn(0x7f7a0815d570 legacy=0x7f7a0806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:35.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f79fffff640 1 -- 172.21.15.6:0/691283154 >> v1:172.21.15.6:6789/0 conn(0x7f7a080b3530 legacy=0x7f7a080cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:35.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.663+0000 7f79fffff640 1 -- 172.21.15.6:0/691283154 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080cfff0 con 0x7f7a0806c7b0 2023-11-28T21:08:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f79fffff640 1 --2- 172.21.15.6:0/691283154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a0806c7b0 0x7f7a0806b8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f79f00097c0 tx=0x7f79f001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae398cb14fa43fb6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a067fc640 1 -- 172.21.15.6:0/691283154 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f00ab5f0 con 0x7f7a0806c7b0 2023-11-28T21:08:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a067fc640 1 -- 172.21.15.6:0/691283154 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f00ab750 con 0x7f7a0806c7b0 2023-11-28T21:08:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a067fc640 1 -- 172.21.15.6:0/691283154 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f00abae0 con 0x7f7a0806c7b0 2023-11-28T21:08:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/691283154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a0806c7b0 msgr2=0x7f7a0806b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a0d9d1640 1 --2- 172.21.15.6:0/691283154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a0806c7b0 0x7f7a0806b8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f79f00097c0 tx=0x7f79f001c3f0 comp rx=0 tx=0).stop 2023-11-28T21:08:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/691283154 shutdown_connections 2023-11-28T21:08:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a0d9d1640 1 --2- 172.21.15.6:0/691283154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a0806c7b0 0x7f7a0806b8a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/691283154 >> 172.21.15.6:0/691283154 conn(0x7f7a080b2a10 msgr2=0x7f7a080b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/691283154 shutdown_connections 2023-11-28T21:08:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.667+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/691283154 wait complete. 2023-11-28T21:08:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 Processor -- start 2023-11-28T21:08:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 -- start start 2023-11-28T21:08:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a0806c7b0 0x7f7a080b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a080b3530 0x7f7a0815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a0815d570 0x7f7a08160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08151fc0 con 0x7f7a080b3530 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081522a0 con 0x7f7a0806c7b0 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08152580 con 0x7f7a0815d570 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f79fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a080b3530 0x7f7a0815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f79fffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a080b3530 0x7f7a0815fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52084/0 (socket says 172.21.15.6:52084) 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f79fffff640 1 -- 172.21.15.6:0/2087545116 learned_addr learned my addr 172.21.15.6:0/2087545116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a077fe640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a0815d570 0x7f7a08160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a06ffd640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a0806c7b0 0x7f7a080b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f79fffff640 1 -- 172.21.15.6:0/2087545116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a0815d570 msgr2=0x7f7a08160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f79fffff640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a0815d570 0x7f7a08160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f79fffff640 1 -- 172.21.15.6:0/2087545116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a0806c7b0 msgr2=0x7f7a080b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f79fffff640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a0806c7b0 0x7f7a080b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f79fffff640 1 -- 172.21.15.6:0/2087545116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f0009420 con 0x7f7a080b3530 2023-11-28T21:08:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f79fffff640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a080b3530 0x7f7a0815fb40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f79f00ad040 tx=0x7f79f001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a04ff9640 1 -- 172.21.15.6:0/2087545116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f00bf610 con 0x7f7a080b3530 2023-11-28T21:08:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a04ff9640 1 -- 172.21.15.6:0/2087545116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f00bf7b0 con 0x7f7a080b3530 2023-11-28T21:08:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a08152860 con 0x7f7a080b3530 2023-11-28T21:08:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a04ff9640 1 -- 172.21.15.6:0/2087545116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f00bfb60 con 0x7f7a080b3530 2023-11-28T21:08:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a08152e20 con 0x7f7a080b3530 2023-11-28T21:08:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.671+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a08153010 con 0x7f7a080b3530 2023-11-28T21:08:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.675+0000 7f7a04ff9640 1 -- 172.21.15.6:0/2087545116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f79f00bfcc0 con 0x7f7a080b3530 2023-11-28T21:08:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.675+0000 7f7a04ff9640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f79e8066470 0x7f79e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.675+0000 7f7a04ff9640 1 -- 172.21.15.6:0/2087545116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79f00a8050 con 0x7f7a080b3530 2023-11-28T21:08:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.675+0000 7f7a06ffd640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f79e8066470 0x7f79e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.675+0000 7f7a06ffd640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f79e8066470 0x7f79e8068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79f8007fd0 tx=0x7f79f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.679+0000 7f7a04ff9640 1 -- 172.21.15.6:0/2087545116 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79f00ebd70 con 0x7f7a080b3530 2023-11-28T21:08:35.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.839+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a080674d0 con 0x7f7a080b3530 2023-11-28T21:08:35.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.839+0000 7f7a04ff9640 1 -- 172.21.15.6:0/2087545116 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f79f00ef390 con 0x7f7a080b3530 2023-11-28T21:08:35.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:35.847 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:35.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f79e8066470 msgr2=0x7f79e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:35.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f79e8066470 0x7f79e8068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f79f8007fd0 tx=0x7f79f8009040 comp rx=0 tx=0).stop 2023-11-28T21:08:35.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a080b3530 msgr2=0x7f7a0815fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:35.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a080b3530 0x7f7a0815fb40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f79f00ad040 tx=0x7f79f001ac30 comp rx=0 tx=0).stop 2023-11-28T21:08:35.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 shutdown_connections 2023-11-28T21:08:35.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f79e8066470 0x7f79e8068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:35.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a0815d570 0x7f7a08160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:35.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a080b3530 0x7f7a0815fb40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:35.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 --2- 172.21.15.6:0/2087545116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a0806c7b0 0x7f7a080b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:35.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 >> 172.21.15.6:0/2087545116 conn(0x7f7a080b2a10 msgr2=0x7f7a080cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:35.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 shutdown_connections 2023-11-28T21:08:35.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:35.843+0000 7f7a0d9d1640 1 -- 172.21.15.6:0/2087545116 wait complete. 2023-11-28T21:08:35.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:35.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa97e5f8640 1 Processor -- start 2023-11-28T21:08:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa97e5f8640 1 -- start start 2023-11-28T21:08:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa97e5f8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa97815db00 0x7fa97815df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa97e5f8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97806caa0 con 0x7fa978159e90 2023-11-28T21:08:36.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa97e5f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97815e4a0 con 0x7fa9780ce3d0 2023-11-28T21:08:36.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa97e5f8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780cd330 con 0x7fa97815db00 2023-11-28T21:08:36.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa977fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa978159e90 0x7fa9780aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35820/0 (socket says 172.21.15.6:35820) 2023-11-28T21:08:36.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa977fff640 1 -- 172.21.15.6:0/4130226782 learned_addr learned my addr 172.21.15.6:0/4130226782 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:36.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa9777fe640 1 --2- 172.21.15.6:0/4130226782 >> v2:172.21.15.6:3300/0 conn(0x7fa97815db00 0x7fa97815df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa976ffd640 1 -- 172.21.15.6:0/4130226782 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322428986 0 0) 0x7fa97806caa0 con 0x7fa978159e90 2023-11-28T21:08:36.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa9777fe640 1 -- 172.21.15.6:0/4130226782 >> v1:172.21.15.31:6789/0 conn(0x7fa9780ce3d0 legacy=0x7fa9780ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:36.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa9777fe640 1 -- 172.21.15.6:0/4130226782 >> v1:172.21.15.6:6789/0 conn(0x7fa978159e90 legacy=0x7fa9780aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.011+0000 7fa9777fe640 1 -- 172.21.15.6:0/4130226782 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780cd610 con 0x7fa97815db00 2023-11-28T21:08:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa9777fe640 1 --2- 172.21.15.6:0/4130226782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97815db00 0x7fa97815df60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0097c0 tx=0x7fa96c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887c7185221236fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa976ffd640 1 -- 172.21.15.6:0/4130226782 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0ab610 con 0x7fa97815db00 2023-11-28T21:08:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa976ffd640 1 -- 172.21.15.6:0/4130226782 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c0ab770 con 0x7fa97815db00 2023-11-28T21:08:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa976ffd640 1 -- 172.21.15.6:0/4130226782 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0abb00 con 0x7fa97815db00 2023-11-28T21:08:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa97e5f8640 1 -- 172.21.15.6:0/4130226782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97815db00 msgr2=0x7fa97815df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa97e5f8640 1 --2- 172.21.15.6:0/4130226782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97815db00 0x7fa97815df60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0097c0 tx=0x7fa96c01c410 comp rx=0 tx=0).stop 2023-11-28T21:08:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa97e5f8640 1 -- 172.21.15.6:0/4130226782 shutdown_connections 2023-11-28T21:08:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa97e5f8640 1 --2- 172.21.15.6:0/4130226782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97815db00 0x7fa97815df60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa97e5f8640 1 -- 172.21.15.6:0/4130226782 >> 172.21.15.6:0/4130226782 conn(0x7fa9780b1670 msgr2=0x7fa9780b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa97e5f8640 1 -- 172.21.15.6:0/4130226782 shutdown_connections 2023-11-28T21:08:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.015+0000 7fa97e5f8640 1 -- 172.21.15.6:0/4130226782 wait complete. 2023-11-28T21:08:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 Processor -- start 2023-11-28T21:08:36.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 -- start start 2023-11-28T21:08:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9780ce3d0 0x7fa97815d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa978159e90 0x7fa97814df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa97815db00 0x7fa97814e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97814d420 con 0x7fa978159e90 2023-11-28T21:08:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97814d700 con 0x7fa9780ce3d0 2023-11-28T21:08:36.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97815cb30 con 0x7fa97815db00 2023-11-28T21:08:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa978159e90 0x7fa97814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa9777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa978159e90 0x7fa97814df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52104/0 (socket says 172.21.15.6:52104) 2023-11-28T21:08:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa9777fe640 1 -- 172.21.15.6:0/2233397427 learned_addr learned my addr 172.21.15.6:0/2233397427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa9777fe640 1 -- 172.21.15.6:0/2233397427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa97815db00 msgr2=0x7fa97814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa9777fe640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa97815db00 0x7fa97814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa9777fe640 1 -- 172.21.15.6:0/2233397427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9780ce3d0 msgr2=0x7fa97815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa9777fe640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9780ce3d0 0x7fa97815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa9777fe640 1 -- 172.21.15.6:0/2233397427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c009420 con 0x7fa978159e90 2023-11-28T21:08:36.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa9777fe640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa978159e90 0x7fa97814df40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0ad040 tx=0x7fa96c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:36.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa974ff9640 1 -- 172.21.15.6:0/2233397427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0b5810 con 0x7fa978159e90 2023-11-28T21:08:36.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa974ff9640 1 -- 172.21.15.6:0/2233397427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c0b5990 con 0x7fa978159e90 2023-11-28T21:08:36.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa974ff9640 1 -- 172.21.15.6:0/2233397427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0b5d40 con 0x7fa978159e90 2023-11-28T21:08:36.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97815a3f0 con 0x7fa978159e90 2023-11-28T21:08:36.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97814d0d0 con 0x7fa978159e90 2023-11-28T21:08:36.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.019+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97815dee0 con 0x7fa978159e90 2023-11-28T21:08:36.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.023+0000 7fa974ff9640 1 -- 172.21.15.6:0/2233397427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa96c0bf410 con 0x7fa978159e90 2023-11-28T21:08:36.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.023+0000 7fa974ff9640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa964066470 0x7fa964068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.023+0000 7fa974ff9640 1 -- 172.21.15.6:0/2233397427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa96c11e980 con 0x7fa978159e90 2023-11-28T21:08:36.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.023+0000 7fa977fff640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa964066470 0x7fa964068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.023+0000 7fa977fff640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa964066470 0x7fa964068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9680015a0 tx=0x7fa968007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:36.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.027+0000 7fa974ff9640 1 -- 172.21.15.6:0/2233397427 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa96c0ebd60 con 0x7fa978159e90 2023-11-28T21:08:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.183+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa97814d560 con 0x7fa978159e90 2023-11-28T21:08:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.183+0000 7fa974ff9640 1 -- 172.21.15.6:0/2233397427 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa97814d560 con 0x7fa978159e90 2023-11-28T21:08:36.190 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa964066470 msgr2=0x7fa964068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa964066470 0x7fa964068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9680015a0 tx=0x7fa968007970 comp rx=0 tx=0).stop 2023-11-28T21:08:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa978159e90 msgr2=0x7fa97814df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa978159e90 0x7fa97814df40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0ad040 tx=0x7fa96c01ac50 comp rx=0 tx=0).stop 2023-11-28T21:08:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 shutdown_connections 2023-11-28T21:08:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa964066470 0x7fa964068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa97815db00 0x7fa97814e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa978159e90 0x7fa97814df40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 --2- 172.21.15.6:0/2233397427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9780ce3d0 0x7fa97815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 >> 172.21.15.6:0/2233397427 conn(0x7fa9780b1670 msgr2=0x7fa9780b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 shutdown_connections 2023-11-28T21:08:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.187+0000 7fa97e5f8640 1 -- 172.21.15.6:0/2233397427 wait complete. 2023-11-28T21:08:36.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07891d640 1 Processor -- start 2023-11-28T21:08:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07891d640 1 -- start start 2023-11-28T21:08:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07891d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe07406ca00 0x7fe0740cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07891d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe07415c440 0x7fe07415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07891d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0740cc930 con 0x7fe07406cde0 2023-11-28T21:08:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07891d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0740cd400 con 0x7fe07406ca00 2023-11-28T21:08:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07891d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0740ccb60 con 0x7fe07415c440 2023-11-28T21:08:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe07406ca00 0x7fe0740cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe07406ca00 0x7fe0740cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52110/0 (socket says 172.21.15.6:52110) 2023-11-28T21:08:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.351+0000 7fe07259c640 1 -- 172.21.15.6:0/1982438578 learned_addr learned my addr 172.21.15.6:0/1982438578 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe072d9d640 1 --2- 172.21.15.6:0/1982438578 >> v2:172.21.15.31:3300/0 conn(0x7fe07415c440 0x7fe07415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe07259c640 1 -- 172.21.15.6:0/1982438578 >> v2:172.21.15.31:3300/0 conn(0x7fe07415c440 msgr2=0x7fe07415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe07259c640 1 --2- 172.21.15.6:0/1982438578 >> v2:172.21.15.31:3300/0 conn(0x7fe07415c440 0x7fe07415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe07259c640 1 -- 172.21.15.6:0/1982438578 >> v1:172.21.15.31:6789/0 conn(0x7fe07406cde0 legacy=0x7fe07415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe07259c640 1 -- 172.21.15.6:0/1982438578 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0740cce40 con 0x7fe07406ca00 2023-11-28T21:08:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe07259c640 1 --2- 172.21.15.6:0/1982438578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406ca00 0x7fe0740cc3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe064009870 tx=0x7fe06401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5591d323db33d2c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe071d9b640 1 -- 172.21.15.6:0/1982438578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640ab640 con 0x7fe07406ca00 2023-11-28T21:08:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe071d9b640 1 -- 172.21.15.6:0/1982438578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0640a7070 con 0x7fe07406ca00 2023-11-28T21:08:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe071d9b640 1 -- 172.21.15.6:0/1982438578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640ab9c0 con 0x7fe07406ca00 2023-11-28T21:08:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe07891d640 1 -- 172.21.15.6:0/1982438578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406ca00 msgr2=0x7fe0740cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.355+0000 7fe07891d640 1 --2- 172.21.15.6:0/1982438578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406ca00 0x7fe0740cc3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe064009870 tx=0x7fe06401c440 comp rx=0 tx=0).stop 2023-11-28T21:08:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 -- 172.21.15.6:0/1982438578 shutdown_connections 2023-11-28T21:08:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 --2- 172.21.15.6:0/1982438578 >> v2:172.21.15.31:3300/0 conn(0x7fe07415c440 0x7fe07415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 --2- 172.21.15.6:0/1982438578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406ca00 0x7fe0740cc3f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 -- 172.21.15.6:0/1982438578 >> 172.21.15.6:0/1982438578 conn(0x7fe07406a980 msgr2=0x7fe07406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 -- 172.21.15.6:0/1982438578 shutdown_connections 2023-11-28T21:08:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 -- 172.21.15.6:0/1982438578 wait complete. 2023-11-28T21:08:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 Processor -- start 2023-11-28T21:08:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 -- start start 2023-11-28T21:08:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07406ca00 0x7fe0740afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406cde0 0x7fe074135a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07415c440 0x7fe074135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0740b43b0 con 0x7fe07406cde0 2023-11-28T21:08:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0740b3b10 con 0x7fe07406ca00 2023-11-28T21:08:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07891d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0740b3df0 con 0x7fe07415c440 2023-11-28T21:08:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406cde0 0x7fe074135a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406cde0 0x7fe074135a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52124/0 (socket says 172.21.15.6:52124) 2023-11-28T21:08:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06bfff640 1 -- 172.21.15.6:0/3607621219 learned_addr learned my addr 172.21.15.6:0/3607621219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe072d9d640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07415c440 0x7fe074135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe07259c640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07406ca00 0x7fe0740afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06bfff640 1 -- 172.21.15.6:0/3607621219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07415c440 msgr2=0x7fe074135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06bfff640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07415c440 0x7fe074135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06bfff640 1 -- 172.21.15.6:0/3607621219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07406ca00 msgr2=0x7fe0740afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06bfff640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07406ca00 0x7fe0740afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06bfff640 1 -- 172.21.15.6:0/3607621219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640094d0 con 0x7fe07406cde0 2023-11-28T21:08:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06bfff640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406cde0 0x7fe074135a80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00c500 tx=0x7fe05c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.359+0000 7fe06affd640 1 -- 172.21.15.6:0/3607621219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c005220 con 0x7fe07406cde0 2023-11-28T21:08:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe06affd640 1 -- 172.21.15.6:0/3607621219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c005380 con 0x7fe07406cde0 2023-11-28T21:08:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe06affd640 1 -- 172.21.15.6:0/3607621219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c007270 con 0x7fe07406cde0 2023-11-28T21:08:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0740b40d0 con 0x7fe07406cde0 2023-11-28T21:08:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0740b0120 con 0x7fe07406cde0 2023-11-28T21:08:36.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe074072b90 con 0x7fe07406cde0 2023-11-28T21:08:36.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe06affd640 1 -- 172.21.15.6:0/3607621219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe05c0073d0 con 0x7fe07406cde0 2023-11-28T21:08:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe06affd640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05406a880 0x7fe05406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe06affd640 1 -- 172.21.15.6:0/3607621219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe05c083720 con 0x7fe07406cde0 2023-11-28T21:08:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe07259c640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05406a880 0x7fe05406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.363+0000 7fe07259c640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05406a880 0x7fe05406cd40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe0640af000 tx=0x7fe0640b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:36.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.367+0000 7fe06affd640 1 -- 172.21.15.6:0/3607621219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe05c050bc0 con 0x7fe07406cde0 2023-11-28T21:08:36.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0741369d0 con 0x7fe07406cde0 2023-11-28T21:08:36.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe06affd640 1 -- 172.21.15.6:0/3607621219 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe05c0541e0 con 0x7fe07406cde0 2023-11-28T21:08:36.532 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05406a880 msgr2=0x7fe05406cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05406a880 0x7fe05406cd40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe0640af000 tx=0x7fe0640b6040 comp rx=0 tx=0).stop 2023-11-28T21:08:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406cde0 msgr2=0x7fe074135a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406cde0 0x7fe074135a80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00c500 tx=0x7fe05c00c9c0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 shutdown_connections 2023-11-28T21:08:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05406a880 0x7fe05406cd40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07415c440 0x7fe074135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07406cde0 0x7fe074135a80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 --2- 172.21.15.6:0/3607621219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07406ca00 0x7fe0740afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 >> 172.21.15.6:0/3607621219 conn(0x7fe07406a980 msgr2=0x7fe074159370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 shutdown_connections 2023-11-28T21:08:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.527+0000 7fe07891d640 1 -- 172.21.15.6:0/3607621219 wait complete. 2023-11-28T21:08:36.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.695+0000 7fb91b809640 1 Processor -- start 2023-11-28T21:08:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.695+0000 7fb91b809640 1 -- start start 2023-11-28T21:08:36.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.695+0000 7fb91b809640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb91415fcf0 0x7fb9140d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.695+0000 7fb91b809640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb9140ceec0 0x7fb9140b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.695+0000 7fb91b809640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9140cea30 con 0x7fb9140b2ff0 2023-11-28T21:08:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.695+0000 7fb91b809640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9140d3ef0 con 0x7fb91415fcf0 2023-11-28T21:08:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.695+0000 7fb91b809640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9140b2430 con 0x7fb9140ceec0 2023-11-28T21:08:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb9195a5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb91415fcf0 0x7fb9140d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb919da6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb9140b2ff0 0x7fb9140cfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35828/0 (socket says 172.21.15.6:35828) 2023-11-28T21:08:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb9195a5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb91415fcf0 0x7fb9140d3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52138/0 (socket says 172.21.15.6:52138) 2023-11-28T21:08:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb919da6640 1 -- 172.21.15.6:0/429880674 learned_addr learned my addr 172.21.15.6:0/429880674 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb918da4640 1 --2- 172.21.15.6:0/429880674 >> v2:172.21.15.31:3300/0 conn(0x7fb9140ceec0 0x7fb9140b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb9195a5640 1 -- 172.21.15.6:0/429880674 >> v2:172.21.15.31:3300/0 conn(0x7fb9140ceec0 msgr2=0x7fb9140b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb9195a5640 1 --2- 172.21.15.6:0/429880674 >> v2:172.21.15.31:3300/0 conn(0x7fb9140ceec0 0x7fb9140b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb9195a5640 1 -- 172.21.15.6:0/429880674 >> v1:172.21.15.6:6789/0 conn(0x7fb9140b2ff0 legacy=0x7fb9140cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb9195a5640 1 -- 172.21.15.6:0/429880674 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9141610e0 con 0x7fb91415fcf0 2023-11-28T21:08:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb90bfff640 1 -- 172.21.15.6:0/429880674 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201078896 0 0) 0x7fb9140cea30 con 0x7fb9140b2ff0 2023-11-28T21:08:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb9195a5640 1 --2- 172.21.15.6:0/429880674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 0x7fb9140d3860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb9140b2620 tx=0x7fb91001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73f81c6d7c7d637 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb90bfff640 1 -- 172.21.15.6:0/429880674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100ac600 con 0x7fb91415fcf0 2023-11-28T21:08:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb90bfff640 1 -- 172.21.15.6:0/429880674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9100a8050 con 0x7fb91415fcf0 2023-11-28T21:08:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.699+0000 7fb90bfff640 1 -- 172.21.15.6:0/429880674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100ac980 con 0x7fb91415fcf0 2023-11-28T21:08:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 -- 172.21.15.6:0/429880674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 msgr2=0x7fb9140d3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 --2- 172.21.15.6:0/429880674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 0x7fb9140d3860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb9140b2620 tx=0x7fb91001c3a0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 -- 172.21.15.6:0/429880674 shutdown_connections 2023-11-28T21:08:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 --2- 172.21.15.6:0/429880674 >> v2:172.21.15.31:3300/0 conn(0x7fb9140ceec0 0x7fb9140b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 --2- 172.21.15.6:0/429880674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 0x7fb9140d3860 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 -- 172.21.15.6:0/429880674 >> 172.21.15.6:0/429880674 conn(0x7fb91409c480 msgr2=0x7fb9140d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 -- 172.21.15.6:0/429880674 shutdown_connections 2023-11-28T21:08:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 -- 172.21.15.6:0/429880674 wait complete. 2023-11-28T21:08:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 Processor -- start 2023-11-28T21:08:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 -- start start 2023-11-28T21:08:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b2ff0 0x7fb914155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9140ceec0 0x7fb9140cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 0x7fb91415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb914156fd0 con 0x7fb91415fcf0 2023-11-28T21:08:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb914156730 con 0x7fb9140b2ff0 2023-11-28T21:08:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb91b809640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb914156a10 con 0x7fb9140ceec0 2023-11-28T21:08:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb919da6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 0x7fb91415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb919da6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 0x7fb91415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52140/0 (socket says 172.21.15.6:52140) 2023-11-28T21:08:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb919da6640 1 -- 172.21.15.6:0/3017561200 learned_addr learned my addr 172.21.15.6:0/3017561200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb918da4640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9140ceec0 0x7fb9140cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb9195a5640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b2ff0 0x7fb914155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb919da6640 1 -- 172.21.15.6:0/3017561200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9140ceec0 msgr2=0x7fb9140cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb919da6640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9140ceec0 0x7fb9140cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb919da6640 1 -- 172.21.15.6:0/3017561200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b2ff0 msgr2=0x7fb914155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb919da6640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b2ff0 0x7fb914155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.703+0000 7fb919da6640 1 -- 172.21.15.6:0/3017561200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910009420 con 0x7fb91415fcf0 2023-11-28T21:08:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb919da6640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 0x7fb91415bc60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c7a0 tx=0x7fb90c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb909ffb640 1 -- 172.21.15.6:0/3017561200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c00a640 con 0x7fb91415fcf0 2023-11-28T21:08:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb909ffb640 1 -- 172.21.15.6:0/3017561200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c00a7a0 con 0x7fb91415fcf0 2023-11-28T21:08:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb909ffb640 1 -- 172.21.15.6:0/3017561200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c00ab90 con 0x7fb91415fcf0 2023-11-28T21:08:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb914156cf0 con 0x7fb91415fcf0 2023-11-28T21:08:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb914155980 con 0x7fb91415fcf0 2023-11-28T21:08:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9140b5d30 con 0x7fb91415fcf0 2023-11-28T21:08:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb909ffb640 1 -- 172.21.15.6:0/3017561200 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb90c00acf0 con 0x7fb91415fcf0 2023-11-28T21:08:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb909ffb640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb8f8066470 0x7fb8f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb909ffb640 1 -- 172.21.15.6:0/3017561200 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb90c0834a0 con 0x7fb91415fcf0 2023-11-28T21:08:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.707+0000 7fb9195a5640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb8f8066470 0x7fb8f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.711+0000 7fb9195a5640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb8f8066470 0x7fb8f8068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb9100ae000 tx=0x7fb9100a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.711+0000 7fb909ffb640 1 -- 172.21.15.6:0/3017561200 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9140b5d30 con 0x7fb91415fcf0 2023-11-28T21:08:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.871+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9140b5d30 con 0x7fb91415fcf0 2023-11-28T21:08:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.871+0000 7fb909ffb640 1 -- 172.21.15.6:0/3017561200 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9140b5d30 con 0x7fb91415fcf0 2023-11-28T21:08:36.878 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb8f8066470 msgr2=0x7fb8f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb8f8066470 0x7fb8f8068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb9100ae000 tx=0x7fb9100a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 msgr2=0x7fb91415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 0x7fb91415bc60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c7a0 tx=0x7fb90c00cc60 comp rx=0 tx=0).stop 2023-11-28T21:08:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 shutdown_connections 2023-11-28T21:08:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb8f8066470 0x7fb8f8068930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb91415fcf0 0x7fb91415bc60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9140ceec0 0x7fb9140cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 --2- 172.21.15.6:0/3017561200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b2ff0 0x7fb914155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 >> 172.21.15.6:0/3017561200 conn(0x7fb91409c480 msgr2=0x7fb91406bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 shutdown_connections 2023-11-28T21:08:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:36.875+0000 7fb91b809640 1 -- 172.21.15.6:0/3017561200 wait complete. 2023-11-28T21:08:36.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.035+0000 7f3495d0f640 1 Processor -- start 2023-11-28T21:08:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.035+0000 7f3495d0f640 1 -- start start 2023-11-28T21:08:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f3495d0f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34900ad700 0x7f3490160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f3495d0f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34900b32c0 0x7f3490161280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f3495d0f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3490157c80 con 0x7f34901617c0 2023-11-28T21:08:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f3495d0f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3490161c10 con 0x7f34900b32c0 2023-11-28T21:08:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f3495d0f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349006b590 con 0x7f34900ad700 2023-11-28T21:08:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f348effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34900b32c0 0x7f3490161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f348effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34900b32c0 0x7f3490161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52142/0 (socket says 172.21.15.6:52142) 2023-11-28T21:08:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f348effd640 1 -- 172.21.15.6:0/639342408 learned_addr learned my addr 172.21.15.6:0/639342408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f348f7fe640 1 --2- 172.21.15.6:0/639342408 >> v2:172.21.15.31:3300/0 conn(0x7f34900ad700 0x7f3490160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f348effd640 1 -- 172.21.15.6:0/639342408 >> v2:172.21.15.31:3300/0 conn(0x7f34900ad700 msgr2=0x7f3490160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f348effd640 1 --2- 172.21.15.6:0/639342408 >> v2:172.21.15.31:3300/0 conn(0x7f34900ad700 0x7f3490160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f348effd640 1 -- 172.21.15.6:0/639342408 >> v1:172.21.15.31:6789/0 conn(0x7f34901617c0 legacy=0x7f349015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.039+0000 7f348effd640 1 -- 172.21.15.6:0/639342408 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900adae0 con 0x7f34900b32c0 2023-11-28T21:08:37.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f348effd640 1 --2- 172.21.15.6:0/639342408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34900b32c0 0x7f3490161280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f34900b22e0 tx=0x7f348401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c43781cf1f8507f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:37.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f348e7fc640 1 -- 172.21.15.6:0/639342408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349015e670 con 0x7f34900b32c0 2023-11-28T21:08:37.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f348e7fc640 1 -- 172.21.15.6:0/639342408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840aa430 con 0x7f34900b32c0 2023-11-28T21:08:37.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f348e7fc640 1 -- 172.21.15.6:0/639342408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840aa7c0 con 0x7f34900b32c0 2023-11-28T21:08:37.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 -- 172.21.15.6:0/639342408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34900b32c0 msgr2=0x7f3490161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 --2- 172.21.15.6:0/639342408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34900b32c0 0x7f3490161280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f34900b22e0 tx=0x7f348401c4d0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 -- 172.21.15.6:0/639342408 shutdown_connections 2023-11-28T21:08:37.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 --2- 172.21.15.6:0/639342408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34900b32c0 0x7f3490161280 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 --2- 172.21.15.6:0/639342408 >> v2:172.21.15.31:3300/0 conn(0x7f34900ad700 0x7f3490160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 -- 172.21.15.6:0/639342408 >> 172.21.15.6:0/639342408 conn(0x7f34900cf7b0 msgr2=0x7f34900cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:37.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 -- 172.21.15.6:0/639342408 shutdown_connections 2023-11-28T21:08:37.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 -- 172.21.15.6:0/639342408 wait complete. 2023-11-28T21:08:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 Processor -- start 2023-11-28T21:08:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.043+0000 7f3495d0f640 1 -- start start 2023-11-28T21:08:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3495d0f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34900ad700 0x7f34900cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3495d0f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34900b32c0 0x7f349014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3495d0f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34901617c0 0x7f349015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3495d0f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490155740 con 0x7f34901617c0 2023-11-28T21:08:37.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3495d0f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900cdf50 con 0x7f34900ad700 2023-11-28T21:08:37.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3495d0f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900ce230 con 0x7f34900b32c0 2023-11-28T21:08:37.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34901617c0 0x7f349015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348effd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34900b32c0 0x7f349014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34900ad700 0x7f34900cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348effd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34900b32c0 0x7f349014f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:57682/0 (socket says 172.21.15.6:57682) 2023-11-28T21:08:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348effd640 1 -- 172.21.15.6:0/3604718259 learned_addr learned my addr 172.21.15.6:0/3604718259 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348effd640 1 -- 172.21.15.6:0/3604718259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34900ad700 msgr2=0x7f34900cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348effd640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34900ad700 0x7f34900cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348effd640 1 -- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34901617c0 msgr2=0x7f349015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348effd640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34901617c0 0x7f349015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348effd640 1 -- 172.21.15.6:0/3604718259 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840094d0 con 0x7f34900b32c0 2023-11-28T21:08:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348ffff640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34901617c0 0x7f349015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f348effd640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34900b32c0 0x7f349014f480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34840190e0 tx=0x7f348401ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3477fff640 1 -- 172.21.15.6:0/3604718259 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840b3800 con 0x7f34900b32c0 2023-11-28T21:08:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3477fff640 1 -- 172.21.15.6:0/3604718259 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840aae90 con 0x7f34900b32c0 2023-11-28T21:08:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34901550f0 con 0x7f34900b32c0 2023-11-28T21:08:37.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3477fff640 1 -- 172.21.15.6:0/3604718259 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840b3ba0 con 0x7f34900b32c0 2023-11-28T21:08:37.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900cdc10 con 0x7f34900b32c0 2023-11-28T21:08:37.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.047+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349006f630 con 0x7f34900b32c0 2023-11-28T21:08:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.051+0000 7f3477fff640 1 -- 172.21.15.6:0/3604718259 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f34840b3d00 con 0x7f34900b32c0 2023-11-28T21:08:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.051+0000 7f3477fff640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f347c0664a0 0x7f347c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.051+0000 7f3477fff640 1 -- 172.21.15.6:0/3604718259 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f348411e7c0 con 0x7f34900b32c0 2023-11-28T21:08:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.051+0000 7f348f7fe640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f347c0664a0 0x7f347c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.051+0000 7f348f7fe640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f347c0664a0 0x7f347c068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3480007a60 tx=0x7f3480008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.055+0000 7f3477fff640 1 -- 172.21.15.6:0/3604718259 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f34840ebc50 con 0x7f34900b32c0 2023-11-28T21:08:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.211+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34901558b0 con 0x7f34900b32c0 2023-11-28T21:08:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.211+0000 7f3477fff640 1 -- 172.21.15.6:0/3604718259 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f34840ef270 con 0x7f34900b32c0 2023-11-28T21:08:37.221 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:37.221 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:37.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f347c0664a0 msgr2=0x7f347c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f347c0664a0 0x7f347c068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3480007a60 tx=0x7f3480008040 comp rx=0 tx=0).stop 2023-11-28T21:08:37.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34900b32c0 msgr2=0x7f349014f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34900b32c0 0x7f349014f480 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34840190e0 tx=0x7f348401ad10 comp rx=0 tx=0).stop 2023-11-28T21:08:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 shutdown_connections 2023-11-28T21:08:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f347c0664a0 0x7f347c068960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34901617c0 0x7f349015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34900b32c0 0x7f349014f480 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 --2- 172.21.15.6:0/3604718259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34900ad700 0x7f34900cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 >> 172.21.15.6:0/3604718259 conn(0x7f34900cf7b0 msgr2=0x7f3490070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 shutdown_connections 2023-11-28T21:08:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.215+0000 7f3495d0f640 1 -- 172.21.15.6:0/3604718259 wait complete. 2023-11-28T21:08:37.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:37.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:37.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf5d86b640 1 Processor -- start 2023-11-28T21:08:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf5d86b640 1 -- start start 2023-11-28T21:08:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf5d86b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099be0 0x7fcf580b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf5d86b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf580cc220 con 0x7fcf580b2550 2023-11-28T21:08:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf5d86b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf580cb680 con 0x7fcf58099fc0 2023-11-28T21:08:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf5d86b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5815dda0 con 0x7fcf58099be0 2023-11-28T21:08:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf577fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcf580b2550 0x7fcf580cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35832/0 (socket says 172.21.15.6:35832) 2023-11-28T21:08:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf577fe640 1 -- 172.21.15.6:0/2314009560 learned_addr learned my addr 172.21.15.6:0/2314009560 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:37.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf56ffd640 1 --2- 172.21.15.6:0/2314009560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099be0 0x7fcf580b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf567fc640 1 -- 172.21.15.6:0/2314009560 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144167698 0 0) 0x7fcf580cc220 con 0x7fcf580b2550 2023-11-28T21:08:37.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf567fc640 1 -- 172.21.15.6:0/2314009560 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf44003530 con 0x7fcf580b2550 2023-11-28T21:08:37.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf567fc640 1 -- 172.21.15.6:0/2314009560 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582786141 0 0) 0x7fcf580cb680 con 0x7fcf58099fc0 2023-11-28T21:08:37.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf567fc640 1 -- 172.21.15.6:0/2314009560 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf580cc220 con 0x7fcf58099fc0 2023-11-28T21:08:37.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf56ffd640 1 -- 172.21.15.6:0/2314009560 >> v1:172.21.15.31:6789/0 conn(0x7fcf58099fc0 legacy=0x7fcf580b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf56ffd640 1 -- 172.21.15.6:0/2314009560 >> v1:172.21.15.6:6789/0 conn(0x7fcf580b2550 legacy=0x7fcf580cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.399+0000 7fcf56ffd640 1 -- 172.21.15.6:0/2314009560 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580cb8f0 con 0x7fcf58099be0 2023-11-28T21:08:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf56ffd640 1 --2- 172.21.15.6:0/2314009560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099be0 0x7fcf580b3de0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf480097f0 tx=0x7fcf4801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1df62afba127c13b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf567fc640 1 -- 172.21.15.6:0/2314009560 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480ab620 con 0x7fcf58099be0 2023-11-28T21:08:37.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf567fc640 1 -- 172.21.15.6:0/2314009560 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf480ab780 con 0x7fcf58099be0 2023-11-28T21:08:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf567fc640 1 -- 172.21.15.6:0/2314009560 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480abb10 con 0x7fcf58099be0 2023-11-28T21:08:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf5d86b640 1 -- 172.21.15.6:0/2314009560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099be0 msgr2=0x7fcf580b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf5d86b640 1 --2- 172.21.15.6:0/2314009560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099be0 0x7fcf580b3de0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcf480097f0 tx=0x7fcf4801c400 comp rx=0 tx=0).stop 2023-11-28T21:08:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf5d86b640 1 -- 172.21.15.6:0/2314009560 shutdown_connections 2023-11-28T21:08:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf5d86b640 1 --2- 172.21.15.6:0/2314009560 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099be0 0x7fcf580b3de0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf5d86b640 1 -- 172.21.15.6:0/2314009560 >> 172.21.15.6:0/2314009560 conn(0x7fcf580b2a80 msgr2=0x7fcf580b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf5d86b640 1 -- 172.21.15.6:0/2314009560 shutdown_connections 2023-11-28T21:08:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.403+0000 7fcf5d86b640 1 -- 172.21.15.6:0/2314009560 wait complete. 2023-11-28T21:08:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 Processor -- start 2023-11-28T21:08:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 -- start start 2023-11-28T21:08:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf58099be0 0x7fcf5806e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099fc0 0x7fcf58153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf580b2550 0x7fcf581544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580c4b70 con 0x7fcf580b2550 2023-11-28T21:08:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580c4e50 con 0x7fcf58099be0 2023-11-28T21:08:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580c5130 con 0x7fcf58099fc0 2023-11-28T21:08:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf580b2550 0x7fcf581544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf580b2550 0x7fcf581544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52164/0 (socket says 172.21.15.6:52164) 2023-11-28T21:08:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf577fe640 1 -- 172.21.15.6:0/1219153449 learned_addr learned my addr 172.21.15.6:0/1219153449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf4ffff640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099fc0 0x7fcf58153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf56ffd640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf58099be0 0x7fcf5806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf577fe640 1 -- 172.21.15.6:0/1219153449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099fc0 msgr2=0x7fcf58153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf577fe640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099fc0 0x7fcf58153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf577fe640 1 -- 172.21.15.6:0/1219153449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf58099be0 msgr2=0x7fcf5806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf577fe640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf58099be0 0x7fcf5806e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf577fe640 1 -- 172.21.15.6:0/1219153449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48009420 con 0x7fcf580b2550 2023-11-28T21:08:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf577fe640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf580b2550 0x7fcf581544b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000cb40 tx=0x7fcf5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf54ff9640 1 -- 172.21.15.6:0/1219153449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000aca0 con 0x7fcf580b2550 2023-11-28T21:08:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf54ff9640 1 -- 172.21.15.6:0/1219153449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000ae00 con 0x7fcf580b2550 2023-11-28T21:08:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf54ff9640 1 -- 172.21.15.6:0/1219153449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50012620 con 0x7fcf580b2550 2023-11-28T21:08:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf580c5410 con 0x7fcf580b2550 2023-11-28T21:08:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf580c5930 con 0x7fcf580b2550 2023-11-28T21:08:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.407+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf580c5630 con 0x7fcf580b2550 2023-11-28T21:08:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.411+0000 7fcf54ff9640 1 -- 172.21.15.6:0/1219153449 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf50007070 con 0x7fcf580b2550 2023-11-28T21:08:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.411+0000 7fcf54ff9640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf38066470 0x7fcf38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.411+0000 7fcf54ff9640 1 -- 172.21.15.6:0/1219153449 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf50083ec0 con 0x7fcf580b2550 2023-11-28T21:08:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.411+0000 7fcf56ffd640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf38066470 0x7fcf38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.411+0000 7fcf56ffd640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf38066470 0x7fcf38068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf480af000 tx=0x7fcf480a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.415+0000 7fcf54ff9640 1 -- 172.21.15.6:0/1219153449 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf50051360 con 0x7fcf580b2550 2023-11-28T21:08:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf580c4cb0 con 0x7fcf580b2550 2023-11-28T21:08:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf54ff9640 1 -- 172.21.15.6:0/1219153449 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf580c4cb0 con 0x7fcf580b2550 2023-11-28T21:08:37.580 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf38066470 msgr2=0x7fcf38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf38066470 0x7fcf38068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf480af000 tx=0x7fcf480a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf580b2550 msgr2=0x7fcf581544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf580b2550 0x7fcf581544b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000cb40 tx=0x7fcf5000a060 comp rx=0 tx=0).stop 2023-11-28T21:08:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 shutdown_connections 2023-11-28T21:08:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fcf38066470 0x7fcf38068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf580b2550 0x7fcf581544b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcf58099fc0 0x7fcf58153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 --2- 172.21.15.6:0/1219153449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf58099be0 0x7fcf5806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 >> 172.21.15.6:0/1219153449 conn(0x7fcf580b2a80 msgr2=0x7fcf5806fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 shutdown_connections 2023-11-28T21:08:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.575+0000 7fcf5d86b640 1 -- 172.21.15.6:0/1219153449 wait complete. 2023-11-28T21:08:37.602 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f3c17640 1 Processor -- start 2023-11-28T21:08:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f3c17640 1 -- start start 2023-11-28T21:08:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f3c17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec14b0e0 0x7f33ec0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f3c17640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33ec06d060 0x7f33ec0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f3c17640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec0b3e30 con 0x7f33ec0b1e70 2023-11-28T21:08:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f3c17640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec14b4c0 con 0x7f33ec06d060 2023-11-28T21:08:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f3c17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0b2850 con 0x7f33ec14b0e0 2023-11-28T21:08:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f11b2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f33ec0b1e70 0x7f33ec06c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35838/0 (socket says 172.21.15.6:35838) 2023-11-28T21:08:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f11b2640 1 -- 172.21.15.6:0/2948914477 learned_addr learned my addr 172.21.15.6:0/2948914477 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f19b3640 1 --2- 172.21.15.6:0/2948914477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec14b0e0 0x7f33ec0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f21b4640 1 --2- 172.21.15.6:0/2948914477 >> v2:172.21.15.31:3300/0 conn(0x7f33ec06d060 0x7f33ec0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f09b1640 1 -- 172.21.15.6:0/2948914477 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758168900 0 0) 0x7f33ec0b3e30 con 0x7f33ec0b1e70 2023-11-28T21:08:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f09b1640 1 -- 172.21.15.6:0/2948914477 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d8003530 con 0x7f33ec0b1e70 2023-11-28T21:08:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f19b3640 1 -- 172.21.15.6:0/2948914477 >> v2:172.21.15.31:3300/0 conn(0x7f33ec06d060 msgr2=0x7f33ec0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f19b3640 1 --2- 172.21.15.6:0/2948914477 >> v2:172.21.15.31:3300/0 conn(0x7f33ec06d060 0x7f33ec0cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f19b3640 1 -- 172.21.15.6:0/2948914477 >> v1:172.21.15.6:6789/0 conn(0x7f33ec0b1e70 legacy=0x7f33ec06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.747+0000 7f33f19b3640 1 -- 172.21.15.6:0/2948914477 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0b2b30 con 0x7f33ec14b0e0 2023-11-28T21:08:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f19b3640 1 --2- 172.21.15.6:0/2948914477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec14b0e0 0x7f33ec0b38f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33e80097c0 tx=0x7f33e801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfce2756afbc5a35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f09b1640 1 -- 172.21.15.6:0/2948914477 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80ad660 con 0x7f33ec14b0e0 2023-11-28T21:08:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f09b1640 1 -- 172.21.15.6:0/2948914477 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e80ad7c0 con 0x7f33ec14b0e0 2023-11-28T21:08:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f09b1640 1 -- 172.21.15.6:0/2948914477 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80adb50 con 0x7f33ec14b0e0 2023-11-28T21:08:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f3c17640 1 -- 172.21.15.6:0/2948914477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec14b0e0 msgr2=0x7f33ec0b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f3c17640 1 --2- 172.21.15.6:0/2948914477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec14b0e0 0x7f33ec0b38f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f33e80097c0 tx=0x7f33e801c450 comp rx=0 tx=0).stop 2023-11-28T21:08:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f3c17640 1 -- 172.21.15.6:0/2948914477 shutdown_connections 2023-11-28T21:08:37.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f3c17640 1 --2- 172.21.15.6:0/2948914477 >> v2:172.21.15.31:3300/0 conn(0x7f33ec06d060 0x7f33ec0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f3c17640 1 --2- 172.21.15.6:0/2948914477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec14b0e0 0x7f33ec0b38f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f3c17640 1 -- 172.21.15.6:0/2948914477 >> 172.21.15.6:0/2948914477 conn(0x7f33ec06a980 msgr2=0x7f33ec06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:37.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f3c17640 1 -- 172.21.15.6:0/2948914477 shutdown_connections 2023-11-28T21:08:37.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.751+0000 7f33f3c17640 1 -- 172.21.15.6:0/2948914477 wait complete. 2023-11-28T21:08:37.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 Processor -- start 2023-11-28T21:08:37.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 -- start start 2023-11-28T21:08:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33ec06d060 0x7f33ec15d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec0b1e70 0x7f33ec1448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33ec14b0e0 0x7f33ec144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec160a80 con 0x7f33ec06d060 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec161600 con 0x7f33ec14b0e0 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec160cd0 con 0x7f33ec0b1e70 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f19b3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33ec06d060 0x7f33ec15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f19b3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33ec06d060 0x7f33ec15d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52168/0 (socket says 172.21.15.6:52168) 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f19b3640 1 -- 172.21.15.6:0/3214271101 learned_addr learned my addr 172.21.15.6:0/3214271101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f11b2640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec0b1e70 0x7f33ec1448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f21b4640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33ec14b0e0 0x7f33ec144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f19b3640 1 -- 172.21.15.6:0/3214271101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec0b1e70 msgr2=0x7f33ec1448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f19b3640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec0b1e70 0x7f33ec1448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f19b3640 1 -- 172.21.15.6:0/3214271101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33ec14b0e0 msgr2=0x7f33ec144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f19b3640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33ec14b0e0 0x7f33ec144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f19b3640 1 -- 172.21.15.6:0/3214271101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e8009420 con 0x7f33ec06d060 2023-11-28T21:08:37.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f21b4640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33ec14b0e0 0x7f33ec144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:37.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f19b3640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33ec06d060 0x7f33ec15d420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f33e801a080 tx=0x7f33e80191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:37.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33e27fc640 1 -- 172.21.15.6:0/3214271101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80b7670 con 0x7f33ec06d060 2023-11-28T21:08:37.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33e27fc640 1 -- 172.21.15.6:0/3214271101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e80b77f0 con 0x7f33ec06d060 2023-11-28T21:08:37.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33e27fc640 1 -- 172.21.15.6:0/3214271101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80b7ba0 con 0x7f33ec06d060 2023-11-28T21:08:37.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec160fb0 con 0x7f33ec06d060 2023-11-28T21:08:37.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.755+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec15d960 con 0x7f33ec06d060 2023-11-28T21:08:37.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.759+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec072b90 con 0x7f33ec06d060 2023-11-28T21:08:37.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.759+0000 7f33e27fc640 1 -- 172.21.15.6:0/3214271101 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f33e80b4040 con 0x7f33ec06d060 2023-11-28T21:08:37.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.759+0000 7f33e27fc640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f33d0066470 0x7f33d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:37.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.759+0000 7f33e27fc640 1 -- 172.21.15.6:0/3214271101 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33e811e550 con 0x7f33ec06d060 2023-11-28T21:08:37.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.759+0000 7f33f11b2640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f33d0066470 0x7f33d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:37.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.759+0000 7f33f11b2640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f33d0066470 0x7f33d0068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0cb000 tx=0x7f33dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.763+0000 7f33e27fc640 1 -- 172.21.15.6:0/3214271101 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f33e80eb9c0 con 0x7f33ec06d060 2023-11-28T21:08:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33ec04e930 con 0x7f33ec06d060 2023-11-28T21:08:37.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33e27fc640 1 -- 172.21.15.6:0/3214271101 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33e80eefe0 con 0x7f33ec06d060 2023-11-28T21:08:37.928 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f33d0066470 msgr2=0x7f33d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f33d0066470 0x7f33d0068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0cb000 tx=0x7f33dc009040 comp rx=0 tx=0).stop 2023-11-28T21:08:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33ec06d060 msgr2=0x7f33ec15d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33ec06d060 0x7f33ec15d420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f33e801a080 tx=0x7f33e80191f0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 shutdown_connections 2023-11-28T21:08:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f33d0066470 0x7f33d0068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33ec14b0e0 0x7f33ec144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33ec0b1e70 0x7f33ec1448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 --2- 172.21.15.6:0/3214271101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33ec06d060 0x7f33ec15d420 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 >> 172.21.15.6:0/3214271101 conn(0x7f33ec06a980 msgr2=0x7f33ec070390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 shutdown_connections 2023-11-28T21:08:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:37.923+0000 7f33f3c17640 1 -- 172.21.15.6:0/3214271101 wait complete. 2023-11-28T21:08:37.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:38.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:38.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea9fb8640 1 Processor -- start 2023-11-28T21:08:38.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea9fb8640 1 -- start start 2023-11-28T21:08:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea9fb8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ea415fcf0 0x7f5ea40d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea9fb8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea40ceec0 0x7f5ea40b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea9fb8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea40cea30 con 0x7f5ea40cf320 2023-11-28T21:08:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea9fb8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea40d3ef0 con 0x7f5ea415fcf0 2023-11-28T21:08:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea9fb8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40b2430 con 0x7f5ea40ceec0 2023-11-28T21:08:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ea415fcf0 0x7f5ea40d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea2ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea40ceec0 0x7f5ea40b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea2ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea40ceec0 0x7f5ea40b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:57740/0 (socket says 172.21.15.6:57740) 2023-11-28T21:08:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea2ffd640 1 -- 172.21.15.6:0/2866334911 learned_addr learned my addr 172.21.15.6:0/2866334911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ea415fcf0 0x7f5ea40d3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:37836/0 (socket says 172.21.15.6:37836) 2023-11-28T21:08:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea3fff640 1 --1- 172.21.15.6:0/2866334911 >> v1:172.21.15.31:6789/0 conn(0x7f5ea40cf320 0x7f5ea40b2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:47324/0 (socket says 172.21.15.6:47324) 2023-11-28T21:08:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea2ffd640 1 -- 172.21.15.6:0/2866334911 >> v2:172.21.15.31:3300/0 conn(0x7f5ea415fcf0 msgr2=0x7f5ea40d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea2ffd640 1 --2- 172.21.15.6:0/2866334911 >> v2:172.21.15.31:3300/0 conn(0x7f5ea415fcf0 0x7f5ea40d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea2ffd640 1 -- 172.21.15.6:0/2866334911 >> v1:172.21.15.31:6789/0 conn(0x7f5ea40cf320 legacy=0x7f5ea40b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea2ffd640 1 -- 172.21.15.6:0/2866334911 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea41610e0 con 0x7f5ea40ceec0 2023-11-28T21:08:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.091+0000 7f5ea37fe640 1 --2- 172.21.15.6:0/2866334911 >> v2:172.21.15.31:3300/0 conn(0x7f5ea415fcf0 0x7f5ea40d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.095+0000 7f5ea2ffd640 1 --2- 172.21.15.6:0/2866334911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea40ceec0 0x7f5ea40b2ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009870 tx=0x7f5e9801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b19c7ad2ea183d5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.095+0000 7f5ea27fc640 1 -- 172.21.15.6:0/2866334911 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980ab680 con 0x7f5ea40ceec0 2023-11-28T21:08:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.095+0000 7f5ea27fc640 1 -- 172.21.15.6:0/2866334911 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e980ab7e0 con 0x7f5ea40ceec0 2023-11-28T21:08:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.095+0000 7f5ea27fc640 1 -- 172.21.15.6:0/2866334911 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980abb70 con 0x7f5ea40ceec0 2023-11-28T21:08:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/2866334911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea40ceec0 msgr2=0x7f5ea40b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 --2- 172.21.15.6:0/2866334911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea40ceec0 0x7f5ea40b2ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009870 tx=0x7f5e9801c480 comp rx=0 tx=0).stop 2023-11-28T21:08:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/2866334911 shutdown_connections 2023-11-28T21:08:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 --2- 172.21.15.6:0/2866334911 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea40ceec0 0x7f5ea40b2ab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 --2- 172.21.15.6:0/2866334911 >> v2:172.21.15.31:3300/0 conn(0x7f5ea415fcf0 0x7f5ea40d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/2866334911 >> 172.21.15.6:0/2866334911 conn(0x7f5ea409c480 msgr2=0x7f5ea40d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/2866334911 shutdown_connections 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/2866334911 wait complete. 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 Processor -- start 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 -- start start 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ea40ceec0 0x7f5ea4155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea415fcf0 0x7f5ea40ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea415e7d0 0x7f5ea415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea415f1c0 con 0x7f5ea415fcf0 2023-11-28T21:08:38.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40b8b10 con 0x7f5ea40ceec0 2023-11-28T21:08:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea9fb8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4155bb0 con 0x7f5ea415e7d0 2023-11-28T21:08:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea415fcf0 0x7f5ea40ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea415fcf0 0x7f5ea40ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52170/0 (socket says 172.21.15.6:52170) 2023-11-28T21:08:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.099+0000 7f5ea2ffd640 1 -- 172.21.15.6:0/3030947604 learned_addr learned my addr 172.21.15.6:0/3030947604 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea3fff640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea415e7d0 0x7f5ea415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea37fe640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ea40ceec0 0x7f5ea4155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea2ffd640 1 -- 172.21.15.6:0/3030947604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea415e7d0 msgr2=0x7f5ea415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea2ffd640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea415e7d0 0x7f5ea415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea2ffd640 1 -- 172.21.15.6:0/3030947604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ea40ceec0 msgr2=0x7f5ea4155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea2ffd640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ea40ceec0 0x7f5ea4155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea2ffd640 1 -- 172.21.15.6:0/3030947604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94009420 con 0x7f5ea415fcf0 2023-11-28T21:08:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea2ffd640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea415fcf0 0x7f5ea40ca220 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5e980ad040 tx=0x7f5e9801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3030947604 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980b4800 con 0x7f5ea415fcf0 2023-11-28T21:08:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3030947604 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e980b4960 con 0x7f5ea415fcf0 2023-11-28T21:08:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e980094d0 con 0x7f5ea415fcf0 2023-11-28T21:08:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3030947604 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980b4d10 con 0x7f5ea415fcf0 2023-11-28T21:08:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea40cd010 con 0x7f5ea415fcf0 2023-11-28T21:08:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea404e930 con 0x7f5ea415fcf0 2023-11-28T21:08:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3030947604 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e980c7440 con 0x7f5ea415fcf0 2023-11-28T21:08:38.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5e8bfff640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5e90066470 0x7f5e90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.103+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3030947604 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e9811ec70 con 0x7f5ea415fcf0 2023-11-28T21:08:38.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.107+0000 7f5ea37fe640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5e90066470 0x7f5e90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.107+0000 7f5ea37fe640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5e90066470 0x7f5e90068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40cfab0 tx=0x7f5e94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.107+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3030947604 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e980ec180 con 0x7f5ea415fcf0 2023-11-28T21:08:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ea40d4060 con 0x7f5ea415fcf0 2023-11-28T21:08:38.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3030947604 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e980ef7a0 con 0x7f5ea415fcf0 2023-11-28T21:08:38.273 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5e90066470 msgr2=0x7f5e90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5e90066470 0x7f5e90068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40cfab0 tx=0x7f5e94008040 comp rx=0 tx=0).stop 2023-11-28T21:08:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea415fcf0 msgr2=0x7f5ea40ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea415fcf0 0x7f5ea40ca220 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5e980ad040 tx=0x7f5e9801acc0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 shutdown_connections 2023-11-28T21:08:38.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5e90066470 0x7f5e90068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ea415e7d0 0x7f5ea415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ea415fcf0 0x7f5ea40ca220 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 --2- 172.21.15.6:0/3030947604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ea40ceec0 0x7f5ea4155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 >> 172.21.15.6:0/3030947604 conn(0x7f5ea409c480 msgr2=0x7f5ea40b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 shutdown_connections 2023-11-28T21:08:38.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.267+0000 7f5ea9fb8640 1 -- 172.21.15.6:0/3030947604 wait complete. 2023-11-28T21:08:38.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:38.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.475+0000 7f0c56f96640 1 Processor -- start 2023-11-28T21:08:38.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.475+0000 7f0c56f96640 1 -- start start 2023-11-28T21:08:38.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.475+0000 7f0c56f96640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c5015f230 0x7f0c500b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.475+0000 7f0c56f96640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c50162890 0x7f0c500705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.475+0000 7f0c56f96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c500b32c0 con 0x7f0c50070b20 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.475+0000 7f0c56f96640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5006d580 con 0x7f0c50162890 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.475+0000 7f0c56f96640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50070f90 con 0x7f0c5015f230 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.475+0000 7f0c55533640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c50070b20 0x7f0c501651e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45984/0 (socket says 172.21.15.6:45984) 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.475+0000 7f0c55533640 1 -- 172.21.15.6:0/2162169288 learned_addr learned my addr 172.21.15.6:0/2162169288 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c54d32640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c5015f230 0x7f0c500b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4ffff640 1 --2- 172.21.15.6:0/2162169288 >> v2:172.21.15.31:3300/0 conn(0x7f0c50162890 0x7f0c500705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797153209 0 0) 0x7f0c500b32c0 con 0x7f0c50070b20 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c40003530 con 0x7f0c50070b20 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4106580714 0 0) 0x7f0c40003530 con 0x7f0c50070b20 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c5015f230 msgr2=0x7f0c500b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c5015f230 0x7f0c500b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 >> v2:172.21.15.31:3300/0 conn(0x7f0c50162890 msgr2=0x7f0c500705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 --2- 172.21.15.6:0/2162169288 >> v2:172.21.15.31:3300/0 conn(0x7f0c50162890 0x7f0c500705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5015f610 con 0x7f0c50070b20 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f0c48001a00 con 0x7f0c50070b20 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 >> v1:172.21.15.6:6789/0 conn(0x7f0c50070b20 legacy=0x7f0c501651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c5015f230 0x7f0c400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40003f20 0x7f0c400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40004d10 0x7f0c40005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5006d580 con 0x7f0c40003f20 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50070f90 con 0x7f0c40004d10 2023-11-28T21:08:38.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4000b990 con 0x7f0c5015f230 2023-11-28T21:08:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4ffff640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40003f20 0x7f0c400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c54d32640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c5015f230 0x7f0c400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c55533640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40004d10 0x7f0c40005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4ffff640 1 -- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c5015f230 msgr2=0x7f0c400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4ffff640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c5015f230 0x7f0c400039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4ffff640 1 -- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40004d10 msgr2=0x7f0c40005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4ffff640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40004d10 0x7f0c40005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c4ffff640 1 -- 172.21.15.6:0/2162169288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40003530 con 0x7f0c40003f20 2023-11-28T21:08:38.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.479+0000 7f0c55533640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40004d10 0x7f0c40005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:38.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c4ffff640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40003f20 0x7f0c400047d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009b10 tx=0x7f0c3c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe007425a7b9042 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:38.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c0a5570 con 0x7f0c40003f20 2023-11-28T21:08:38.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c0a56d0 con 0x7f0c40003f20 2023-11-28T21:08:38.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c4f7fe640 1 -- 172.21.15.6:0/2162169288 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c0a5a80 con 0x7f0c40003f20 2023-11-28T21:08:38.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c56f96640 1 -- 172.21.15.6:0/2162169288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40003f20 msgr2=0x7f0c400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c56f96640 1 --2- 172.21.15.6:0/2162169288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40003f20 0x7f0c400047d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009b10 tx=0x7f0c3c01ca90 comp rx=0 tx=0).stop 2023-11-28T21:08:38.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c55533640 1 -- 172.21.15.6:0/2162169288 reap_dead start 2023-11-28T21:08:38.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c56f96640 1 -- 172.21.15.6:0/2162169288 shutdown_connections 2023-11-28T21:08:38.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c56f96640 1 -- 172.21.15.6:0/2162169288 >> 172.21.15.6:0/2162169288 conn(0x7f0c5006ab80 msgr2=0x7f0c500b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:38.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c56f96640 1 -- 172.21.15.6:0/2162169288 shutdown_connections 2023-11-28T21:08:38.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c56f96640 1 -- 172.21.15.6:0/2162169288 wait complete. 2023-11-28T21:08:38.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c56f96640 1 Processor -- start 2023-11-28T21:08:38.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c56f96640 1 -- start start 2023-11-28T21:08:38.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.483+0000 7f0c56f96640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c40003f20 0x7f0c501f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c56f96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c501f4740 0x7f0c50165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c56f96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c50165a70 0x7f0c501fa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c56f96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50165ef0 con 0x7f0c50165a70 2023-11-28T21:08:38.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c56f96640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c501f8200 con 0x7f0c501f4740 2023-11-28T21:08:38.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c56f96640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500cbb10 con 0x7f0c40003f20 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c55533640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c50165a70 0x7f0c501fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c55533640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c50165a70 0x7f0c501fa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37864/0 (socket says 172.21.15.6:37864) 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c55533640 1 -- 172.21.15.6:0/4173403334 learned_addr learned my addr 172.21.15.6:0/4173403334 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c54d32640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c40003f20 0x7f0c501f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c4ffff640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c501f4740 0x7f0c50165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c55533640 1 -- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c40003f20 msgr2=0x7f0c501f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c55533640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c40003f20 0x7f0c501f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c55533640 1 -- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c501f4740 msgr2=0x7f0c50165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c55533640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c501f4740 0x7f0c50165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c55533640 1 -- 172.21.15.6:0/4173403334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500cbdf0 con 0x7f0c50165a70 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c54d32640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c40003f20 0x7f0c501f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:38.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c4ffff640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c501f4740 0x7f0c50165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:38.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c55533640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c50165a70 0x7f0c501fa830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c48000f90 tx=0x7f0c48011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:38.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c4d7fa640 1 -- 172.21.15.6:0/4173403334 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800f8a0 con 0x7f0c50165a70 2023-11-28T21:08:38.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c4d7fa640 1 -- 172.21.15.6:0/4173403334 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800fa00 con 0x7f0c50165a70 2023-11-28T21:08:38.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c4d7fa640 1 -- 172.21.15.6:0/4173403334 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800fdb0 con 0x7f0c50165a70 2023-11-28T21:08:38.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c500cc0d0 con 0x7f0c50165a70 2023-11-28T21:08:38.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c500cc690 con 0x7f0c50165a70 2023-11-28T21:08:38.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c500b24c0 con 0x7f0c50165a70 2023-11-28T21:08:38.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.487+0000 7f0c4d7fa640 1 -- 172.21.15.6:0/4173403334 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0c4801f460 con 0x7f0c50165a70 2023-11-28T21:08:38.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.491+0000 7f0c4d7fa640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c340664a0 0x7f0c34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.491+0000 7f0c4d7fa640 1 -- 172.21.15.6:0/4173403334 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c48086f30 con 0x7f0c50165a70 2023-11-28T21:08:38.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.491+0000 7f0c54d32640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c340664a0 0x7f0c34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.491+0000 7f0c54d32640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c340664a0 0x7f0c34068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009b00 tx=0x7f0c44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:38.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.495+0000 7f0c4d7fa640 1 -- 172.21.15.6:0/4173403334 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c48054310 con 0x7f0c50165a70 2023-11-28T21:08:38.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.651+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c500cc880 con 0x7f0c50165a70 2023-11-28T21:08:38.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c4d7fa640 1 -- 172.21.15.6:0/4173403334 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f0c4805ce60 con 0x7f0c50165a70 2023-11-28T21:08:38.660 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:38.660 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c340664a0 msgr2=0x7f0c34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c340664a0 0x7f0c34068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009b00 tx=0x7f0c44008040 comp rx=0 tx=0).stop 2023-11-28T21:08:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c50165a70 msgr2=0x7f0c501fa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c50165a70 0x7f0c501fa830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c48000f90 tx=0x7f0c48011b70 comp rx=0 tx=0).stop 2023-11-28T21:08:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 shutdown_connections 2023-11-28T21:08:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c340664a0 0x7f0c34068960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c50165a70 0x7f0c501fa830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c501f4740 0x7f0c50165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 --2- 172.21.15.6:0/4173403334 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c40003f20 0x7f0c501f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 >> 172.21.15.6:0/4173403334 conn(0x7f0c5006ab80 msgr2=0x7f0c500b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 shutdown_connections 2023-11-28T21:08:38.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.655+0000 7f0c56f96640 1 -- 172.21.15.6:0/4173403334 wait complete. 2023-11-28T21:08:38.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:38.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:38.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f65067f8640 1 Processor -- start 2023-11-28T21:08:38.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f65067f8640 1 -- start start 2023-11-28T21:08:38.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f65067f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6500143970 0x7f650006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f65067f8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f650015e1a0 0x7f650006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f65067f8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65000b30b0 con 0x7f65000b4110 2023-11-28T21:08:38.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f65067f8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650015e7e0 con 0x7f650015e1a0 2023-11-28T21:08:38.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f65067f8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65000b3350 con 0x7f6500143970 2023-11-28T21:08:38.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f6504d95640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f650015e1a0 0x7f650006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f64ff7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f65000b4110 0x7f650015da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45992/0 (socket says 172.21.15.6:45992) 2023-11-28T21:08:38.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f64ff7fe640 1 -- 172.21.15.6:0/909949650 learned_addr learned my addr 172.21.15.6:0/909949650 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:38.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.823+0000 7f64fffff640 1 --2- 172.21.15.6:0/909949650 >> v2:172.21.15.31:3300/0 conn(0x7f6500143970 0x7f650006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f6504d95640 1 -- 172.21.15.6:0/909949650 >> v2:172.21.15.31:3300/0 conn(0x7f6500143970 msgr2=0x7f650006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:38.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f6504d95640 1 --2- 172.21.15.6:0/909949650 >> v2:172.21.15.31:3300/0 conn(0x7f6500143970 0x7f650006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f6504d95640 1 -- 172.21.15.6:0/909949650 >> v1:172.21.15.6:6789/0 conn(0x7f65000b4110 legacy=0x7f650015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f6504d95640 1 -- 172.21.15.6:0/909949650 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65000b3630 con 0x7f650015e1a0 2023-11-28T21:08:38.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f6504d95640 1 --2- 172.21.15.6:0/909949650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f650015e1a0 0x7f650006ce90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f65000b1bc0 tx=0x7f64f801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54ff25af223fa30 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f64feffd640 1 -- 172.21.15.6:0/909949650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f80a5830 con 0x7f650015e1a0 2023-11-28T21:08:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f64feffd640 1 -- 172.21.15.6:0/909949650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f80a5990 con 0x7f650015e1a0 2023-11-28T21:08:38.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f64feffd640 1 -- 172.21.15.6:0/909949650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f80a5d20 con 0x7f650015e1a0 2023-11-28T21:08:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f65067f8640 1 -- 172.21.15.6:0/909949650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f650015e1a0 msgr2=0x7f650006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f65067f8640 1 --2- 172.21.15.6:0/909949650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f650015e1a0 0x7f650006ce90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f65000b1bc0 tx=0x7f64f801c880 comp rx=0 tx=0).stop 2023-11-28T21:08:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f65067f8640 1 -- 172.21.15.6:0/909949650 shutdown_connections 2023-11-28T21:08:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f65067f8640 1 --2- 172.21.15.6:0/909949650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f650015e1a0 0x7f650006ce90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f65067f8640 1 --2- 172.21.15.6:0/909949650 >> v2:172.21.15.31:3300/0 conn(0x7f6500143970 0x7f650006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f65067f8640 1 -- 172.21.15.6:0/909949650 >> 172.21.15.6:0/909949650 conn(0x7f650006a980 msgr2=0x7f650006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:38.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.827+0000 7f65067f8640 1 -- 172.21.15.6:0/909949650 shutdown_connections 2023-11-28T21:08:38.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f65067f8640 1 -- 172.21.15.6:0/909949650 wait complete. 2023-11-28T21:08:38.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f65067f8640 1 Processor -- start 2023-11-28T21:08:38.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f65067f8640 1 -- start start 2023-11-28T21:08:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f65067f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65000b4110 0x7f6500153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f65067f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6500143970 0x7f6500155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f65067f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f650015e1a0 0x7f650013fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f65067f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6500137230 con 0x7f6500143970 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f65067f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6500136620 con 0x7f650015e1a0 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f65067f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6500136900 con 0x7f65000b4110 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64ff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6500143970 0x7f6500155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64ff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6500143970 0x7f6500155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37892/0 (socket says 172.21.15.6:37892) 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64ff7fe640 1 -- 172.21.15.6:0/4109112247 learned_addr learned my addr 172.21.15.6:0/4109112247 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64fffff640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65000b4110 0x7f6500153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f6504d95640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f650015e1a0 0x7f650013fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64ff7fe640 1 -- 172.21.15.6:0/4109112247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65000b4110 msgr2=0x7f6500153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64ff7fe640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65000b4110 0x7f6500153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64ff7fe640 1 -- 172.21.15.6:0/4109112247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f650015e1a0 msgr2=0x7f650013fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64ff7fe640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f650015e1a0 0x7f650013fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64ff7fe640 1 -- 172.21.15.6:0/4109112247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f8009a70 con 0x7f6500143970 2023-11-28T21:08:38.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64ff7fe640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6500143970 0x7f6500155de0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f64f400c4d0 tx=0x7f64f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:38.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.831+0000 7f64fcff9640 1 -- 172.21.15.6:0/4109112247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4005cf0 con 0x7f6500143970 2023-11-28T21:08:38.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f64fcff9640 1 -- 172.21.15.6:0/4109112247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f4005e50 con 0x7f6500143970 2023-11-28T21:08:38.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f64fcff9640 1 -- 172.21.15.6:0/4109112247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4007270 con 0x7f6500143970 2023-11-28T21:08:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6500136be0 con 0x7f6500143970 2023-11-28T21:08:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6500154000 con 0x7f6500143970 2023-11-28T21:08:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65001373a0 con 0x7f6500143970 2023-11-28T21:08:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f64fcff9640 1 -- 172.21.15.6:0/4109112247 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64f40073d0 con 0x7f6500143970 2023-11-28T21:08:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f64fcff9640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64ec066470 0x7f64ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f64fcff9640 1 -- 172.21.15.6:0/4109112247 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64f4083290 con 0x7f6500143970 2023-11-28T21:08:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f64fffff640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64ec066470 0x7f64ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.835+0000 7f64fffff640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64ec066470 0x7f64ec068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64f0007a60 tx=0x7f64f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:38.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.839+0000 7f64fcff9640 1 -- 172.21.15.6:0/4109112247 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64f40507b0 con 0x7f6500143970 2023-11-28T21:08:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.999+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6500072b90 con 0x7f6500143970 2023-11-28T21:08:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:38.999+0000 7f64fcff9640 1 -- 172.21.15.6:0/4109112247 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64f4053dd0 con 0x7f6500143970 2023-11-28T21:08:39.005 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64ec066470 msgr2=0x7f64ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64ec066470 0x7f64ec068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64f0007a60 tx=0x7f64f0008040 comp rx=0 tx=0).stop 2023-11-28T21:08:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6500143970 msgr2=0x7f6500155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6500143970 0x7f6500155de0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f64f400c4d0 tx=0x7f64f400c990 comp rx=0 tx=0).stop 2023-11-28T21:08:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 shutdown_connections 2023-11-28T21:08:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64ec066470 0x7f64ec068930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f650015e1a0 0x7f650013fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6500143970 0x7f6500155de0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 --2- 172.21.15.6:0/4109112247 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65000b4110 0x7f6500153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 >> 172.21.15.6:0/4109112247 conn(0x7f650006a980 msgr2=0x7f6500142c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 shutdown_connections 2023-11-28T21:08:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.003+0000 7f65067f8640 1 -- 172.21.15.6:0/4109112247 wait complete. 2023-11-28T21:08:39.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:39.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f84a0afd640 1 Processor -- start 2023-11-28T21:08:39.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f84a0afd640 1 -- start start 2023-11-28T21:08:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f84a0afd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c0cbf40 0x7f849c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f84a0afd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f849c15e750 0x7f849c15a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f84a0afd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849c15b510 con 0x7f849c15e370 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f84a0afd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849c0cd730 con 0x7f849c15e750 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f84a0afd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c13d450 con 0x7f849c0cbf40 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f849ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f849c15e750 0x7f849c15a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f849ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f849c15e750 0x7f849c15a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37898/0 (socket says 172.21.15.6:37898) 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f849ad9d640 1 -- 172.21.15.6:0/714763413 learned_addr learned my addr 172.21.15.6:0/714763413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f8493fff640 1 --2- 172.21.15.6:0/714763413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c0cbf40 0x7f849c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f849ad9d640 1 -- 172.21.15.6:0/714763413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c0cbf40 msgr2=0x7f849c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f849ad9d640 1 --2- 172.21.15.6:0/714763413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c0cbf40 0x7f849c0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f849ad9d640 1 -- 172.21.15.6:0/714763413 >> v1:172.21.15.31:6789/0 conn(0x7f849c15e370 legacy=0x7f849c0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.167+0000 7f849ad9d640 1 -- 172.21.15.6:0/714763413 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c0cd940 con 0x7f849c15e750 2023-11-28T21:08:39.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f849ad9d640 1 --2- 172.21.15.6:0/714763413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e750 0x7f849c15a7e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8494009e50 tx=0x7f849401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc674f7f53b129b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f8499d9b640 1 -- 172.21.15.6:0/714763413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84940a57d0 con 0x7f849c15e750 2023-11-28T21:08:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f8499d9b640 1 -- 172.21.15.6:0/714763413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84940a5930 con 0x7f849c15e750 2023-11-28T21:08:39.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f8499d9b640 1 -- 172.21.15.6:0/714763413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84940a5cc0 con 0x7f849c15e750 2023-11-28T21:08:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f84a0afd640 1 -- 172.21.15.6:0/714763413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e750 msgr2=0x7f849c15a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f84a0afd640 1 --2- 172.21.15.6:0/714763413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e750 0x7f849c15a7e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8494009e50 tx=0x7f849401ca10 comp rx=0 tx=0).stop 2023-11-28T21:08:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f84a0afd640 1 -- 172.21.15.6:0/714763413 shutdown_connections 2023-11-28T21:08:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f84a0afd640 1 --2- 172.21.15.6:0/714763413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e750 0x7f849c15a7e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f84a0afd640 1 --2- 172.21.15.6:0/714763413 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c0cbf40 0x7f849c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f84a0afd640 1 -- 172.21.15.6:0/714763413 >> 172.21.15.6:0/714763413 conn(0x7f849c06a980 msgr2=0x7f849c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f84a0afd640 1 -- 172.21.15.6:0/714763413 shutdown_connections 2023-11-28T21:08:39.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.171+0000 7f84a0afd640 1 -- 172.21.15.6:0/714763413 wait complete. 2023-11-28T21:08:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f84a0afd640 1 Processor -- start 2023-11-28T21:08:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f84a0afd640 1 -- start start 2023-11-28T21:08:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f84a0afd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f849c0cbf40 0x7f849c13c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f84a0afd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e370 0x7f849c149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f84a0afd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c15e750 0x7f849c146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f84a0afd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0b10f0 con 0x7f849c15e370 2023-11-28T21:08:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f84a0afd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c14a950 con 0x7f849c0cbf40 2023-11-28T21:08:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f84a0afd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0b07c0 con 0x7f849c15e750 2023-11-28T21:08:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8493fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e370 0x7f849c149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8493fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e370 0x7f849c149e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37902/0 (socket says 172.21.15.6:37902) 2023-11-28T21:08:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8493fff640 1 -- 172.21.15.6:0/2474756345 learned_addr learned my addr 172.21.15.6:0/2474756345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f849a59c640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f849c0cbf40 0x7f849c13c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f849ad9d640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c15e750 0x7f849c146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8493fff640 1 -- 172.21.15.6:0/2474756345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c15e750 msgr2=0x7f849c146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8493fff640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c15e750 0x7f849c146810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8493fff640 1 -- 172.21.15.6:0/2474756345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f849c0cbf40 msgr2=0x7f849c13c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8493fff640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f849c0cbf40 0x7f849c13c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8493fff640 1 -- 172.21.15.6:0/2474756345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009b30 con 0x7f849c15e370 2023-11-28T21:08:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8493fff640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e370 0x7f849c149e90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f848400e930 tx=0x7f848400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8492ffd640 1 -- 172.21.15.6:0/2474756345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484009690 con 0x7f849c15e370 2023-11-28T21:08:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8492ffd640 1 -- 172.21.15.6:0/2474756345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848400ca00 con 0x7f849c15e370 2023-11-28T21:08:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f8492ffd640 1 -- 172.21.15.6:0/2474756345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848400cd70 con 0x7f849c15e370 2023-11-28T21:08:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.175+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849c0b0aa0 con 0x7f849c15e370 2023-11-28T21:08:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.179+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c0b1580 con 0x7f849c15e370 2023-11-28T21:08:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.179+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c0b1260 con 0x7f849c15e370 2023-11-28T21:08:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.179+0000 7f8492ffd640 1 -- 172.21.15.6:0/2474756345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8484013470 con 0x7f849c15e370 2023-11-28T21:08:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.179+0000 7f8492ffd640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f847c0664a0 0x7f847c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.179+0000 7f8492ffd640 1 -- 172.21.15.6:0/2474756345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84840840c0 con 0x7f849c15e370 2023-11-28T21:08:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.179+0000 7f849a59c640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f847c0664a0 0x7f847c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.183+0000 7f849a59c640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f847c0664a0 0x7f847c068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f848c007fd0 tx=0x7f848c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:39.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.183+0000 7f8492ffd640 1 -- 172.21.15.6:0/2474756345 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8484051610 con 0x7f849c15e370 2023-11-28T21:08:39.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.343+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f849c06d160 con 0x7f849c15e370 2023-11-28T21:08:39.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.343+0000 7f8492ffd640 1 -- 172.21.15.6:0/2474756345 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8484054c30 con 0x7f849c15e370 2023-11-28T21:08:39.351 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:39.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f847c0664a0 msgr2=0x7f847c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f847c0664a0 0x7f847c068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f848c007fd0 tx=0x7f848c009040 comp rx=0 tx=0).stop 2023-11-28T21:08:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e370 msgr2=0x7f849c149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e370 0x7f849c149e90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f848400e930 tx=0x7f848400edf0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 shutdown_connections 2023-11-28T21:08:39.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f847c0664a0 0x7f847c068960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849c15e750 0x7f849c146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849c15e370 0x7f849c149e90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 --2- 172.21.15.6:0/2474756345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f849c0cbf40 0x7f849c13c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 >> 172.21.15.6:0/2474756345 conn(0x7f849c06a980 msgr2=0x7f849c14b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 shutdown_connections 2023-11-28T21:08:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.347+0000 7f84a0afd640 1 -- 172.21.15.6:0/2474756345 wait complete. 2023-11-28T21:08:39.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:39.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb790f640 1 Processor -- start 2023-11-28T21:08:39.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb790f640 1 -- start start 2023-11-28T21:08:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb790f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2eb006d060 0x7f2eb00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb790f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00b2850 con 0x7f2eb014b0e0 2023-11-28T21:08:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb790f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00b2b30 con 0x7f2eb00b1e70 2023-11-28T21:08:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb790f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb014b4c0 con 0x7f2eb006d060 2023-11-28T21:08:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb56ab640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2eb014b0e0 0x7f2eb00b38f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46004/0 (socket says 172.21.15.6:46004) 2023-11-28T21:08:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb56ab640 1 -- 172.21.15.6:0/3822559215 learned_addr learned my addr 172.21.15.6:0/3822559215 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214705037 0 0) 0x7f2eb00b2850 con 0x7f2eb014b0e0 2023-11-28T21:08:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e9c003530 con 0x7f2eb014b0e0 2023-11-28T21:08:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb5eac640 1 --2- 172.21.15.6:0/3822559215 >> v2:172.21.15.31:3300/0 conn(0x7f2eb006d060 0x7f2eb00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3748405283 0 0) 0x7f2e9c003530 con 0x7f2eb014b0e0 2023-11-28T21:08:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 >> v2:172.21.15.31:3300/0 conn(0x7f2eb006d060 msgr2=0x7f2eb00cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 --2- 172.21.15.6:0/3822559215 >> v2:172.21.15.31:3300/0 conn(0x7f2eb006d060 0x7f2eb00cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 >> v1:172.21.15.31:6789/0 conn(0x7f2eb00b1e70 legacy=0x7f2eb006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00b2e10 con 0x7f2eb014b0e0 2023-11-28T21:08:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f2eac001680 con 0x7f2eb014b0e0 2023-11-28T21:08:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 >> v1:172.21.15.6:6789/0 conn(0x7f2eb014b0e0 legacy=0x7f2eb00b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c0039d0 0x7f2e9c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c0047d0 0x7f2e9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c005190 0x7f2e9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c00c060 con 0x7f2e9c005190 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c00c1d0 con 0x7f2e9c0047d0 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c00c390 con 0x7f2e9c0039d0 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb5eac640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c005190 0x7f2e9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb56ab640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c0039d0 0x7f2e9c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.515+0000 7f2eb4eaa640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c0047d0 0x7f2e9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb5eac640 1 -- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c0039d0 msgr2=0x7f2e9c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb5eac640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c0039d0 0x7f2e9c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb5eac640 1 -- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c0047d0 msgr2=0x7f2e9c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb5eac640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c0047d0 0x7f2e9c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb5eac640 1 -- 172.21.15.6:0/3822559215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c003530 con 0x7f2e9c005190 2023-11-28T21:08:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb56ab640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c0039d0 0x7f2e9c003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb4eaa640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e9c0047d0 0x7f2e9c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb5eac640 1 -- 172.21.15.6:0/3822559215 reap_dead start 2023-11-28T21:08:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb5eac640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c005190 0x7f2e9c00b990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009fc0 tx=0x7f2ea801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd64b0408557de2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80a5cb0 con 0x7f2e9c005190 2023-11-28T21:08:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800f040 con 0x7f2e9c005190 2023-11-28T21:08:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2ea7fff640 1 -- 172.21.15.6:0/3822559215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8003be0 con 0x7f2e9c005190 2023-11-28T21:08:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb790f640 1 -- 172.21.15.6:0/3822559215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c005190 msgr2=0x7f2e9c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb790f640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c005190 0x7f2e9c00b990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009fc0 tx=0x7f2ea801cca0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb790f640 1 -- 172.21.15.6:0/3822559215 shutdown_connections 2023-11-28T21:08:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb790f640 1 --2- 172.21.15.6:0/3822559215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e9c005190 0x7f2e9c00b990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb790f640 1 -- 172.21.15.6:0/3822559215 >> 172.21.15.6:0/3822559215 conn(0x7f2eb006a980 msgr2=0x7f2eb006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.519+0000 7f2eb790f640 1 -- 172.21.15.6:0/3822559215 shutdown_connections 2023-11-28T21:08:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 -- 172.21.15.6:0/3822559215 wait complete. 2023-11-28T21:08:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 Processor -- start 2023-11-28T21:08:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 -- start start 2023-11-28T21:08:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c005190 0x7f2eb0142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00af440 0x7f2eb015daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2eb00af8a0 0x7f2eb015dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb015e520 con 0x7f2eb00af440 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0162000 con 0x7f2eb00af8a0 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb01622e0 con 0x7f2e9c005190 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb4eaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00af440 0x7f2eb015daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb4eaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00af440 0x7f2eb015daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37934/0 (socket says 172.21.15.6:37934) 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb4eaa640 1 -- 172.21.15.6:0/509484057 learned_addr learned my addr 172.21.15.6:0/509484057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb56ab640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c005190 0x7f2eb0142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb4eaa640 1 -- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c005190 msgr2=0x7f2eb0142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb5eac640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2eb00af8a0 0x7f2eb015dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb4eaa640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c005190 0x7f2eb0142ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb4eaa640 1 -- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2eb00af8a0 msgr2=0x7f2eb015dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb4eaa640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2eb00af8a0 0x7f2eb015dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb4eaa640 1 -- 172.21.15.6:0/509484057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb01625c0 con 0x7f2eb00af440 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb56ab640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c005190 0x7f2eb0142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb5eac640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2eb00af8a0 0x7f2eb015dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb4eaa640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00af440 0x7f2eb015daa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000e480 tx=0x7f2ea000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2ea5ffb640 1 -- 172.21.15.6:0/509484057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00052e0 con 0x7f2eb00af440 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2ea5ffb640 1 -- 172.21.15.6:0/509484057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0005440 con 0x7f2eb00af440 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb01628a0 con 0x7f2eb00af440 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.523+0000 7f2ea5ffb640 1 -- 172.21.15.6:0/509484057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0003820 con 0x7f2eb00af440 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.527+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb01496a0 con 0x7f2eb00af440 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.527+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb0072b90 con 0x7f2eb00af440 2023-11-28T21:08:39.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.527+0000 7f2ea5ffb640 1 -- 172.21.15.6:0/509484057 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ea0003980 con 0x7f2eb00af440 2023-11-28T21:08:39.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.527+0000 7f2ea5ffb640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2e94066470 0x7f2e94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.527+0000 7f2ea5ffb640 1 -- 172.21.15.6:0/509484057 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ea0083b90 con 0x7f2eb00af440 2023-11-28T21:08:39.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.527+0000 7f2eb56ab640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2e94066470 0x7f2e94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.527+0000 7f2eb56ab640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2e94066470 0x7f2e94068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0017b0 tx=0x7f2eac001a60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:39.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.531+0000 7f2ea5ffb640 1 -- 172.21.15.6:0/509484057 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ea00510a0 con 0x7f2eb00af440 2023-11-28T21:08:39.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2eb004e930 con 0x7f2eb00af440 2023-11-28T21:08:39.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2ea5ffb640 1 -- 172.21.15.6:0/509484057 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ea00546c0 con 0x7f2eb00af440 2023-11-28T21:08:39.698 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:39.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2e94066470 msgr2=0x7f2e94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2e94066470 0x7f2e94068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0017b0 tx=0x7f2eac001a60 comp rx=0 tx=0).stop 2023-11-28T21:08:39.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00af440 msgr2=0x7f2eb015daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00af440 0x7f2eb015daa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000e480 tx=0x7f2ea000e940 comp rx=0 tx=0).stop 2023-11-28T21:08:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 shutdown_connections 2023-11-28T21:08:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2e94066470 0x7f2e94068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2eb00af8a0 0x7f2eb015dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00af440 0x7f2eb015daa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 --2- 172.21.15.6:0/509484057 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e9c005190 0x7f2eb0142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 >> 172.21.15.6:0/509484057 conn(0x7f2eb006a980 msgr2=0x7f2eb0149f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 shutdown_connections 2023-11-28T21:08:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.691+0000 7f2eb790f640 1 -- 172.21.15.6:0/509484057 wait complete. 2023-11-28T21:08:39.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:39.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.855+0000 7f3766196640 1 Processor -- start 2023-11-28T21:08:39.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.855+0000 7f3766196640 1 -- start start 2023-11-28T21:08:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f3766196640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f376006dd90 0x7f3760071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f3766196640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376015e340 con 0x7f3760142da0 2023-11-28T21:08:39.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f3766196640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37600b39b0 con 0x7f376015e7d0 2023-11-28T21:08:39.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f3766196640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376015dae0 con 0x7f376006dd90 2023-11-28T21:08:39.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f375f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3760142da0 0x7f376006d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46006/0 (socket says 172.21.15.6:46006) 2023-11-28T21:08:39.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f375f7fe640 1 -- 172.21.15.6:0/1868698815 learned_addr learned my addr 172.21.15.6:0/1868698815 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:39.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f3757fff640 1 --2- 172.21.15.6:0/1868698815 >> v2:172.21.15.31:3300/0 conn(0x7f376006dd90 0x7f3760071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f375effd640 1 -- 172.21.15.6:0/1868698815 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088677693 0 0) 0x7f376015e340 con 0x7f3760142da0 2023-11-28T21:08:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f375effd640 1 -- 172.21.15.6:0/1868698815 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f374c003530 con 0x7f3760142da0 2023-11-28T21:08:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f375effd640 1 -- 172.21.15.6:0/1868698815 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858124314 0 0) 0x7f37600b39b0 con 0x7f376015e7d0 2023-11-28T21:08:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f375effd640 1 -- 172.21.15.6:0/1868698815 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f376015e340 con 0x7f376015e7d0 2023-11-28T21:08:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f3757fff640 1 -- 172.21.15.6:0/1868698815 >> v1:172.21.15.31:6789/0 conn(0x7f376015e7d0 legacy=0x7f37600b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f3757fff640 1 -- 172.21.15.6:0/1868698815 >> v1:172.21.15.6:6789/0 conn(0x7f3760142da0 legacy=0x7f376006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.859+0000 7f3757fff640 1 -- 172.21.15.6:0/1868698815 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760143440 con 0x7f376006dd90 2023-11-28T21:08:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3757fff640 1 --2- 172.21.15.6:0/1868698815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376006dd90 0x7f3760071fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f37480097c0 tx=0x7f374801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e352f5e72dab77 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f375effd640 1 -- 172.21.15.6:0/1868698815 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480ab650 con 0x7f376006dd90 2023-11-28T21:08:39.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f375effd640 1 -- 172.21.15.6:0/1868698815 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37480ab7b0 con 0x7f376006dd90 2023-11-28T21:08:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f375effd640 1 -- 172.21.15.6:0/1868698815 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480abb40 con 0x7f376006dd90 2023-11-28T21:08:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 -- 172.21.15.6:0/1868698815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376006dd90 msgr2=0x7f3760071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 --2- 172.21.15.6:0/1868698815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376006dd90 0x7f3760071fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f37480097c0 tx=0x7f374801c450 comp rx=0 tx=0).stop 2023-11-28T21:08:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 -- 172.21.15.6:0/1868698815 shutdown_connections 2023-11-28T21:08:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 --2- 172.21.15.6:0/1868698815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376006dd90 0x7f3760071fb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 -- 172.21.15.6:0/1868698815 >> 172.21.15.6:0/1868698815 conn(0x7f376006ab80 msgr2=0x7f37600b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 -- 172.21.15.6:0/1868698815 shutdown_connections 2023-11-28T21:08:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 -- 172.21.15.6:0/1868698815 wait complete. 2023-11-28T21:08:39.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 Processor -- start 2023-11-28T21:08:39.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 -- start start 2023-11-28T21:08:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f376006dd90 0x7f376013c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3760142da0 0x7f37601580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.863+0000 7f3766196640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376015e7d0 0x7f37600ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f3766196640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37601589c0 con 0x7f376006dd90 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f3766196640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37600ced60 con 0x7f376015e7d0 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f3766196640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37600cf040 con 0x7f3760142da0 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f376006dd90 0x7f376013c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f376006dd90 0x7f376013c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37946/0 (socket says 172.21.15.6:37946) 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375f7fe640 1 -- 172.21.15.6:0/4089484335 learned_addr learned my addr 172.21.15.6:0/4089484335 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f3757fff640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3760142da0 0x7f37601580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375ffff640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376015e7d0 0x7f37600ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375f7fe640 1 -- 172.21.15.6:0/4089484335 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3760142da0 msgr2=0x7f37601580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375f7fe640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3760142da0 0x7f37601580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375f7fe640 1 -- 172.21.15.6:0/4089484335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376015e7d0 msgr2=0x7f37600ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375f7fe640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376015e7d0 0x7f37600ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375f7fe640 1 -- 172.21.15.6:0/4089484335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748009420 con 0x7f376006dd90 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375ffff640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376015e7d0 0x7f37600ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375f7fe640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f376006dd90 0x7f376013c790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f375000c4d0 tx=0x7f375000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375cff9640 1 -- 172.21.15.6:0/4089484335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750005cf0 con 0x7f376006dd90 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375cff9640 1 -- 172.21.15.6:0/4089484335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3750005e50 con 0x7f376006dd90 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37600cf320 con 0x7f376006dd90 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375cff9640 1 -- 172.21.15.6:0/4089484335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37500072b0 con 0x7f376006dd90 2023-11-28T21:08:39.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37600cf600 con 0x7f376006dd90 2023-11-28T21:08:39.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37600674d0 con 0x7f376006dd90 2023-11-28T21:08:39.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.867+0000 7f375cff9640 1 -- 172.21.15.6:0/4089484335 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3750007410 con 0x7f376006dd90 2023-11-28T21:08:39.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.871+0000 7f375cff9640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3740066470 0x7f3740068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:39.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.871+0000 7f375cff9640 1 -- 172.21.15.6:0/4089484335 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3750083540 con 0x7f376006dd90 2023-11-28T21:08:39.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.871+0000 7f3757fff640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3740066470 0x7f3740068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:39.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.871+0000 7f3757fff640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3740066470 0x7f3740068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37480af000 tx=0x7f37480a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:39.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:39.875+0000 7f375cff9640 1 -- 172.21.15.6:0/4089484335 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3750050940 con 0x7f376006dd90 2023-11-28T21:08:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.031+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37600b3010 con 0x7f376006dd90 2023-11-28T21:08:40.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f375cff9640 1 -- 172.21.15.6:0/4089484335 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f3750017090 con 0x7f376006dd90 2023-11-28T21:08:40.040 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:40.040 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:40.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3740066470 msgr2=0x7f3740068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3740066470 0x7f3740068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37480af000 tx=0x7f37480a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:40.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f376006dd90 msgr2=0x7f376013c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f376006dd90 0x7f376013c790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f375000c4d0 tx=0x7f375000c990 comp rx=0 tx=0).stop 2023-11-28T21:08:40.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 shutdown_connections 2023-11-28T21:08:40.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3740066470 0x7f3740068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f376015e7d0 0x7f37600ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3760142da0 0x7f37601580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 --2- 172.21.15.6:0/4089484335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f376006dd90 0x7f376013c790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 >> 172.21.15.6:0/4089484335 conn(0x7f376006ab80 msgr2=0x7f3760137340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:40.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 shutdown_connections 2023-11-28T21:08:40.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.035+0000 7f3766196640 1 -- 172.21.15.6:0/4089484335 wait complete. 2023-11-28T21:08:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:40.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:40.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3dead96640 1 Processor -- start 2023-11-28T21:08:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3dead96640 1 -- start start 2023-11-28T21:08:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3dead96640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de40cf940 0x7f3de40cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3dead96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3de4164fa0 0x7f3de4167390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3dead96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de40b4880 con 0x7f3de415d1c0 2023-11-28T21:08:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3dead96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de415d5a0 con 0x7f3de4164fa0 2023-11-28T21:08:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3dead96640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40d0300 con 0x7f3de40cf940 2023-11-28T21:08:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3de9d94640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3de415d1c0 0x7f3de4161600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46008/0 (socket says 172.21.15.6:46008) 2023-11-28T21:08:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3de9d94640 1 -- 172.21.15.6:0/213335362 learned_addr learned my addr 172.21.15.6:0/213335362 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.203+0000 7f3dea595640 1 --2- 172.21.15.6:0/213335362 >> v2:172.21.15.6:3300/0 conn(0x7f3de4164fa0 0x7f3de4167390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3de9593640 1 --2- 172.21.15.6:0/213335362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de40cf940 0x7f3de40cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dea595640 1 -- 172.21.15.6:0/213335362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de40cf940 msgr2=0x7f3de40cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dea595640 1 --2- 172.21.15.6:0/213335362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de40cf940 0x7f3de40cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dea595640 1 -- 172.21.15.6:0/213335362 >> v1:172.21.15.6:6789/0 conn(0x7f3de415d1c0 legacy=0x7f3de4161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dea595640 1 -- 172.21.15.6:0/213335362 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de40ceb50 con 0x7f3de4164fa0 2023-11-28T21:08:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3de8d92640 1 -- 172.21.15.6:0/213335362 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329937198 0 0) 0x7f3de0001120 con 0x7f3de415d1c0 2023-11-28T21:08:40.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dea595640 1 --2- 172.21.15.6:0/213335362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de4164fa0 0x7f3de4167390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009d90 tx=0x7f3ddc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288d40dc01078a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:40.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3de8d92640 1 -- 172.21.15.6:0/213335362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0a59e0 con 0x7f3de4164fa0 2023-11-28T21:08:40.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3de8d92640 1 -- 172.21.15.6:0/213335362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc0a5b40 con 0x7f3de4164fa0 2023-11-28T21:08:40.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3de8d92640 1 -- 172.21.15.6:0/213335362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0ad440 con 0x7f3de4164fa0 2023-11-28T21:08:40.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dead96640 1 -- 172.21.15.6:0/213335362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de4164fa0 msgr2=0x7f3de4167390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dead96640 1 --2- 172.21.15.6:0/213335362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de4164fa0 0x7f3de4167390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009d90 tx=0x7f3ddc01c920 comp rx=0 tx=0).stop 2023-11-28T21:08:40.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dead96640 1 -- 172.21.15.6:0/213335362 shutdown_connections 2023-11-28T21:08:40.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dead96640 1 --2- 172.21.15.6:0/213335362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de4164fa0 0x7f3de4167390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dead96640 1 --2- 172.21.15.6:0/213335362 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de40cf940 0x7f3de40cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.207+0000 7f3dead96640 1 -- 172.21.15.6:0/213335362 >> 172.21.15.6:0/213335362 conn(0x7f3de40d2f30 msgr2=0x7f3de40d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:40.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 -- 172.21.15.6:0/213335362 shutdown_connections 2023-11-28T21:08:40.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 -- 172.21.15.6:0/213335362 wait complete. 2023-11-28T21:08:40.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 Processor -- start 2023-11-28T21:08:40.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 -- start start 2023-11-28T21:08:40.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40cf940 0x7f3de415c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de415d1c0 0x7f3de4153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3de4164fa0 0x7f3de4154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40b0ec0 con 0x7f3de40cf940 2023-11-28T21:08:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de4153d90 con 0x7f3de4164fa0 2023-11-28T21:08:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40b8930 con 0x7f3de415d1c0 2023-11-28T21:08:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3de9d94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40cf940 0x7f3de415c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3de9d94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40cf940 0x7f3de415c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37964/0 (socket says 172.21.15.6:37964) 2023-11-28T21:08:40.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3de9d94640 1 -- 172.21.15.6:0/2542617917 learned_addr learned my addr 172.21.15.6:0/2542617917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:40.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3de9d94640 1 -- 172.21.15.6:0/2542617917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de415d1c0 msgr2=0x7f3de4153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3de9d94640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de415d1c0 0x7f3de4153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3de9d94640 1 -- 172.21.15.6:0/2542617917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3de4164fa0 msgr2=0x7f3de4154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3de9d94640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3de4164fa0 0x7f3de4154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3de9d94640 1 -- 172.21.15.6:0/2542617917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc009a70 con 0x7f3de40cf940 2023-11-28T21:08:40.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3de9d94640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40cf940 0x7f3de415c4d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c780 tx=0x7f3de000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:40.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dda7fc640 1 -- 172.21.15.6:0/2542617917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00072d0 con 0x7f3de40cf940 2023-11-28T21:08:40.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dda7fc640 1 -- 172.21.15.6:0/2542617917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0007450 con 0x7f3de40cf940 2023-11-28T21:08:40.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de40b5bc0 con 0x7f3de40cf940 2023-11-28T21:08:40.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.211+0000 7f3dda7fc640 1 -- 172.21.15.6:0/2542617917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00047f0 con 0x7f3de40cf940 2023-11-28T21:08:40.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.215+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de40b6180 con 0x7f3de40cf940 2023-11-28T21:08:40.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.215+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de4153f50 con 0x7f3de40cf940 2023-11-28T21:08:40.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.215+0000 7f3dda7fc640 1 -- 172.21.15.6:0/2542617917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3de0004950 con 0x7f3de40cf940 2023-11-28T21:08:40.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.215+0000 7f3dda7fc640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3dc8066470 0x7f3dc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.215+0000 7f3dda7fc640 1 -- 172.21.15.6:0/2542617917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3de00832d0 con 0x7f3de40cf940 2023-11-28T21:08:40.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.215+0000 7f3de9593640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3dc8066470 0x7f3dc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.215+0000 7f3de9593640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3dc8066470 0x7f3dc8068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3de40b23f0 tx=0x7f3dd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:40.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.219+0000 7f3dda7fc640 1 -- 172.21.15.6:0/2542617917 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3de00506b0 con 0x7f3de40cf940 2023-11-28T21:08:40.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.379+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3de40b4880 con 0x7f3de40cf940 2023-11-28T21:08:40.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.379+0000 7f3dda7fc640 1 -- 172.21.15.6:0/2542617917 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3de0018020 con 0x7f3de40cf940 2023-11-28T21:08:40.385 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.379+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3dc8066470 msgr2=0x7f3dc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.379+0000 7f3dead96640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3dc8066470 0x7f3dc8068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3de40b23f0 tx=0x7f3dd4008040 comp rx=0 tx=0).stop 2023-11-28T21:08:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.379+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40cf940 msgr2=0x7f3de415c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.379+0000 7f3dead96640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40cf940 0x7f3de415c4d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c780 tx=0x7f3de000cc40 comp rx=0 tx=0).stop 2023-11-28T21:08:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.383+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 shutdown_connections 2023-11-28T21:08:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.383+0000 7f3dead96640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3dc8066470 0x7f3dc8068930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.383+0000 7f3dead96640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3de4164fa0 0x7f3de4154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.383+0000 7f3dead96640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de415d1c0 0x7f3de4153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.383+0000 7f3dead96640 1 --2- 172.21.15.6:0/2542617917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40cf940 0x7f3de415c4d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.383+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 >> 172.21.15.6:0/2542617917 conn(0x7f3de40d2f30 msgr2=0x7f3de4155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:40.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.383+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 shutdown_connections 2023-11-28T21:08:40.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.383+0000 7f3dead96640 1 -- 172.21.15.6:0/2542617917 wait complete. 2023-11-28T21:08:40.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.547+0000 7f03f5116640 1 Processor -- start 2023-11-28T21:08:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.547+0000 7f03f5116640 1 -- start start 2023-11-28T21:08:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03f5116640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03f006ca00 0x7f03f00cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03f5116640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03f015c440 0x7f03f015ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03f5116640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00cc930 con 0x7f03f006cde0 2023-11-28T21:08:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03f5116640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00cd400 con 0x7f03f015c440 2023-11-28T21:08:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03f5116640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00ccb60 con 0x7f03f006ca00 2023-11-28T21:08:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03e7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f03f006cde0 0x7f03f015bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46024/0 (socket says 172.21.15.6:46024) 2023-11-28T21:08:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03e7fff640 1 -- 172.21.15.6:0/4191971785 learned_addr learned my addr 172.21.15.6:0/4191971785 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03ef59e640 1 --2- 172.21.15.6:0/4191971785 >> v2:172.21.15.6:3300/0 conn(0x7f03f015c440 0x7f03f015ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03eed9d640 1 --2- 172.21.15.6:0/4191971785 >> v2:172.21.15.31:3300/0 conn(0x7f03f006ca00 0x7f03f00cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03ee59c640 1 -- 172.21.15.6:0/4191971785 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106596443 0 0) 0x7f03f00cc930 con 0x7f03f006cde0 2023-11-28T21:08:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03ee59c640 1 -- 172.21.15.6:0/4191971785 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc003530 con 0x7f03f006cde0 2023-11-28T21:08:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03ef59e640 1 -- 172.21.15.6:0/4191971785 >> v2:172.21.15.31:3300/0 conn(0x7f03f006ca00 msgr2=0x7f03f00cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03ef59e640 1 --2- 172.21.15.6:0/4191971785 >> v2:172.21.15.31:3300/0 conn(0x7f03f006ca00 0x7f03f00cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03ef59e640 1 -- 172.21.15.6:0/4191971785 >> v1:172.21.15.6:6789/0 conn(0x7f03f006cde0 legacy=0x7f03f015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.551+0000 7f03ef59e640 1 -- 172.21.15.6:0/4191971785 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00cce40 con 0x7f03f015c440 2023-11-28T21:08:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03ef59e640 1 --2- 172.21.15.6:0/4191971785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f015c440 0x7f03f015ce40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009d90 tx=0x7f03e801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a4f5c29771e786 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03ee59c640 1 -- 172.21.15.6:0/4191971785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80a5910 con 0x7f03f015c440 2023-11-28T21:08:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03ee59c640 1 -- 172.21.15.6:0/4191971785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e80a5a70 con 0x7f03f015c440 2023-11-28T21:08:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03ee59c640 1 -- 172.21.15.6:0/4191971785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80a5e00 con 0x7f03f015c440 2023-11-28T21:08:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 -- 172.21.15.6:0/4191971785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f015c440 msgr2=0x7f03f015ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 --2- 172.21.15.6:0/4191971785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f015c440 0x7f03f015ce40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009d90 tx=0x7f03e801c850 comp rx=0 tx=0).stop 2023-11-28T21:08:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 -- 172.21.15.6:0/4191971785 shutdown_connections 2023-11-28T21:08:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 --2- 172.21.15.6:0/4191971785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f015c440 0x7f03f015ce40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 --2- 172.21.15.6:0/4191971785 >> v2:172.21.15.31:3300/0 conn(0x7f03f006ca00 0x7f03f00cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 -- 172.21.15.6:0/4191971785 >> 172.21.15.6:0/4191971785 conn(0x7f03f006a980 msgr2=0x7f03f006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 -- 172.21.15.6:0/4191971785 shutdown_connections 2023-11-28T21:08:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 -- 172.21.15.6:0/4191971785 wait complete. 2023-11-28T21:08:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 Processor -- start 2023-11-28T21:08:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.555+0000 7f03f5116640 1 -- start start 2023-11-28T21:08:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03f5116640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03f006ca00 0x7f03f0151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03f5116640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f006cde0 0x7f03f01640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03f5116640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f015c440 0x7f03f01f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03f5116640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0164b70 con 0x7f03f006cde0 2023-11-28T21:08:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03f5116640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01645f0 con 0x7f03f015c440 2023-11-28T21:08:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03f5116640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0164890 con 0x7f03f006ca00 2023-11-28T21:08:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f006cde0 0x7f03f01640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f006cde0 0x7f03f01640b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37988/0 (socket says 172.21.15.6:37988) 2023-11-28T21:08:40.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e7fff640 1 -- 172.21.15.6:0/4135527411 learned_addr learned my addr 172.21.15.6:0/4135527411 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03ef59e640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f015c440 0x7f03f01f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03eed9d640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03f006ca00 0x7f03f0151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e7fff640 1 -- 172.21.15.6:0/4135527411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03f006ca00 msgr2=0x7f03f0151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e7fff640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03f006ca00 0x7f03f0151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e7fff640 1 -- 172.21.15.6:0/4135527411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f015c440 msgr2=0x7f03f01f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e7fff640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f015c440 0x7f03f01f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e7fff640 1 -- 172.21.15.6:0/4135527411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8009a70 con 0x7f03f006cde0 2023-11-28T21:08:40.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03eed9d640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03f006ca00 0x7f03f0151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e7fff640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f006cde0 0x7f03f01640b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f03d800c4d0 tx=0x7f03d800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e77fe640 1 -- 172.21.15.6:0/4135527411 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8005cf0 con 0x7f03f006cde0 2023-11-28T21:08:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e77fe640 1 -- 172.21.15.6:0/4135527411 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8005e50 con 0x7f03f006cde0 2023-11-28T21:08:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f01f90f0 con 0x7f03f006cde0 2023-11-28T21:08:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e77fe640 1 -- 172.21.15.6:0/4135527411 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8007270 con 0x7f03f006cde0 2023-11-28T21:08:40.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f01f96b0 con 0x7f03f006cde0 2023-11-28T21:08:40.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f01f8f50 con 0x7f03f006cde0 2023-11-28T21:08:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.559+0000 7f03e77fe640 1 -- 172.21.15.6:0/4135527411 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f03d80073d0 con 0x7f03f006cde0 2023-11-28T21:08:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.563+0000 7f03e77fe640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f03d0066470 0x7f03d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.563+0000 7f03e77fe640 1 -- 172.21.15.6:0/4135527411 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03d8083470 con 0x7f03f006cde0 2023-11-28T21:08:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.563+0000 7f03eed9d640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f03d0066470 0x7f03d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.563+0000 7f03eed9d640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f03d0066470 0x7f03d0068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009bb0 tx=0x7f03e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:40.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.567+0000 7f03e77fe640 1 -- 172.21.15.6:0/4135527411 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f03f01f8f50 con 0x7f03f006cde0 2023-11-28T21:08:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.723+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f03f01f8f50 con 0x7f03f006cde0 2023-11-28T21:08:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.723+0000 7f03e77fe640 1 -- 172.21.15.6:0/4135527411 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03f01f8f50 con 0x7f03f006cde0 2023-11-28T21:08:40.731 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f03d0066470 msgr2=0x7f03d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f03d0066470 0x7f03d0068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009bb0 tx=0x7f03e0008040 comp rx=0 tx=0).stop 2023-11-28T21:08:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f006cde0 msgr2=0x7f03f01640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f006cde0 0x7f03f01640b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f03d800c4d0 tx=0x7f03d800c990 comp rx=0 tx=0).stop 2023-11-28T21:08:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 shutdown_connections 2023-11-28T21:08:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f03d0066470 0x7f03d0068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f015c440 0x7f03f01f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03f006cde0 0x7f03f01640b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 --2- 172.21.15.6:0/4135527411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f03f006ca00 0x7f03f0151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 >> 172.21.15.6:0/4135527411 conn(0x7f03f006a980 msgr2=0x7f03f015bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 shutdown_connections 2023-11-28T21:08:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.727+0000 7f03f5116640 1 -- 172.21.15.6:0/4135527411 wait complete. 2023-11-28T21:08:40.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.891+0000 7f211a557640 1 Processor -- start 2023-11-28T21:08:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.891+0000 7f211a557640 1 -- start start 2023-11-28T21:08:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f211a557640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f211415fcf0 0x7f21140d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f211a557640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21140cea30 con 0x7f21140b31c0 2023-11-28T21:08:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f211a557640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21140b2430 con 0x7f21140ceec0 2023-11-28T21:08:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f211a557640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21140d3ef0 con 0x7f211415fcf0 2023-11-28T21:08:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2118af4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f21140b31c0 0x7f21141600d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46032/0 (socket says 172.21.15.6:46032) 2023-11-28T21:08:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2118af4640 1 -- 172.21.15.6:0/3561326851 learned_addr learned my addr 172.21.15.6:0/3561326851 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2113fff640 1 --2- 172.21.15.6:0/3561326851 >> v2:172.21.15.31:3300/0 conn(0x7f211415fcf0 0x7f21140d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302402000 0 0) 0x7f21140cea30 con 0x7f21140b31c0 2023-11-28T21:08:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20fc003530 con 0x7f21140b31c0 2023-11-28T21:08:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 177977636 0 0) 0x7f20fc003530 con 0x7f21140b31c0 2023-11-28T21:08:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 >> v2:172.21.15.31:3300/0 conn(0x7f211415fcf0 msgr2=0x7f21140d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 --2- 172.21.15.6:0/3561326851 >> v2:172.21.15.31:3300/0 conn(0x7f211415fcf0 0x7f21140d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 >> v1:172.21.15.31:6789/0 conn(0x7f21140ceec0 legacy=0x7f21140b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140d1c00 con 0x7f21140b31c0 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f210c001a00 con 0x7f21140b31c0 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 >> v1:172.21.15.6:6789/0 conn(0x7f21140b31c0 legacy=0x7f21141600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20fc0039d0 0x7f20fc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0047d0 0x7f20fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0051e0 0x7f20fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21140d3ef0 con 0x7f20fc0039d0 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc00c130 con 0x7f20fc0051e0 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc00c2f0 con 0x7f20fc0047d0 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2113fff640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20fc0039d0 0x7f20fc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2118af4640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0051e0 0x7f20fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f21137fe640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0047d0 0x7f20fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2113fff640 1 -- 172.21.15.6:0/3561326851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0047d0 msgr2=0x7f20fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:40.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2113fff640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0047d0 0x7f20fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2113fff640 1 -- 172.21.15.6:0/3561326851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0051e0 msgr2=0x7f20fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:40.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2113fff640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20fc0051e0 0x7f20fc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2113fff640 1 -- 172.21.15.6:0/3561326851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc003530 con 0x7f20fc0039d0 2023-11-28T21:08:40.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f2118af4640 1 -- 172.21.15.6:0/3561326851 reap_dead start 2023-11-28T21:08:40.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.895+0000 7f21137fe640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0047d0 0x7f20fc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:40.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f2113fff640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20fc0039d0 0x7f20fc003df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2104009ab0 tx=0x7f210401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283361bde9dfaad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:40.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040a64d0 con 0x7f20fc0039d0 2023-11-28T21:08:40.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21040a6630 con 0x7f20fc0039d0 2023-11-28T21:08:40.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f2112ffd640 1 -- 172.21.15.6:0/3561326851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040a69e0 con 0x7f20fc0039d0 2023-11-28T21:08:40.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f211a557640 1 -- 172.21.15.6:0/3561326851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20fc0039d0 msgr2=0x7f20fc003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f211a557640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20fc0039d0 0x7f20fc003df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2104009ab0 tx=0x7f210401c9e0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f211a557640 1 -- 172.21.15.6:0/3561326851 shutdown_connections 2023-11-28T21:08:40.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f211a557640 1 --2- 172.21.15.6:0/3561326851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20fc0039d0 0x7f20fc003df0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f211a557640 1 -- 172.21.15.6:0/3561326851 >> 172.21.15.6:0/3561326851 conn(0x7f211409c480 msgr2=0x7f21140d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:40.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f211a557640 1 -- 172.21.15.6:0/3561326851 shutdown_connections 2023-11-28T21:08:40.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.899+0000 7f211a557640 1 -- 172.21.15.6:0/3561326851 wait complete. 2023-11-28T21:08:40.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 Processor -- start 2023-11-28T21:08:40.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 -- start start 2023-11-28T21:08:40.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0039d0 0x7f211415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21140ccaa0 0x7f21140ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211409eb60 0x7f211409efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21140b8490 con 0x7f21140ccaa0 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21140cd460 con 0x7f211409eb60 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21140b7810 con 0x7f20fc0039d0 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f21137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21140ccaa0 0x7f21140ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f21137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21140ccaa0 0x7f21140ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38000/0 (socket says 172.21.15.6:38000) 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f21137fe640 1 -- 172.21.15.6:0/816085772 learned_addr learned my addr 172.21.15.6:0/816085772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f2113fff640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0039d0 0x7f211415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f2118af4640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211409eb60 0x7f211409efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f21137fe640 1 -- 172.21.15.6:0/816085772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0039d0 msgr2=0x7f211415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f21137fe640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0039d0 0x7f211415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f21137fe640 1 -- 172.21.15.6:0/816085772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211409eb60 msgr2=0x7f211409efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f21137fe640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211409eb60 0x7f211409efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f21137fe640 1 -- 172.21.15.6:0/816085772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140b7af0 con 0x7f21140ccaa0 2023-11-28T21:08:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f21137fe640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21140ccaa0 0x7f21140ccf20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2108000c10 tx=0x7f210800e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f2110ff9640 1 -- 172.21.15.6:0/816085772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080052e0 con 0x7f21140ccaa0 2023-11-28T21:08:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f2110ff9640 1 -- 172.21.15.6:0/816085772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2108005440 con 0x7f21140ccaa0 2023-11-28T21:08:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f2110ff9640 1 -- 172.21.15.6:0/816085772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108003840 con 0x7f21140ccaa0 2023-11-28T21:08:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21140b7dd0 con 0x7f21140ccaa0 2023-11-28T21:08:40.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211415c860 con 0x7f21140ccaa0 2023-11-28T21:08:40.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.903+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21140a1160 con 0x7f21140ccaa0 2023-11-28T21:08:40.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.907+0000 7f2110ff9640 1 -- 172.21.15.6:0/816085772 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f21080039a0 con 0x7f21140ccaa0 2023-11-28T21:08:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.907+0000 7f2110ff9640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21000664a0 0x7f2100068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.907+0000 7f2110ff9640 1 -- 172.21.15.6:0/816085772 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2108083590 con 0x7f21140ccaa0 2023-11-28T21:08:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.907+0000 7f2113fff640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21000664a0 0x7f2100068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.907+0000 7f2113fff640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21000664a0 0x7f2100068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21040af000 tx=0x7f21040046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:40.911+0000 7f2110ff9640 1 -- 172.21.15.6:0/816085772 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2108050a20 con 0x7f21140ccaa0 2023-11-28T21:08:41.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.067+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21140b15e0 con 0x7f21140ccaa0 2023-11-28T21:08:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.067+0000 7f2110ff9640 1 -- 172.21.15.6:0/816085772 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2108054040 con 0x7f21140ccaa0 2023-11-28T21:08:41.076 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21000664a0 msgr2=0x7f2100068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21000664a0 0x7f2100068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21040af000 tx=0x7f21040046d0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21140ccaa0 msgr2=0x7f21140ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21140ccaa0 0x7f21140ccf20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2108000c10 tx=0x7f210800e850 comp rx=0 tx=0).stop 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 shutdown_connections 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21000664a0 0x7f2100068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f211409eb60 0x7f211409efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21140ccaa0 0x7f21140ccf20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 --2- 172.21.15.6:0/816085772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20fc0039d0 0x7f211415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 >> 172.21.15.6:0/816085772 conn(0x7f211409c480 msgr2=0x7f211415ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 shutdown_connections 2023-11-28T21:08:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.071+0000 7f211a557640 1 -- 172.21.15.6:0/816085772 wait complete. 2023-11-28T21:08:41.121 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-28T21:08:41.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:41.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc78bb57640 1 Processor -- start 2023-11-28T21:08:41.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc78bb57640 1 -- start start 2023-11-28T21:08:41.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc78bb57640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc78413e090 0x7fc7840cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc78bb57640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc784140e90 0x7fc78406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc78bb57640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7840cea50 con 0x7fc78415c250 2023-11-28T21:08:41.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc78bb57640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78413e470 con 0x7fc78413e090 2023-11-28T21:08:41.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc78bb57640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840ce1b0 con 0x7fc784140e90 2023-11-28T21:08:41.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc7890f2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc78415c250 0x7fc784140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46046/0 (socket says 172.21.15.6:46046) 2023-11-28T21:08:41.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc7890f2640 1 -- 172.21.15.6:0/710518099 learned_addr learned my addr 172.21.15.6:0/710518099 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:41.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc7898f3640 1 --2- 172.21.15.6:0/710518099 >> v2:172.21.15.31:3300/0 conn(0x7fc78413e090 0x7fc7840cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc78a0f4640 1 --2- 172.21.15.6:0/710518099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc784140e90 0x7fc78406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc7888f1640 1 -- 172.21.15.6:0/710518099 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805740092 0 0) 0x7fc7840cea50 con 0x7fc78415c250 2023-11-28T21:08:41.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc7888f1640 1 -- 172.21.15.6:0/710518099 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc770003530 con 0x7fc78415c250 2023-11-28T21:08:41.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc7898f3640 1 -- 172.21.15.6:0/710518099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc784140e90 msgr2=0x7fc78406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:41.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc7898f3640 1 --2- 172.21.15.6:0/710518099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc784140e90 0x7fc78406cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc7898f3640 1 -- 172.21.15.6:0/710518099 >> v1:172.21.15.6:6789/0 conn(0x7fc78415c250 legacy=0x7fc784140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.259+0000 7fc7898f3640 1 -- 172.21.15.6:0/710518099 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840ce490 con 0x7fc78413e090 2023-11-28T21:08:41.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc7898f3640 1 --2- 172.21.15.6:0/710518099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78413e090 0x7fc7840cd740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7800097c0 tx=0x7fc78001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7d3642cef96b06 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:41.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc7888f1640 1 -- 172.21.15.6:0/710518099 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7800ac620 con 0x7fc78413e090 2023-11-28T21:08:41.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc7888f1640 1 -- 172.21.15.6:0/710518099 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7800ac780 con 0x7fc78413e090 2023-11-28T21:08:41.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc7888f1640 1 -- 172.21.15.6:0/710518099 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7800acb10 con 0x7fc78413e090 2023-11-28T21:08:41.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc78bb57640 1 -- 172.21.15.6:0/710518099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78413e090 msgr2=0x7fc7840cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc78bb57640 1 --2- 172.21.15.6:0/710518099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78413e090 0x7fc7840cd740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7800097c0 tx=0x7fc78001c3c0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc78bb57640 1 -- 172.21.15.6:0/710518099 shutdown_connections 2023-11-28T21:08:41.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc78bb57640 1 --2- 172.21.15.6:0/710518099 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc784140e90 0x7fc78406cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc78bb57640 1 --2- 172.21.15.6:0/710518099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78413e090 0x7fc7840cd740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc78bb57640 1 -- 172.21.15.6:0/710518099 >> 172.21.15.6:0/710518099 conn(0x7fc78406ab80 msgr2=0x7fc7840b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:41.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc78bb57640 1 -- 172.21.15.6:0/710518099 shutdown_connections 2023-11-28T21:08:41.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.263+0000 7fc78bb57640 1 -- 172.21.15.6:0/710518099 wait complete. 2023-11-28T21:08:41.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 Processor -- start 2023-11-28T21:08:41.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 -- start start 2023-11-28T21:08:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78413e090 0x7fc784155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc784140e90 0x7fc784154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78415c250 0x7fc7841f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841f6720 con 0x7fc784140e90 2023-11-28T21:08:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841f5aa0 con 0x7fc78415c250 2023-11-28T21:08:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841f5d80 con 0x7fc78413e090 2023-11-28T21:08:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7890f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc784140e90 0x7fc784154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7890f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc784140e90 0x7fc784154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38006/0 (socket says 172.21.15.6:38006) 2023-11-28T21:08:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7890f2640 1 -- 172.21.15.6:0/735021176 learned_addr learned my addr 172.21.15.6:0/735021176 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7890f2640 1 -- 172.21.15.6:0/735021176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78413e090 msgr2=0x7fc784155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78a0f4640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78415c250 0x7fc7841f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7898f3640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78413e090 0x7fc784155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7890f2640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78413e090 0x7fc784155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7890f2640 1 -- 172.21.15.6:0/735021176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78415c250 msgr2=0x7fc7841f6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7890f2640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78415c250 0x7fc7841f6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7890f2640 1 -- 172.21.15.6:0/735021176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780009420 con 0x7fc784140e90 2023-11-28T21:08:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78a0f4640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78415c250 0x7fc7841f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:41.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc7890f2640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc784140e90 0x7fc784154000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc774001ec0 tx=0x7fc77400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc77a7fc640 1 -- 172.21.15.6:0/735021176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774005d50 con 0x7fc784140e90 2023-11-28T21:08:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc77a7fc640 1 -- 172.21.15.6:0/735021176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774007070 con 0x7fc784140e90 2023-11-28T21:08:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc77a7fc640 1 -- 172.21.15.6:0/735021176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774007420 con 0x7fc784140e90 2023-11-28T21:08:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7841f6060 con 0x7fc784140e90 2023-11-28T21:08:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.267+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc784156180 con 0x7fc784140e90 2023-11-28T21:08:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.271+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7841f6860 con 0x7fc784140e90 2023-11-28T21:08:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.271+0000 7fc77a7fc640 1 -- 172.21.15.6:0/735021176 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc774007580 con 0x7fc784140e90 2023-11-28T21:08:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.271+0000 7fc77a7fc640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc768066470 0x7fc768068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.271+0000 7fc77a7fc640 1 -- 172.21.15.6:0/735021176 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc774082fb0 con 0x7fc784140e90 2023-11-28T21:08:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.271+0000 7fc7898f3640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc768066470 0x7fc768068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.271+0000 7fc7898f3640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc768066470 0x7fc768068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc7800ae000 tx=0x7fc780008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:41.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.275+0000 7fc77a7fc640 1 -- 172.21.15.6:0/735021176 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7841f6860 con 0x7fc784140e90 2023-11-28T21:08:41.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7841f6860 con 0x7fc784140e90 2023-11-28T21:08:41.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc77a7fc640 1 -- 172.21.15.6:0/735021176 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fc7841f6860 con 0x7fc784140e90 2023-11-28T21:08:41.445 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:41.445 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:41.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc768066470 msgr2=0x7fc768068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc768066470 0x7fc768068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc7800ae000 tx=0x7fc780008040 comp rx=0 tx=0).stop 2023-11-28T21:08:41.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc784140e90 msgr2=0x7fc784154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc784140e90 0x7fc784154000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc774001ec0 tx=0x7fc77400c960 comp rx=0 tx=0).stop 2023-11-28T21:08:41.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 shutdown_connections 2023-11-28T21:08:41.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc768066470 0x7fc768068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc78415c250 0x7fc7841f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc784140e90 0x7fc784154000 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 --2- 172.21.15.6:0/735021176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc78413e090 0x7fc784155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 >> 172.21.15.6:0/735021176 conn(0x7fc78406ab80 msgr2=0x7fc7841406e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:41.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 shutdown_connections 2023-11-28T21:08:41.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.439+0000 7fc78bb57640 1 -- 172.21.15.6:0/735021176 wait complete. 2023-11-28T21:08:41.466 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:41.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe87bedd640 1 Processor -- start 2023-11-28T21:08:41.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe87bedd640 1 -- start start 2023-11-28T21:08:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe87bedd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8740ceef0 0x7fe8740733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe87bedd640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87415d3e0 con 0x7fe87406dba0 2023-11-28T21:08:41.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe87bedd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87415d6c0 con 0x7fe87406a580 2023-11-28T21:08:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe87bedd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87415d1d0 con 0x7fe8740ceef0 2023-11-28T21:08:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe87a47a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe87406dba0 0x7fe87406dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46056/0 (socket says 172.21.15.6:46056) 2023-11-28T21:08:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe87a47a640 1 -- 172.21.15.6:0/2740655344 learned_addr learned my addr 172.21.15.6:0/2740655344 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe879478640 1 --2- 172.21.15.6:0/2740655344 >> v2:172.21.15.31:3300/0 conn(0x7fe8740ceef0 0x7fe8740733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe878c77640 1 -- 172.21.15.6:0/2740655344 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678970241 0 0) 0x7fe87415d3e0 con 0x7fe87406dba0 2023-11-28T21:08:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.607+0000 7fe878c77640 1 -- 172.21.15.6:0/2740655344 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe860003530 con 0x7fe87406dba0 2023-11-28T21:08:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe879478640 1 -- 172.21.15.6:0/2740655344 >> v1:172.21.15.31:6789/0 conn(0x7fe87406a580 legacy=0x7fe874159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe879478640 1 -- 172.21.15.6:0/2740655344 >> v1:172.21.15.6:6789/0 conn(0x7fe87406dba0 legacy=0x7fe87406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe879478640 1 -- 172.21.15.6:0/2740655344 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87415d9a0 con 0x7fe8740ceef0 2023-11-28T21:08:41.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe879478640 1 --2- 172.21.15.6:0/2740655344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 0x7fe8740733f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8640097c0 tx=0x7fe86401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b5d97a1eda77134 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe878c77640 1 -- 172.21.15.6:0/2740655344 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8640ab650 con 0x7fe8740ceef0 2023-11-28T21:08:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe878c77640 1 -- 172.21.15.6:0/2740655344 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8640ab7b0 con 0x7fe8740ceef0 2023-11-28T21:08:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe878c77640 1 -- 172.21.15.6:0/2740655344 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8640abb40 con 0x7fe8740ceef0 2023-11-28T21:08:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe87bedd640 1 -- 172.21.15.6:0/2740655344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 msgr2=0x7fe8740733f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe87bedd640 1 --2- 172.21.15.6:0/2740655344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 0x7fe8740733f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8640097c0 tx=0x7fe86401c450 comp rx=0 tx=0).stop 2023-11-28T21:08:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe87bedd640 1 -- 172.21.15.6:0/2740655344 shutdown_connections 2023-11-28T21:08:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe87bedd640 1 --2- 172.21.15.6:0/2740655344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 0x7fe8740733f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.611+0000 7fe87bedd640 1 -- 172.21.15.6:0/2740655344 >> 172.21.15.6:0/2740655344 conn(0x7fe8740b1670 msgr2=0x7fe8740b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 -- 172.21.15.6:0/2740655344 shutdown_connections 2023-11-28T21:08:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 -- 172.21.15.6:0/2740655344 wait complete. 2023-11-28T21:08:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 Processor -- start 2023-11-28T21:08:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 -- start start 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87406a580 0x7fe8741511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe87406dba0 0x7fe8741537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 0x7fe8740acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe874157830 con 0x7fe87406a580 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe874156c20 con 0x7fe8740ceef0 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87bedd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe874156f00 con 0x7fe87406dba0 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879c79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87406a580 0x7fe8741511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879c79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87406a580 0x7fe8741511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38008/0 (socket says 172.21.15.6:38008) 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879c79640 1 -- 172.21.15.6:0/2697763084 learned_addr learned my addr 172.21.15.6:0/2697763084 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879478640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe87406dba0 0x7fe8741537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87a47a640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 0x7fe8740acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879c79640 1 -- 172.21.15.6:0/2697763084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe87406dba0 msgr2=0x7fe8741537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879c79640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe87406dba0 0x7fe8741537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879c79640 1 -- 172.21.15.6:0/2697763084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 msgr2=0x7fe8740acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879c79640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 0x7fe8740acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879c79640 1 -- 172.21.15.6:0/2697763084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe864009420 con 0x7fe87406a580 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe87a47a640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 0x7fe8740acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe879c79640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87406a580 0x7fe8741511e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c3c0 tx=0x7fe87000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe86a7fc640 1 -- 172.21.15.6:0/2697763084 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8700052d0 con 0x7fe87406a580 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe86a7fc640 1 -- 172.21.15.6:0/2697763084 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870005430 con 0x7fe87406a580 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.615+0000 7fe86a7fc640 1 -- 172.21.15.6:0/2697763084 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870003840 con 0x7fe87406a580 2023-11-28T21:08:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.619+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8741571e0 con 0x7fe87406a580 2023-11-28T21:08:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.619+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe874151720 con 0x7fe87406a580 2023-11-28T21:08:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.619+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8740727d0 con 0x7fe87406a580 2023-11-28T21:08:41.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.619+0000 7fe86a7fc640 1 -- 172.21.15.6:0/2697763084 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8700039a0 con 0x7fe87406a580 2023-11-28T21:08:41.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.619+0000 7fe86a7fc640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe858066470 0x7fe858068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.619+0000 7fe86a7fc640 1 -- 172.21.15.6:0/2697763084 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe870083390 con 0x7fe87406a580 2023-11-28T21:08:41.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.619+0000 7fe879478640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe858066470 0x7fe858068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.623+0000 7fe879478640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe858066470 0x7fe858068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8640af000 tx=0x7fe8640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:41.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.623+0000 7fe86a7fc640 1 -- 172.21.15.6:0/2697763084 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe870050820 con 0x7fe87406a580 2023-11-28T21:08:41.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe87404e930 con 0x7fe87406a580 2023-11-28T21:08:41.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe86a7fc640 1 -- 172.21.15.6:0/2697763084 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe870053e40 con 0x7fe87406a580 2023-11-28T21:08:41.788 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:41.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe858066470 msgr2=0x7fe858068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe858066470 0x7fe858068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8640af000 tx=0x7fe8640a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87406a580 msgr2=0x7fe8741511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87406a580 0x7fe8741511e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c3c0 tx=0x7fe87000c880 comp rx=0 tx=0).stop 2023-11-28T21:08:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 shutdown_connections 2023-11-28T21:08:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe858066470 0x7fe858068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8740ceef0 0x7fe8740acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe87406dba0 0x7fe8741537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 --2- 172.21.15.6:0/2697763084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87406a580 0x7fe8741511e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 >> 172.21.15.6:0/2697763084 conn(0x7fe8740b1670 msgr2=0x7fe874156260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:41.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 shutdown_connections 2023-11-28T21:08:41.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.783+0000 7fe87bedd640 1 -- 172.21.15.6:0/2697763084 wait complete. 2023-11-28T21:08:41.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.951+0000 7f16bfc17640 1 Processor -- start 2023-11-28T21:08:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.951+0000 7f16bfc17640 1 -- start start 2023-11-28T21:08:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.951+0000 7f16bfc17640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16b815e370 0x7f16b80ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.951+0000 7f16bfc17640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16b80cbf40 0x7f16b815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.951+0000 7f16bfc17640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b815b510 con 0x7f16b815e750 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.951+0000 7f16bfc17640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b80cd730 con 0x7f16b80cbf40 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.951+0000 7f16bfc17640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b813d450 con 0x7f16b815e370 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.951+0000 7f16be1b4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16b80cbf40 0x7f16b815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16be1b4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16b80cbf40 0x7f16b815a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38010/0 (socket says 172.21.15.6:38010) 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16be1b4640 1 -- 172.21.15.6:0/3330049606 learned_addr learned my addr 172.21.15.6:0/3330049606 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16bd1b2640 1 --1- 172.21.15.6:0/3330049606 >> v1:172.21.15.6:6789/0 conn(0x7f16b815e750 0x7f16b80cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46058/0 (socket says 172.21.15.6:46058) 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16bd9b3640 1 --2- 172.21.15.6:0/3330049606 >> v2:172.21.15.31:3300/0 conn(0x7f16b815e370 0x7f16b80ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16be1b4640 1 -- 172.21.15.6:0/3330049606 >> v2:172.21.15.31:3300/0 conn(0x7f16b815e370 msgr2=0x7f16b80ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16be1b4640 1 --2- 172.21.15.6:0/3330049606 >> v2:172.21.15.31:3300/0 conn(0x7f16b815e370 0x7f16b80ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16be1b4640 1 -- 172.21.15.6:0/3330049606 >> v1:172.21.15.6:6789/0 conn(0x7f16b815e750 legacy=0x7f16b80cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16be1b4640 1 -- 172.21.15.6:0/3330049606 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80cd940 con 0x7f16b80cbf40 2023-11-28T21:08:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16bc9b1640 1 -- 172.21.15.6:0/3330049606 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133712228 0 0) 0x7f16b815b510 con 0x7f16b815e750 2023-11-28T21:08:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16be1b4640 1 --2- 172.21.15.6:0/3330049606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b80cbf40 0x7f16b815a7e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f16b806c9d0 tx=0x7f16b001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59807f6aa0827cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16bc9b1640 1 -- 172.21.15.6:0/3330049606 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b00a5780 con 0x7f16b80cbf40 2023-11-28T21:08:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16bc9b1640 1 -- 172.21.15.6:0/3330049606 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b00a58e0 con 0x7f16b80cbf40 2023-11-28T21:08:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.955+0000 7f16bc9b1640 1 -- 172.21.15.6:0/3330049606 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b00a5c70 con 0x7f16b80cbf40 2023-11-28T21:08:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 -- 172.21.15.6:0/3330049606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b80cbf40 msgr2=0x7f16b815a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 --2- 172.21.15.6:0/3330049606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b80cbf40 0x7f16b815a7e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f16b806c9d0 tx=0x7f16b001c9d0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 -- 172.21.15.6:0/3330049606 shutdown_connections 2023-11-28T21:08:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 --2- 172.21.15.6:0/3330049606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b80cbf40 0x7f16b815a7e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 --2- 172.21.15.6:0/3330049606 >> v2:172.21.15.31:3300/0 conn(0x7f16b815e370 0x7f16b80ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 -- 172.21.15.6:0/3330049606 >> 172.21.15.6:0/3330049606 conn(0x7f16b806a980 msgr2=0x7f16b806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:41.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 -- 172.21.15.6:0/3330049606 shutdown_connections 2023-11-28T21:08:41.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 -- 172.21.15.6:0/3330049606 wait complete. 2023-11-28T21:08:41.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 Processor -- start 2023-11-28T21:08:41.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 -- start start 2023-11-28T21:08:41.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80cbf40 0x7f16b8139f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b815e370 0x7f16b80af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b815e750 0x7f16b813ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b80b09d0 con 0x7f16b815e370 2023-11-28T21:08:41.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b80af930 con 0x7f16b815e750 2023-11-28T21:08:41.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bfc17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b80afc10 con 0x7f16b80cbf40 2023-11-28T21:08:41.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bd1b2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b815e370 0x7f16b80af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bd1b2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b815e370 0x7f16b80af0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38016/0 (socket says 172.21.15.6:38016) 2023-11-28T21:08:41.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bd1b2640 1 -- 172.21.15.6:0/430049687 learned_addr learned my addr 172.21.15.6:0/430049687 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:41.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bd9b3640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80cbf40 0x7f16b8139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16be1b4640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b815e750 0x7f16b813ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bd1b2640 1 -- 172.21.15.6:0/430049687 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80cbf40 msgr2=0x7f16b8139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bd1b2640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80cbf40 0x7f16b8139f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bd1b2640 1 -- 172.21.15.6:0/430049687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b815e750 msgr2=0x7f16b813ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bd1b2640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b815e750 0x7f16b813ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.959+0000 7f16bd1b2640 1 -- 172.21.15.6:0/430049687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b0009b30 con 0x7f16b815e370 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16bd1b2640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b815e370 0x7f16b80af0e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c480 tx=0x7f16a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16ae7fc640 1 -- 172.21.15.6:0/430049687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a80074e0 con 0x7f16b815e370 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16ae7fc640 1 -- 172.21.15.6:0/430049687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8007660 con 0x7f16b815e370 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b80afef0 con 0x7f16b815e370 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16ae7fc640 1 -- 172.21.15.6:0/430049687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8004a30 con 0x7f16b815e370 2023-11-28T21:08:41.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b80b04b0 con 0x7f16b815e370 2023-11-28T21:08:41.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b8072b90 con 0x7f16b815e370 2023-11-28T21:08:41.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16ae7fc640 1 -- 172.21.15.6:0/430049687 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16a8004b90 con 0x7f16b815e370 2023-11-28T21:08:41.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16ae7fc640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f169c066470 0x7f169c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:41.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16ae7fc640 1 -- 172.21.15.6:0/430049687 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16a8082fe0 con 0x7f16b815e370 2023-11-28T21:08:41.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.963+0000 7f16bd9b3640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f169c066470 0x7f169c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:41.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.967+0000 7f16bd9b3640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f169c066470 0x7f169c068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009b60 tx=0x7f16b4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:41.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:41.967+0000 7f16ae7fc640 1 -- 172.21.15.6:0/430049687 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f16a80504b0 con 0x7f16b815e370 2023-11-28T21:08:42.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16b804e930 con 0x7f16b815e370 2023-11-28T21:08:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16ae7fc640 1 -- 172.21.15.6:0/430049687 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16a8053ad0 con 0x7f16b815e370 2023-11-28T21:08:42.133 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f169c066470 msgr2=0x7f169c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f169c066470 0x7f169c068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009b60 tx=0x7f16b4009190 comp rx=0 tx=0).stop 2023-11-28T21:08:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b815e370 msgr2=0x7f16b80af0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b815e370 0x7f16b80af0e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c480 tx=0x7f16a800c940 comp rx=0 tx=0).stop 2023-11-28T21:08:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 shutdown_connections 2023-11-28T21:08:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f169c066470 0x7f169c068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16b815e750 0x7f16b813ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16b815e370 0x7f16b80af0e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 --2- 172.21.15.6:0/430049687 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16b80cbf40 0x7f16b8139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.127+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 >> 172.21.15.6:0/430049687 conn(0x7f16b806a980 msgr2=0x7f16b80b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.131+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 shutdown_connections 2023-11-28T21:08:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.131+0000 7f16bfc17640 1 -- 172.21.15.6:0/430049687 wait complete. 2023-11-28T21:08:42.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.295+0000 7f21c2d2a640 1 Processor -- start 2023-11-28T21:08:42.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21c2d2a640 1 -- start start 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21c2d2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc06ca00 0x7f21bc0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21c2d2a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21bc06cde0 0x7f21bc15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21c2d2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f21bc15c270 0x7f21bc15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21c2d2a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc0cd400 con 0x7f21bc06cde0 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21c2d2a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc15c700 con 0x7f21bc15c270 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21c2d2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0cc930 con 0x7f21bc06ca00 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21bbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21bc06cde0 0x7f21bc15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21bbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f21bc06cde0 0x7f21bc15bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38026/0 (socket says 172.21.15.6:38026) 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21bbfff640 1 -- 172.21.15.6:0/2123365625 learned_addr learned my addr 172.21.15.6:0/2123365625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:42.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21c12c7640 1 --2- 172.21.15.6:0/2123365625 >> v2:172.21.15.31:3300/0 conn(0x7f21bc15c270 0x7f21bc15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21c0ac6640 1 --2- 172.21.15.6:0/2123365625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc06ca00 0x7f21bc0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21bbfff640 1 -- 172.21.15.6:0/2123365625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc06ca00 msgr2=0x7f21bc0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21bbfff640 1 --2- 172.21.15.6:0/2123365625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc06ca00 0x7f21bc0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21bbfff640 1 -- 172.21.15.6:0/2123365625 >> v2:172.21.15.31:3300/0 conn(0x7f21bc15c270 msgr2=0x7f21bc15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21bbfff640 1 --2- 172.21.15.6:0/2123365625 >> v2:172.21.15.31:3300/0 conn(0x7f21bc15c270 0x7f21bc15eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.299+0000 7f21bbfff640 1 -- 172.21.15.6:0/2123365625 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0ccb60 con 0x7f21bc06cde0 2023-11-28T21:08:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21bbfff640 1 --2- 172.21.15.6:0/2123365625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06cde0 0x7f21bc15bd30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21bc06e680 tx=0x7f21a801c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1212d7aaddf97ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21bb7fe640 1 -- 172.21.15.6:0/2123365625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80ab600 con 0x7f21bc06cde0 2023-11-28T21:08:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21bb7fe640 1 -- 172.21.15.6:0/2123365625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a80a7050 con 0x7f21bc06cde0 2023-11-28T21:08:42.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21bb7fe640 1 -- 172.21.15.6:0/2123365625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80ab980 con 0x7f21bc06cde0 2023-11-28T21:08:42.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 -- 172.21.15.6:0/2123365625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06cde0 msgr2=0x7f21bc15bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/2123365625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06cde0 0x7f21bc15bd30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21bc06e680 tx=0x7f21a801c180 comp rx=0 tx=0).stop 2023-11-28T21:08:42.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 -- 172.21.15.6:0/2123365625 shutdown_connections 2023-11-28T21:08:42.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/2123365625 >> v2:172.21.15.31:3300/0 conn(0x7f21bc15c270 0x7f21bc15eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/2123365625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06cde0 0x7f21bc15bd30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/2123365625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc06ca00 0x7f21bc0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 -- 172.21.15.6:0/2123365625 >> 172.21.15.6:0/2123365625 conn(0x7f21bc06a980 msgr2=0x7f21bc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:42.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 -- 172.21.15.6:0/2123365625 shutdown_connections 2023-11-28T21:08:42.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 -- 172.21.15.6:0/2123365625 wait complete. 2023-11-28T21:08:42.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 Processor -- start 2023-11-28T21:08:42.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.303+0000 7f21c2d2a640 1 -- start start 2023-11-28T21:08:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c2d2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06ca00 0x7f21bc150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c2d2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc06cde0 0x7f21bc0b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c2d2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc15c270 0x7f21bc144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c2d2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0b4400 con 0x7f21bc06ca00 2023-11-28T21:08:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c2d2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0b3880 con 0x7f21bc06cde0 2023-11-28T21:08:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c2d2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0b3b60 con 0x7f21bc15c270 2023-11-28T21:08:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c0ac6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06ca00 0x7f21bc150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c0ac6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06ca00 0x7f21bc150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38040/0 (socket says 172.21.15.6:38040) 2023-11-28T21:08:42.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c0ac6640 1 -- 172.21.15.6:0/1417188632 learned_addr learned my addr 172.21.15.6:0/1417188632 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21bbfff640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc06cde0 0x7f21bc0b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c12c7640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc15c270 0x7f21bc144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c0ac6640 1 -- 172.21.15.6:0/1417188632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc15c270 msgr2=0x7f21bc144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c0ac6640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc15c270 0x7f21bc144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c0ac6640 1 -- 172.21.15.6:0/1417188632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc06cde0 msgr2=0x7f21bc0b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c0ac6640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc06cde0 0x7f21bc0b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c0ac6640 1 -- 172.21.15.6:0/1417188632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80094d0 con 0x7f21bc06ca00 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c0ac6640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06ca00 0x7f21bc150e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21b000d800 tx=0x7f21b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21b97fa640 1 -- 172.21.15.6:0/1417188632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b00096a0 con 0x7f21bc06ca00 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21b97fa640 1 -- 172.21.15.6:0/1417188632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b0009800 con 0x7f21bc06ca00 2023-11-28T21:08:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc0b3e40 con 0x7f21bc06ca00 2023-11-28T21:08:42.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21b97fa640 1 -- 172.21.15.6:0/1417188632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0009b70 con 0x7f21bc06ca00 2023-11-28T21:08:42.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc145790 con 0x7f21bc06ca00 2023-11-28T21:08:42.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc145ae0 con 0x7f21bc06ca00 2023-11-28T21:08:42.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.307+0000 7f21b97fa640 1 -- 172.21.15.6:0/1417188632 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f21b0009cd0 con 0x7f21bc06ca00 2023-11-28T21:08:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.311+0000 7f21b97fa640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21a0066470 0x7f21a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.311+0000 7f21b97fa640 1 -- 172.21.15.6:0/1417188632 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21b0084540 con 0x7f21bc06ca00 2023-11-28T21:08:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.311+0000 7f21bbfff640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21a0066470 0x7f21a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.311+0000 7f21bbfff640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21a0066470 0x7f21a0068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21a80ad000 tx=0x7f21a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:42.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.315+0000 7f21b97fa640 1 -- 172.21.15.6:0/1417188632 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21b00519b0 con 0x7f21bc06ca00 2023-11-28T21:08:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21bc04e930 con 0x7f21bc06ca00 2023-11-28T21:08:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21b97fa640 1 -- 172.21.15.6:0/1417188632 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21b0054fd0 con 0x7f21bc06ca00 2023-11-28T21:08:42.480 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21a0066470 msgr2=0x7f21a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21a0066470 0x7f21a0068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21a80ad000 tx=0x7f21a8008040 comp rx=0 tx=0).stop 2023-11-28T21:08:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06ca00 msgr2=0x7f21bc150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06ca00 0x7f21bc150e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21b000d800 tx=0x7f21b000dcc0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 shutdown_connections 2023-11-28T21:08:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f21a0066470 0x7f21a0068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21bc15c270 0x7f21bc144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21bc06cde0 0x7f21bc0b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 --2- 172.21.15.6:0/1417188632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21bc06ca00 0x7f21bc150e10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 >> 172.21.15.6:0/1417188632 conn(0x7f21bc06a980 msgr2=0x7f21bc159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 shutdown_connections 2023-11-28T21:08:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.475+0000 7f21c2d2a640 1 -- 172.21.15.6:0/1417188632 wait complete. 2023-11-28T21:08:42.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-28T21:08:42.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f16363c4640 1 Processor -- start 2023-11-28T21:08:42.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f16363c4640 1 -- start start 2023-11-28T21:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f16363c4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1630142da0 0x7f1630071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f16363c4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f163006dd90 0x7f16300b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f16363c4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163015e340 con 0x7f163015e7d0 2023-11-28T21:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f16363c4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163015dae0 con 0x7f163006dd90 2023-11-28T21:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f16363c4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16300b39b0 con 0x7f1630142da0 2023-11-28T21:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f1634961640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f163006dd90 0x7f16300b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f1634961640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f163006dd90 0x7f16300b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38056/0 (socket says 172.21.15.6:38056) 2023-11-28T21:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f1634961640 1 -- 172.21.15.6:0/3328223396 learned_addr learned my addr 172.21.15.6:0/3328223396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.639+0000 7f162ffff640 1 --2- 172.21.15.6:0/3328223396 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1630142da0 0x7f1630071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f1634961640 1 -- 172.21.15.6:0/3328223396 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1630142da0 msgr2=0x7f1630071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f1634961640 1 --2- 172.21.15.6:0/3328223396 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1630142da0 0x7f1630071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f1634961640 1 -- 172.21.15.6:0/3328223396 >> v1:172.21.15.31:6789/0 conn(0x7f163015e7d0 legacy=0x7f163006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f1634961640 1 -- 172.21.15.6:0/3328223396 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630143440 con 0x7f163006dd90 2023-11-28T21:08:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f162effd640 1 -- 172.21.15.6:0/3328223396 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876460389 0 0) 0x7f163015e340 con 0x7f163015e7d0 2023-11-28T21:08:42.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f1634961640 1 --2- 172.21.15.6:0/3328223396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f163006dd90 0x7f16300b1d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1628009e80 tx=0x7f162801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa2cc31a1901d9f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f162effd640 1 -- 172.21.15.6:0/3328223396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16280a5880 con 0x7f163006dd90 2023-11-28T21:08:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f162effd640 1 -- 172.21.15.6:0/3328223396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16280a59e0 con 0x7f163006dd90 2023-11-28T21:08:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f162effd640 1 -- 172.21.15.6:0/3328223396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16280a5d70 con 0x7f163006dd90 2023-11-28T21:08:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f16363c4640 1 -- 172.21.15.6:0/3328223396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f163006dd90 msgr2=0x7f16300b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.643+0000 7f16363c4640 1 --2- 172.21.15.6:0/3328223396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f163006dd90 0x7f16300b1d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1628009e80 tx=0x7f162801c9c0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 -- 172.21.15.6:0/3328223396 shutdown_connections 2023-11-28T21:08:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 --2- 172.21.15.6:0/3328223396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f163006dd90 0x7f16300b1d90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 --2- 172.21.15.6:0/3328223396 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1630142da0 0x7f1630071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 -- 172.21.15.6:0/3328223396 >> 172.21.15.6:0/3328223396 conn(0x7f163006ab80 msgr2=0x7f16300b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:42.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 -- 172.21.15.6:0/3328223396 shutdown_connections 2023-11-28T21:08:42.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 -- 172.21.15.6:0/3328223396 wait complete. 2023-11-28T21:08:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 Processor -- start 2023-11-28T21:08:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 -- start start 2023-11-28T21:08:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f163006dd90 0x7f1630072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1630142da0 0x7f16301596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f163015e7d0 0x7f163013dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163015bb00 con 0x7f1630142da0 2023-11-28T21:08:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163015bde0 con 0x7f163015e7d0 2023-11-28T21:08:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f16363c4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163015c0c0 con 0x7f163006dd90 2023-11-28T21:08:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f162f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1630142da0 0x7f16301596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f162f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1630142da0 0x7f16301596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38072/0 (socket says 172.21.15.6:38072) 2023-11-28T21:08:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f162f7fe640 1 -- 172.21.15.6:0/2215860973 learned_addr learned my addr 172.21.15.6:0/2215860973 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f162ffff640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f163006dd90 0x7f1630072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f1634961640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f163015e7d0 0x7f163013dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f162f7fe640 1 -- 172.21.15.6:0/2215860973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f163006dd90 msgr2=0x7f1630072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f162f7fe640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f163006dd90 0x7f1630072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f162f7fe640 1 -- 172.21.15.6:0/2215860973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f163015e7d0 msgr2=0x7f163013dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f162f7fe640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f163015e7d0 0x7f163013dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.647+0000 7f162f7fe640 1 -- 172.21.15.6:0/2215860973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1628009b30 con 0x7f1630142da0 2023-11-28T21:08:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f162f7fe640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1630142da0 0x7f16301596c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1624001ec0 tx=0x7f162400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f162cff9640 1 -- 172.21.15.6:0/2215860973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16240054e0 con 0x7f1630142da0 2023-11-28T21:08:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f162cff9640 1 -- 172.21.15.6:0/2215860973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624003600 con 0x7f1630142da0 2023-11-28T21:08:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f162cff9640 1 -- 172.21.15.6:0/2215860973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16240039b0 con 0x7f1630142da0 2023-11-28T21:08:42.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163015c3a0 con 0x7f1630142da0 2023-11-28T21:08:42.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1630159c00 con 0x7f1630142da0 2023-11-28T21:08:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16300674d0 con 0x7f1630142da0 2023-11-28T21:08:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f162cff9640 1 -- 172.21.15.6:0/2215860973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1624003b10 con 0x7f1630142da0 2023-11-28T21:08:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f162cff9640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f161c0664c0 0x7f161c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f162cff9640 1 -- 172.21.15.6:0/2215860973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16240834d0 con 0x7f1630142da0 2023-11-28T21:08:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.651+0000 7f162ffff640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f161c0664c0 0x7f161c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:42.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.655+0000 7f162ffff640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f161c0664c0 0x7f161c068980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1620009b60 tx=0x7f1620009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:42.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.655+0000 7f162cff9640 1 -- 172.21.15.6:0/2215860973 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1624050950 con 0x7f1630142da0 2023-11-28T21:08:42.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:42.871+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f163015bc40 con 0x7f1630142da0 2023-11-28T21:08:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.323+0000 7f162cff9640 1 -- 172.21.15.6:0/2215860973 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v53) v1 ==== 147+0+0 (secure 0 0 0) 0x7f163015bc40 con 0x7f1630142da0 2023-11-28T21:08:43.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f161c0664c0 msgr2=0x7f161c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:43.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f161c0664c0 0x7f161c068980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1620009b60 tx=0x7f1620009190 comp rx=0 tx=0).stop 2023-11-28T21:08:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1630142da0 msgr2=0x7f16301596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1630142da0 0x7f16301596c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1624001ec0 tx=0x7f162400c8e0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 shutdown_connections 2023-11-28T21:08:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f161c0664c0 0x7f161c068980 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f163015e7d0 0x7f163013dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1630142da0 0x7f16301596c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 --2- 172.21.15.6:0/2215860973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f163006dd90 0x7f1630072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 >> 172.21.15.6:0/2215860973 conn(0x7f163006ab80 msgr2=0x7f16300ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 shutdown_connections 2023-11-28T21:08:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.327+0000 7f16363c4640 1 -- 172.21.15.6:0/2215860973 wait complete. 2023-11-28T21:08:43.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T21:08:43.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb490c17640 1 Processor -- start 2023-11-28T21:08:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb490c17640 1 -- start start 2023-11-28T21:08:43.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb490c17640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb48c06ca00 0x7fb48c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:43.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb490c17640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb48c06cde0 0x7fb48c15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb490c17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 0x7fb48c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb490c17640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c0cd400 con 0x7fb48c06cde0 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb490c17640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c15c700 con 0x7fb48c06ca00 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb490c17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0cc930 con 0x7fb48c15c270 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb483fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb48c06cde0 0x7fb48c15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb483fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb48c06cde0 0x7fb48c15bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38080/0 (socket says 172.21.15.6:38080) 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb483fff640 1 -- 172.21.15.6:0/3042188046 learned_addr learned my addr 172.21.15.6:0/3042188046 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb48a59c640 1 --2- 172.21.15.6:0/3042188046 >> v2:172.21.15.31:3300/0 conn(0x7fb48c06ca00 0x7fb48c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb48ad9d640 1 --2- 172.21.15.6:0/3042188046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 0x7fb48c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb483fff640 1 -- 172.21.15.6:0/3042188046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 msgr2=0x7fb48c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb483fff640 1 --2- 172.21.15.6:0/3042188046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 0x7fb48c15eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb483fff640 1 -- 172.21.15.6:0/3042188046 >> v2:172.21.15.31:3300/0 conn(0x7fb48c06ca00 msgr2=0x7fb48c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb483fff640 1 --2- 172.21.15.6:0/3042188046 >> v2:172.21.15.31:3300/0 conn(0x7fb48c06ca00 0x7fb48c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb483fff640 1 -- 172.21.15.6:0/3042188046 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0ccb60 con 0x7fb48c06cde0 2023-11-28T21:08:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.495+0000 7fb48ad9d640 1 --2- 172.21.15.6:0/3042188046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 0x7fb48c15eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:43.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb483fff640 1 --2- 172.21.15.6:0/3042188046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06cde0 0x7fb48c15bd30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb4740098a0 tx=0x7fb47401c160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eba13a3b9d81195 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb489d9b640 1 -- 172.21.15.6:0/3042188046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740ab600 con 0x7fb48c06cde0 2023-11-28T21:08:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb489d9b640 1 -- 172.21.15.6:0/3042188046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4740a7050 con 0x7fb48c06cde0 2023-11-28T21:08:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb489d9b640 1 -- 172.21.15.6:0/3042188046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740ab980 con 0x7fb48c06cde0 2023-11-28T21:08:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb490c17640 1 -- 172.21.15.6:0/3042188046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06cde0 msgr2=0x7fb48c15bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb490c17640 1 --2- 172.21.15.6:0/3042188046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06cde0 0x7fb48c15bd30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb4740098a0 tx=0x7fb47401c160 comp rx=0 tx=0).stop 2023-11-28T21:08:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb490c17640 1 -- 172.21.15.6:0/3042188046 shutdown_connections 2023-11-28T21:08:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb490c17640 1 --2- 172.21.15.6:0/3042188046 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 0x7fb48c15eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb490c17640 1 --2- 172.21.15.6:0/3042188046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06cde0 0x7fb48c15bd30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb490c17640 1 --2- 172.21.15.6:0/3042188046 >> v2:172.21.15.31:3300/0 conn(0x7fb48c06ca00 0x7fb48c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb490c17640 1 -- 172.21.15.6:0/3042188046 >> 172.21.15.6:0/3042188046 conn(0x7fb48c06a980 msgr2=0x7fb48c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb490c17640 1 -- 172.21.15.6:0/3042188046 shutdown_connections 2023-11-28T21:08:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.499+0000 7fb490c17640 1 -- 172.21.15.6:0/3042188046 wait complete. 2023-11-28T21:08:43.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 Processor -- start 2023-11-28T21:08:43.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 -- start start 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06ca00 0x7fb48c148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06cde0 0x7fb48c14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 0x7fb48c14b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c148540 con 0x7fb48c06ca00 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c14d9e0 con 0x7fb48c06cde0 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c070520 con 0x7fb48c15c270 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb48a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06ca00 0x7fb48c148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb48a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06ca00 0x7fb48c148000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38096/0 (socket says 172.21.15.6:38096) 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb48a59c640 1 -- 172.21.15.6:0/3636993942 learned_addr learned my addr 172.21.15.6:0/3636993942 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb48a59c640 1 -- 172.21.15.6:0/3636993942 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 msgr2=0x7fb48c14b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb48a59c640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 0x7fb48c14b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb48a59c640 1 -- 172.21.15.6:0/3636993942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06cde0 msgr2=0x7fb48c14c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb48a59c640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06cde0 0x7fb48c14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb48a59c640 1 -- 172.21.15.6:0/3636993942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4740094d0 con 0x7fb48c06ca00 2023-11-28T21:08:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb48a59c640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06ca00 0x7fb48c148000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00e8e0 tx=0x7fb47c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb482ffd640 1 -- 172.21.15.6:0/3636993942 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00c9a0 con 0x7fb48c06ca00 2023-11-28T21:08:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb482ffd640 1 -- 172.21.15.6:0/3636993942 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c00cb00 con 0x7fb48c06ca00 2023-11-28T21:08:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c070800 con 0x7fb48c06ca00 2023-11-28T21:08:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb482ffd640 1 -- 172.21.15.6:0/3636993942 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00ce90 con 0x7fb48c06ca00 2023-11-28T21:08:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.503+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c14cf00 con 0x7fb48c06ca00 2023-11-28T21:08:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.507+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c072b90 con 0x7fb48c06ca00 2023-11-28T21:08:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.507+0000 7fb482ffd640 1 -- 172.21.15.6:0/3636993942 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb47c013470 con 0x7fb48c06ca00 2023-11-28T21:08:43.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.507+0000 7fb482ffd640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb46c066470 0x7fb46c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:43.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.507+0000 7fb482ffd640 1 -- 172.21.15.6:0/3636993942 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb47c084090 con 0x7fb48c06ca00 2023-11-28T21:08:43.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.507+0000 7fb483fff640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb46c066470 0x7fb46c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:43.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.507+0000 7fb483fff640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb46c066470 0x7fb46c068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ad000 tx=0x7fb474008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.511+0000 7fb482ffd640 1 -- 172.21.15.6:0/3636993942 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb47c051500 con 0x7fb48c06ca00 2023-11-28T21:08:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.671+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb48c04e930 con 0x7fb48c06ca00 2023-11-28T21:08:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.675+0000 7fb482ffd640 1 -- 172.21.15.6:0/3636993942 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb47c054b20 con 0x7fb48c06ca00 2023-11-28T21:08:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb46c066470 msgr2=0x7fb46c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb46c066470 0x7fb46c068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4740ad000 tx=0x7fb474008040 comp rx=0 tx=0).stop 2023-11-28T21:08:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06ca00 msgr2=0x7fb48c148000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:43.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06ca00 0x7fb48c148000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00e8e0 tx=0x7fb47c00eda0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 shutdown_connections 2023-11-28T21:08:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb46c066470 0x7fb46c068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb48c15c270 0x7fb48c14b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c06cde0 0x7fb48c14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 --2- 172.21.15.6:0/3636993942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb48c06ca00 0x7fb48c148000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 >> 172.21.15.6:0/3636993942 conn(0x7fb48c06a980 msgr2=0x7fb48c15a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 shutdown_connections 2023-11-28T21:08:43.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:43.679+0000 7fb490c17640 1 -- 172.21.15.6:0/3636993942 wait complete. 2023-11-28T21:08:43.704 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T21:08:43.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T21:08:43.801 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T21:08:43.922 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T21:08:43.923 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:08:43.923 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:43.933 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:08:43.933 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:43.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa25092a640 1 Processor -- start 2023-11-28T21:08:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa25092a640 1 -- start start 2023-11-28T21:08:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa25092a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 0x7fa24c160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa25092a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa24c0b32c0 0x7fa24c161280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa25092a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c157c80 con 0x7fa24c1617c0 2023-11-28T21:08:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa25092a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c161c10 con 0x7fa24c0b32c0 2023-11-28T21:08:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa25092a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c06b590 con 0x7fa24c0ad700 2023-11-28T21:08:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa243fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa24c0b32c0 0x7fa24c161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa24a59c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 0x7fa24c160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa243fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa24c0b32c0 0x7fa24c161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:60786/0 (socket says 172.21.15.6:60786) 2023-11-28T21:08:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa243fff640 1 -- 172.21.15.6:0/2079148123 learned_addr learned my addr 172.21.15.6:0/2079148123 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa243fff640 1 -- 172.21.15.6:0/2079148123 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 msgr2=0x7fa24c160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa243fff640 1 --2- 172.21.15.6:0/2079148123 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 0x7fa24c160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa243fff640 1 -- 172.21.15.6:0/2079148123 >> v1:172.21.15.31:6789/0 conn(0x7fa24c1617c0 legacy=0x7fa24c15d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.171+0000 7fa243fff640 1 -- 172.21.15.6:0/2079148123 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c0adae0 con 0x7fa24c0b32c0 2023-11-28T21:08:44.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa243fff640 1 --2- 172.21.15.6:0/2079148123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa24c0b32c0 0x7fa24c161280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa23401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=892bf8ca2707a0a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:44.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa249d9b640 1 -- 172.21.15.6:0/2079148123 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c15e670 con 0x7fa24c0b32c0 2023-11-28T21:08:44.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa249d9b640 1 -- 172.21.15.6:0/2079148123 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2340aa670 con 0x7fa24c0b32c0 2023-11-28T21:08:44.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa249d9b640 1 -- 172.21.15.6:0/2079148123 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340aaa00 con 0x7fa24c0b32c0 2023-11-28T21:08:44.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa25092a640 1 -- 172.21.15.6:0/2079148123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa24c0b32c0 msgr2=0x7fa24c161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa25092a640 1 --2- 172.21.15.6:0/2079148123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa24c0b32c0 0x7fa24c161280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa23401c510 comp rx=0 tx=0).stop 2023-11-28T21:08:44.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa25092a640 1 -- 172.21.15.6:0/2079148123 shutdown_connections 2023-11-28T21:08:44.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa25092a640 1 --2- 172.21.15.6:0/2079148123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa24c0b32c0 0x7fa24c161280 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa25092a640 1 --2- 172.21.15.6:0/2079148123 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 0x7fa24c160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa25092a640 1 -- 172.21.15.6:0/2079148123 >> 172.21.15.6:0/2079148123 conn(0x7fa24c0cf7b0 msgr2=0x7fa24c0cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:44.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa25092a640 1 -- 172.21.15.6:0/2079148123 shutdown_connections 2023-11-28T21:08:44.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.175+0000 7fa25092a640 1 -- 172.21.15.6:0/2079148123 wait complete. 2023-11-28T21:08:44.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa25092a640 1 Processor -- start 2023-11-28T21:08:44.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa25092a640 1 -- start start 2023-11-28T21:08:44.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa25092a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 0x7fa24c06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa25092a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa24c0b32c0 0x7fa24c150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa25092a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24c1617c0 0x7fa24c158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa25092a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c1580f0 con 0x7fa24c1617c0 2023-11-28T21:08:44.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa25092a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c06d930 con 0x7fa24c0b32c0 2023-11-28T21:08:44.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa25092a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c06dc10 con 0x7fa24c0ad700 2023-11-28T21:08:44.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24c1617c0 0x7fa24c158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24c1617c0 0x7fa24c158780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38102/0 (socket says 172.21.15.6:38102) 2023-11-28T21:08:44.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24ad9d640 1 -- 172.21.15.6:0/3993037397 learned_addr learned my addr 172.21.15.6:0/3993037397 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:44.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa243fff640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa24c0b32c0 0x7fa24c150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24a59c640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 0x7fa24c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24ad9d640 1 -- 172.21.15.6:0/3993037397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 msgr2=0x7fa24c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24ad9d640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 0x7fa24c06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24ad9d640 1 -- 172.21.15.6:0/3993037397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa24c0b32c0 msgr2=0x7fa24c150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24ad9d640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa24c0b32c0 0x7fa24c150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24ad9d640 1 -- 172.21.15.6:0/3993037397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2340094d0 con 0x7fa24c1617c0 2023-11-28T21:08:44.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa24ad9d640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24c1617c0 0x7fa24c158780 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa24400c730 tx=0x7fa24400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:44.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa242ffd640 1 -- 172.21.15.6:0/3993037397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244003b80 con 0x7fa24c1617c0 2023-11-28T21:08:44.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa242ffd640 1 -- 172.21.15.6:0/3993037397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244003ce0 con 0x7fa24c1617c0 2023-11-28T21:08:44.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa242ffd640 1 -- 172.21.15.6:0/3993037397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400aa30 con 0x7fa24c1617c0 2023-11-28T21:08:44.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.179+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c06def0 con 0x7fa24c1617c0 2023-11-28T21:08:44.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.183+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c06e4b0 con 0x7fa24c1617c0 2023-11-28T21:08:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.183+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c06f630 con 0x7fa24c1617c0 2023-11-28T21:08:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.183+0000 7fa242ffd640 1 -- 172.21.15.6:0/3993037397 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa24400ab90 con 0x7fa24c1617c0 2023-11-28T21:08:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.183+0000 7fa242ffd640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa22c0664a0 0x7fa22c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.183+0000 7fa242ffd640 1 -- 172.21.15.6:0/3993037397 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa244083ab0 con 0x7fa24c1617c0 2023-11-28T21:08:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.183+0000 7fa24a59c640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa22c0664a0 0x7fa22c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.187+0000 7fa24a59c640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa22c0664a0 0x7fa22c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009b60 tx=0x7fa23c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:44.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.187+0000 7fa242ffd640 1 -- 172.21.15.6:0/3993037397 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa244050fe0 con 0x7fa24c1617c0 2023-11-28T21:08:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.347+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa24c06bea0 con 0x7fa24c1617c0 2023-11-28T21:08:44.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa242ffd640 1 -- 172.21.15.6:0/3993037397 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fa244054600 con 0x7fa24c1617c0 2023-11-28T21:08:44.355 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:44.355 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa22c0664a0 msgr2=0x7fa22c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa22c0664a0 0x7fa22c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009b60 tx=0x7fa23c009190 comp rx=0 tx=0).stop 2023-11-28T21:08:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24c1617c0 msgr2=0x7fa24c158780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24c1617c0 0x7fa24c158780 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa24400c730 tx=0x7fa24400cbf0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 shutdown_connections 2023-11-28T21:08:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa22c0664a0 0x7fa22c068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa24c1617c0 0x7fa24c158780 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa24c0b32c0 0x7fa24c150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 --2- 172.21.15.6:0/3993037397 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa24c0ad700 0x7fa24c06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 >> 172.21.15.6:0/3993037397 conn(0x7fa24c0cf7b0 msgr2=0x7fa24c1601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 shutdown_connections 2023-11-28T21:08:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.351+0000 7fa25092a640 1 -- 172.21.15.6:0/3993037397 wait complete. 2023-11-28T21:08:44.377 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:44.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.515+0000 7f07fa757640 1 Processor -- start 2023-11-28T21:08:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07fa757640 1 -- start start 2023-11-28T21:08:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07fa757640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07f40cc3f0 0x7f07f415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07fa757640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f415c270 0x7f07f415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07fa757640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f40cc8a0 con 0x7f07f406ca00 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07fa757640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40cd400 con 0x7f07f40cc3f0 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07fa757640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f415c700 con 0x7f07f415c270 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f07f406ca00 0x7f07f406cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46060/0 (socket says 172.21.15.6:46060) 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f3fff640 1 -- 172.21.15.6:0/2856399404 learned_addr learned my addr 172.21.15.6:0/2856399404 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f8cf4640 1 --2- 172.21.15.6:0/2856399404 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f415c270 0x7f07f415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f37fe640 1 --2- 172.21.15.6:0/2856399404 >> v2:172.21.15.31:3300/0 conn(0x7f07f40cc3f0 0x7f07f415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f2ffd640 1 -- 172.21.15.6:0/2856399404 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824821390 0 0) 0x7f07f40cc8a0 con 0x7f07f406ca00 2023-11-28T21:08:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f2ffd640 1 -- 172.21.15.6:0/2856399404 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc003530 con 0x7f07f406ca00 2023-11-28T21:08:44.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f37fe640 1 -- 172.21.15.6:0/2856399404 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f415c270 msgr2=0x7f07f415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:44.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f37fe640 1 --2- 172.21.15.6:0/2856399404 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f415c270 0x7f07f415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f37fe640 1 -- 172.21.15.6:0/2856399404 >> v1:172.21.15.6:6789/0 conn(0x7f07f406ca00 legacy=0x7f07f406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.519+0000 7f07f37fe640 1 -- 172.21.15.6:0/2856399404 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40ccb60 con 0x7f07f40cc3f0 2023-11-28T21:08:44.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07f37fe640 1 --2- 172.21.15.6:0/2856399404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 0x7f07f415bd30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009820 tx=0x7f07e801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f48f9340a9de5f23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:44.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07f2ffd640 1 -- 172.21.15.6:0/2856399404 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80ac600 con 0x7f07f40cc3f0 2023-11-28T21:08:44.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07f2ffd640 1 -- 172.21.15.6:0/2856399404 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e80a8050 con 0x7f07f40cc3f0 2023-11-28T21:08:44.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07f2ffd640 1 -- 172.21.15.6:0/2856399404 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80ac980 con 0x7f07f40cc3f0 2023-11-28T21:08:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07fa757640 1 -- 172.21.15.6:0/2856399404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 msgr2=0x7f07f415bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07fa757640 1 --2- 172.21.15.6:0/2856399404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 0x7f07f415bd30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009820 tx=0x7f07e801c3a0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07fa757640 1 -- 172.21.15.6:0/2856399404 shutdown_connections 2023-11-28T21:08:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07fa757640 1 --2- 172.21.15.6:0/2856399404 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f415c270 0x7f07f415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07fa757640 1 --2- 172.21.15.6:0/2856399404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 0x7f07f415bd30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07fa757640 1 -- 172.21.15.6:0/2856399404 >> 172.21.15.6:0/2856399404 conn(0x7f07f406a980 msgr2=0x7f07f406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07fa757640 1 -- 172.21.15.6:0/2856399404 shutdown_connections 2023-11-28T21:08:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07fa757640 1 -- 172.21.15.6:0/2856399404 wait complete. 2023-11-28T21:08:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.523+0000 7f07fa757640 1 Processor -- start 2023-11-28T21:08:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 -- start start 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f406ca00 0x7f07f414d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 0x7f07f40b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f415c270 0x7f07f4155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4157680 con 0x7f07f415c270 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4152cd0 con 0x7f07f40cc3f0 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4152fb0 con 0x7f07f406ca00 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f8cf4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f415c270 0x7f07f4155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f8cf4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f415c270 0x7f07f4155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38118/0 (socket says 172.21.15.6:38118) 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f8cf4640 1 -- 172.21.15.6:0/1429069502 learned_addr learned my addr 172.21.15.6:0/1429069502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f8cf4640 1 -- 172.21.15.6:0/1429069502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f406ca00 msgr2=0x7f07f414d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f8cf4640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f406ca00 0x7f07f414d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f37fe640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 0x7f07f40b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f8cf4640 1 -- 172.21.15.6:0/1429069502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 msgr2=0x7f07f40b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f8cf4640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 0x7f07f40b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f8cf4640 1 -- 172.21.15.6:0/1429069502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8009420 con 0x7f07f415c270 2023-11-28T21:08:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f37fe640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 0x7f07f40b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f8cf4640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f415c270 0x7f07f4155da0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00efc0 tx=0x7f07ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f0ff9640 1 -- 172.21.15.6:0/1429069502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec009ba0 con 0x7f07f415c270 2023-11-28T21:08:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f0ff9640 1 -- 172.21.15.6:0/1429069502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec00f040 con 0x7f07f415c270 2023-11-28T21:08:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f4153290 con 0x7f07f415c270 2023-11-28T21:08:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07f0ff9640 1 -- 172.21.15.6:0/1429069502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0146c0 con 0x7f07f415c270 2023-11-28T21:08:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f4153850 con 0x7f07f415c270 2023-11-28T21:08:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.527+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f4072b90 con 0x7f07f415c270 2023-11-28T21:08:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.531+0000 7f07f0ff9640 1 -- 172.21.15.6:0/1429069502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07ec014820 con 0x7f07f415c270 2023-11-28T21:08:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.531+0000 7f07f0ff9640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f07e0066470 0x7f07e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.531+0000 7f07f0ff9640 1 -- 172.21.15.6:0/1429069502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07ec084a90 con 0x7f07f415c270 2023-11-28T21:08:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.531+0000 7f07f3fff640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f07e0066470 0x7f07e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.531+0000 7f07f3fff640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f07e0066470 0x7f07e0068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f07e4007fd0 tx=0x7f07e4007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:44.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.535+0000 7f07f0ff9640 1 -- 172.21.15.6:0/1429069502 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f07ec051df0 con 0x7f07f415c270 2023-11-28T21:08:44.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.691+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07f4153a40 con 0x7f07f415c270 2023-11-28T21:08:44.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.691+0000 7f07f0ff9640 1 -- 172.21.15.6:0/1429069502 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07ec018020 con 0x7f07f415c270 2023-11-28T21:08:44.698 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:44.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f07e0066470 msgr2=0x7f07e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f07e0066470 0x7f07e0068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f07e4007fd0 tx=0x7f07e4007940 comp rx=0 tx=0).stop 2023-11-28T21:08:44.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f415c270 msgr2=0x7f07f4155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f415c270 0x7f07f4155da0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00efc0 tx=0x7f07ec00c490 comp rx=0 tx=0).stop 2023-11-28T21:08:44.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 shutdown_connections 2023-11-28T21:08:44.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f07e0066470 0x7f07e0068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07f415c270 0x7f07f4155da0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07f40cc3f0 0x7f07f40b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 --2- 172.21.15.6:0/1429069502 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f07f406ca00 0x7f07f414d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 >> 172.21.15.6:0/1429069502 conn(0x7f07f406a980 msgr2=0x7f07f40aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:44.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 shutdown_connections 2023-11-28T21:08:44.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.695+0000 7f07fa757640 1 -- 172.21.15.6:0/1429069502 wait complete. 2023-11-28T21:08:44.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.859+0000 7f996359e640 1 Processor -- start 2023-11-28T21:08:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.859+0000 7f996359e640 1 -- start start 2023-11-28T21:08:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f996359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99640cf410 0x7f9964164c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f996359e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99640715d0 con 0x7f9964070f80 2023-11-28T21:08:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f996359e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99640718b0 con 0x7f99640caf50 2023-11-28T21:08:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f996359e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99640b1a60 con 0x7f99640cf410 2023-11-28T21:08:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f995bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9964070f80 0x7f99640ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46076/0 (socket says 172.21.15.6:46076) 2023-11-28T21:08:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f995bfff640 1 -- 172.21.15.6:0/600218989 learned_addr learned my addr 172.21.15.6:0/600218989 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f9962d9d640 1 --2- 172.21.15.6:0/600218989 >> v2:172.21.15.6:3300/0 conn(0x7f99640cf410 0x7f9964164c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f9961d9b640 1 -- 172.21.15.6:0/600218989 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546687788 0 0) 0x7f99640715d0 con 0x7f9964070f80 2023-11-28T21:08:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f9961d9b640 1 -- 172.21.15.6:0/600218989 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9950003530 con 0x7f9964070f80 2023-11-28T21:08:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f9962d9d640 1 -- 172.21.15.6:0/600218989 >> v1:172.21.15.31:6789/0 conn(0x7f99640caf50 legacy=0x7f996415ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f9962d9d640 1 -- 172.21.15.6:0/600218989 >> v1:172.21.15.6:6789/0 conn(0x7f9964070f80 legacy=0x7f99640ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.863+0000 7f9962d9d640 1 -- 172.21.15.6:0/600218989 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99640b1d40 con 0x7f99640cf410 2023-11-28T21:08:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f9962d9d640 1 --2- 172.21.15.6:0/600218989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 0x7f9964164c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f995c009d90 tx=0x7f995c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9eafddd9dfcbf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f9961d9b640 1 -- 172.21.15.6:0/600218989 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c0a5a30 con 0x7f99640cf410 2023-11-28T21:08:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f9961d9b640 1 -- 172.21.15.6:0/600218989 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c0a5b90 con 0x7f99640cf410 2023-11-28T21:08:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f9961d9b640 1 -- 172.21.15.6:0/600218989 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c0ad440 con 0x7f99640cf410 2023-11-28T21:08:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 -- 172.21.15.6:0/600218989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 msgr2=0x7f9964164c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 --2- 172.21.15.6:0/600218989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 0x7f9964164c40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f995c009d90 tx=0x7f995c01c950 comp rx=0 tx=0).stop 2023-11-28T21:08:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 -- 172.21.15.6:0/600218989 shutdown_connections 2023-11-28T21:08:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 --2- 172.21.15.6:0/600218989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 0x7f9964164c40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 -- 172.21.15.6:0/600218989 >> 172.21.15.6:0/600218989 conn(0x7f996406a750 msgr2=0x7f996406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 -- 172.21.15.6:0/600218989 shutdown_connections 2023-11-28T21:08:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 -- 172.21.15.6:0/600218989 wait complete. 2023-11-28T21:08:44.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 Processor -- start 2023-11-28T21:08:44.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 -- start start 2023-11-28T21:08:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9964070f80 0x7f996415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99640caf50 0x7f99640cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 0x7f99641403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99640cd6a0 con 0x7f99640cf410 2023-11-28T21:08:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.867+0000 7f996359e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996415bad0 con 0x7f9964070f80 2023-11-28T21:08:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f996359e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996415bdb0 con 0x7f99640caf50 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f9962d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 0x7f99641403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f9962d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 0x7f99641403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38138/0 (socket says 172.21.15.6:38138) 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f9962d9d640 1 -- 172.21.15.6:0/3901870522 learned_addr learned my addr 172.21.15.6:0/3901870522 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f996259c640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9964070f80 0x7f996415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f995bfff640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99640caf50 0x7f99640cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f9962d9d640 1 -- 172.21.15.6:0/3901870522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99640caf50 msgr2=0x7f99640cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f9962d9d640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99640caf50 0x7f99640cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f9962d9d640 1 -- 172.21.15.6:0/3901870522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9964070f80 msgr2=0x7f996415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f9962d9d640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9964070f80 0x7f996415b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f9962d9d640 1 -- 172.21.15.6:0/3901870522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c009a70 con 0x7f99640cf410 2023-11-28T21:08:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f9962d9d640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 0x7f99641403d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f995c019560 tx=0x7f995c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f995affd640 1 -- 172.21.15.6:0/3901870522 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c0aee00 con 0x7f99640cf410 2023-11-28T21:08:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f995affd640 1 -- 172.21.15.6:0/3901870522 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c009450 con 0x7f99640cf410 2023-11-28T21:08:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f995affd640 1 -- 172.21.15.6:0/3901870522 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c003bc0 con 0x7f99640cf410 2023-11-28T21:08:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996415c090 con 0x7f99640cf410 2023-11-28T21:08:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9964140910 con 0x7f99640cf410 2023-11-28T21:08:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9964151ec0 con 0x7f99640cf410 2023-11-28T21:08:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.871+0000 7f995affd640 1 -- 172.21.15.6:0/3901870522 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f995c0b4050 con 0x7f99640cf410 2023-11-28T21:08:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.875+0000 7f995affd640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9944066470 0x7f9944068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:44.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.875+0000 7f995affd640 1 -- 172.21.15.6:0/3901870522 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f995c11df90 con 0x7f99640cf410 2023-11-28T21:08:44.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.875+0000 7f996259c640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9944066470 0x7f9944068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:44.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.875+0000 7f996259c640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9944066470 0x7f9944068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9954007fd0 tx=0x7f9954009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:44.879+0000 7f995affd640 1 -- 172.21.15.6:0/3901870522 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9964151ec0 con 0x7f99640cf410 2023-11-28T21:08:45.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9964151ec0 con 0x7f99640cf410 2023-11-28T21:08:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f995affd640 1 -- 172.21.15.6:0/3901870522 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9964151ec0 con 0x7f99640cf410 2023-11-28T21:08:45.044 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9944066470 msgr2=0x7f9944068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9944066470 0x7f9944068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9954007fd0 tx=0x7f9954009040 comp rx=0 tx=0).stop 2023-11-28T21:08:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 msgr2=0x7f99641403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 0x7f99641403d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f995c019560 tx=0x7f995c0196f0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 shutdown_connections 2023-11-28T21:08:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9944066470 0x7f9944068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99640cf410 0x7f99641403d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99640caf50 0x7f99640cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 --2- 172.21.15.6:0/3901870522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9964070f80 0x7f996415b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 >> 172.21.15.6:0/3901870522 conn(0x7f996406a750 msgr2=0x7f9964070140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:45.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 shutdown_connections 2023-11-28T21:08:45.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.039+0000 7f996359e640 1 -- 172.21.15.6:0/3901870522 wait complete. 2023-11-28T21:08:45.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:45.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.207+0000 7fc216c5f640 1 Processor -- start 2023-11-28T21:08:45.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.207+0000 7fc216c5f640 1 -- start start 2023-11-28T21:08:45.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.207+0000 7fc216c5f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc21006ca00 0x7fc2100cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.207+0000 7fc216c5f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc21015c440 0x7fc21015ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.207+0000 7fc216c5f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2100cc930 con 0x7fc21006cde0 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.207+0000 7fc216c5f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2100cd400 con 0x7fc21006ca00 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.207+0000 7fc216c5f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2100ccb60 con 0x7fc21015c440 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc2149fb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc21006ca00 0x7fc2100cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc2149fb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc21006ca00 0x7fc2100cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38154/0 (socket says 172.21.15.6:38154) 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc2149fb640 1 -- 172.21.15.6:0/1561074788 learned_addr learned my addr 172.21.15.6:0/1561074788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc2151fc640 1 --2- 172.21.15.6:0/1561074788 >> v2:172.21.15.31:3300/0 conn(0x7fc21015c440 0x7fc21015ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc2149fb640 1 -- 172.21.15.6:0/1561074788 >> v2:172.21.15.31:3300/0 conn(0x7fc21015c440 msgr2=0x7fc21015ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc2149fb640 1 --2- 172.21.15.6:0/1561074788 >> v2:172.21.15.31:3300/0 conn(0x7fc21015c440 0x7fc21015ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc2149fb640 1 -- 172.21.15.6:0/1561074788 >> v1:172.21.15.31:6789/0 conn(0x7fc21006cde0 legacy=0x7fc21015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc2149fb640 1 -- 172.21.15.6:0/1561074788 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2100cce40 con 0x7fc21006ca00 2023-11-28T21:08:45.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc2149fb640 1 --2- 172.21.15.6:0/1561074788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 0x7fc2100cc3f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc204009870 tx=0x7fc20401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912a40329513cd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:45.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc20f7fe640 1 -- 172.21.15.6:0/1561074788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040ab640 con 0x7fc21006ca00 2023-11-28T21:08:45.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc20f7fe640 1 -- 172.21.15.6:0/1561074788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2040a7070 con 0x7fc21006ca00 2023-11-28T21:08:45.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.211+0000 7fc20f7fe640 1 -- 172.21.15.6:0/1561074788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040ab9c0 con 0x7fc21006ca00 2023-11-28T21:08:45.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 -- 172.21.15.6:0/1561074788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 msgr2=0x7fc2100cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 --2- 172.21.15.6:0/1561074788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 0x7fc2100cc3f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc204009870 tx=0x7fc20401c440 comp rx=0 tx=0).stop 2023-11-28T21:08:45.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 -- 172.21.15.6:0/1561074788 shutdown_connections 2023-11-28T21:08:45.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 --2- 172.21.15.6:0/1561074788 >> v2:172.21.15.31:3300/0 conn(0x7fc21015c440 0x7fc21015ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 --2- 172.21.15.6:0/1561074788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 0x7fc2100cc3f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 -- 172.21.15.6:0/1561074788 >> 172.21.15.6:0/1561074788 conn(0x7fc21006a980 msgr2=0x7fc21006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:45.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 -- 172.21.15.6:0/1561074788 shutdown_connections 2023-11-28T21:08:45.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 -- 172.21.15.6:0/1561074788 wait complete. 2023-11-28T21:08:45.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 Processor -- start 2023-11-28T21:08:45.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 -- start start 2023-11-28T21:08:45.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 0x7fc21014b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc21006cde0 0x7fc2101f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc21015c440 0x7fc2101571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2101502f0 con 0x7fc21006ca00 2023-11-28T21:08:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21014b850 con 0x7fc21006cde0 2023-11-28T21:08:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc216c5f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2101f94f0 con 0x7fc21015c440 2023-11-28T21:08:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc2149fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 0x7fc21014b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc2149fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 0x7fc21014b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38166/0 (socket says 172.21.15.6:38166) 2023-11-28T21:08:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc2149fb640 1 -- 172.21.15.6:0/1339280888 learned_addr learned my addr 172.21.15.6:0/1339280888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc20ffff640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc21006cde0 0x7fc2101f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc2151fc640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc21015c440 0x7fc2101571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc2149fb640 1 -- 172.21.15.6:0/1339280888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc21015c440 msgr2=0x7fc2101571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc2149fb640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc21015c440 0x7fc2101571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc2149fb640 1 -- 172.21.15.6:0/1339280888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc21006cde0 msgr2=0x7fc2101f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc2149fb640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc21006cde0 0x7fc2101f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.215+0000 7fc2149fb640 1 -- 172.21.15.6:0/1339280888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2040094d0 con 0x7fc21006ca00 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc2149fb640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 0x7fc21014b310 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc2040ad040 tx=0x7fc20401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc20d7fa640 1 -- 172.21.15.6:0/1339280888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040abe80 con 0x7fc21006ca00 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc20d7fa640 1 -- 172.21.15.6:0/1339280888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2040be3f0 con 0x7fc21006ca00 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc20d7fa640 1 -- 172.21.15.6:0/1339280888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040be780 con 0x7fc21006ca00 2023-11-28T21:08:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21014f740 con 0x7fc21006ca00 2023-11-28T21:08:45.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21014fc30 con 0x7fc21006ca00 2023-11-28T21:08:45.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc210072b90 con 0x7fc21006ca00 2023-11-28T21:08:45.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc20d7fa640 1 -- 172.21.15.6:0/1339280888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2040c7440 con 0x7fc21006ca00 2023-11-28T21:08:45.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc20d7fa640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc1f4066470 0x7fc1f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc20d7fa640 1 -- 172.21.15.6:0/1339280888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc20411e710 con 0x7fc21006ca00 2023-11-28T21:08:45.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.219+0000 7fc20ffff640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc1f4066470 0x7fc1f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.223+0000 7fc20ffff640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc1f4066470 0x7fc1f4068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc2101598b0 tx=0x7fc1fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:45.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.223+0000 7fc20d7fa640 1 -- 172.21.15.6:0/1339280888 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2040ebc30 con 0x7fc21006ca00 2023-11-28T21:08:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc21004e930 con 0x7fc21006ca00 2023-11-28T21:08:45.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc20d7fa640 1 -- 172.21.15.6:0/1339280888 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2040ef250 con 0x7fc21006ca00 2023-11-28T21:08:45.388 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc1f4066470 msgr2=0x7fc1f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc1f4066470 0x7fc1f4068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc2101598b0 tx=0x7fc1fc009040 comp rx=0 tx=0).stop 2023-11-28T21:08:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 msgr2=0x7fc21014b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 0x7fc21014b310 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc2040ad040 tx=0x7fc20401ac80 comp rx=0 tx=0).stop 2023-11-28T21:08:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 shutdown_connections 2023-11-28T21:08:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc1f4066470 0x7fc1f4068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc21015c440 0x7fc2101571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc21006cde0 0x7fc2101f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 --2- 172.21.15.6:0/1339280888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21006ca00 0x7fc21014b310 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 >> 172.21.15.6:0/1339280888 conn(0x7fc21006a980 msgr2=0x7fc2100ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 shutdown_connections 2023-11-28T21:08:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.383+0000 7fc216c5f640 1 -- 172.21.15.6:0/1339280888 wait complete. 2023-11-28T21:08:45.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T21:08:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa37996640 1 Processor -- start 2023-11-28T21:08:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa37996640 1 -- start start 2023-11-28T21:08:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa37996640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa3015e370 0x7faa300ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa37996640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa3015e750 0x7faa300cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa37996640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3015b510 con 0x7faa300cbd70 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa37996640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa300cc200 con 0x7faa3015e750 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa37996640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa300cd730 con 0x7faa3015e370 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa34f31640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa3015e750 0x7faa300cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa34f31640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa3015e750 0x7faa300cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38174/0 (socket says 172.21.15.6:38174) 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa34f31640 1 -- 172.21.15.6:0/3906406921 learned_addr learned my addr 172.21.15.6:0/3906406921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa35732640 1 --2- 172.21.15.6:0/3906406921 >> v2:172.21.15.31:3300/0 conn(0x7faa3015e370 0x7faa300ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa34f31640 1 -- 172.21.15.6:0/3906406921 >> v2:172.21.15.31:3300/0 conn(0x7faa3015e370 msgr2=0x7faa300ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa34f31640 1 --2- 172.21.15.6:0/3906406921 >> v2:172.21.15.31:3300/0 conn(0x7faa3015e370 0x7faa300ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa34f31640 1 -- 172.21.15.6:0/3906406921 >> v1:172.21.15.31:6789/0 conn(0x7faa300cbd70 legacy=0x7faa3015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.551+0000 7faa34f31640 1 -- 172.21.15.6:0/3906406921 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300cd940 con 0x7faa3015e750 2023-11-28T21:08:45.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa34f31640 1 --2- 172.21.15.6:0/3906406921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa3015e750 0x7faa300cb830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa3006c9d0 tx=0x7faa2001e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f944bcf73a9517de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:45.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa27fff640 1 -- 172.21.15.6:0/3906406921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa200ae640 con 0x7faa3015e750 2023-11-28T21:08:45.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa27fff640 1 -- 172.21.15.6:0/3906406921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa200ae7a0 con 0x7faa3015e750 2023-11-28T21:08:45.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa27fff640 1 -- 172.21.15.6:0/3906406921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa200aeb30 con 0x7faa3015e750 2023-11-28T21:08:45.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa37996640 1 -- 172.21.15.6:0/3906406921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa3015e750 msgr2=0x7faa300cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa37996640 1 --2- 172.21.15.6:0/3906406921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa3015e750 0x7faa300cb830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa3006c9d0 tx=0x7faa2001e6d0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa37996640 1 -- 172.21.15.6:0/3906406921 shutdown_connections 2023-11-28T21:08:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa37996640 1 --2- 172.21.15.6:0/3906406921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa3015e750 0x7faa300cb830 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa37996640 1 --2- 172.21.15.6:0/3906406921 >> v2:172.21.15.31:3300/0 conn(0x7faa3015e370 0x7faa300ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa37996640 1 -- 172.21.15.6:0/3906406921 >> 172.21.15.6:0/3906406921 conn(0x7faa3006a980 msgr2=0x7faa3006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa37996640 1 -- 172.21.15.6:0/3906406921 shutdown_connections 2023-11-28T21:08:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.555+0000 7faa37996640 1 -- 172.21.15.6:0/3906406921 wait complete. 2023-11-28T21:08:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 Processor -- start 2023-11-28T21:08:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 -- start start 2023-11-28T21:08:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300cbd70 0x7faa301f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3015e370 0x7faa301355c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3015e750 0x7faa30159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30136460 con 0x7faa300cbd70 2023-11-28T21:08:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30135b00 con 0x7faa3015e750 2023-11-28T21:08:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa301fa080 con 0x7faa3015e370 2023-11-28T21:08:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35732640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300cbd70 0x7faa301f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35732640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300cbd70 0x7faa301f63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38180/0 (socket says 172.21.15.6:38180) 2023-11-28T21:08:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35732640 1 -- 172.21.15.6:0/1885223195 learned_addr learned my addr 172.21.15.6:0/1885223195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35f33640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3015e750 0x7faa30159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa34f31640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3015e370 0x7faa301355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35732640 1 -- 172.21.15.6:0/1885223195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3015e370 msgr2=0x7faa301355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35732640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3015e370 0x7faa301355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35732640 1 -- 172.21.15.6:0/1885223195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3015e750 msgr2=0x7faa30159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35732640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3015e750 0x7faa30159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35732640 1 -- 172.21.15.6:0/1885223195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa200094d0 con 0x7faa300cbd70 2023-11-28T21:08:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa35732640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300cbd70 0x7faa301f63c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00d800 tx=0x7faa2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa25ffb640 1 -- 172.21.15.6:0/1885223195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00b6c0 con 0x7faa300cbd70 2023-11-28T21:08:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa25ffb640 1 -- 172.21.15.6:0/1885223195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c00b820 con 0x7faa300cbd70 2023-11-28T21:08:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa301fa360 con 0x7faa300cbd70 2023-11-28T21:08:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa25ffb640 1 -- 172.21.15.6:0/1885223195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00bb90 con 0x7faa300cbd70 2023-11-28T21:08:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa301fa920 con 0x7faa300cbd70 2023-11-28T21:08:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.559+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa30072b90 con 0x7faa300cbd70 2023-11-28T21:08:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.563+0000 7faa25ffb640 1 -- 172.21.15.6:0/1885223195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa2c00bcf0 con 0x7faa300cbd70 2023-11-28T21:08:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.563+0000 7faa25ffb640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faa14066470 0x7faa14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.563+0000 7faa25ffb640 1 -- 172.21.15.6:0/1885223195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa2c0844b0 con 0x7faa300cbd70 2023-11-28T21:08:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.563+0000 7faa34f31640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faa14066470 0x7faa14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.563+0000 7faa34f31640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faa14066470 0x7faa14068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa200b0000 tx=0x7faa20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.567+0000 7faa25ffb640 1 -- 172.21.15.6:0/1885223195 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa2c051890 con 0x7faa300cbd70 2023-11-28T21:08:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faa30068620 con 0x7faa300cbd70 2023-11-28T21:08:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa25ffb640 1 -- 172.21.15.6:0/1885223195 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7faa2c011340 con 0x7faa300cbd70 2023-11-28T21:08:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-11-28T21:08:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faa14066470 msgr2=0x7faa14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faa14066470 0x7faa14068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa200b0000 tx=0x7faa20008040 comp rx=0 tx=0).stop 2023-11-28T21:08:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300cbd70 msgr2=0x7faa301f63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300cbd70 0x7faa301f63c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00d800 tx=0x7faa2c00dcc0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 shutdown_connections 2023-11-28T21:08:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7faa14066470 0x7faa14068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3015e750 0x7faa30159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa3015e370 0x7faa301355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 --2- 172.21.15.6:0/1885223195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300cbd70 0x7faa301f63c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 >> 172.21.15.6:0/1885223195 conn(0x7faa3006a980 msgr2=0x7faa300b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 shutdown_connections 2023-11-28T21:08:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.739+0000 7faa37996640 1 -- 172.21.15.6:0/1885223195 wait complete. 2023-11-28T21:08:45.765 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:08:45.765 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:45.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:45.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.955+0000 7fdc8a13e640 1 Processor -- start 2023-11-28T21:08:45.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.955+0000 7fdc8a13e640 1 -- start start 2023-11-28T21:08:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.955+0000 7fdc8a13e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc840ad700 0x7fdc84160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.955+0000 7fdc8a13e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc840b32c0 0x7fdc84161280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.955+0000 7fdc8a13e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc84157c80 con 0x7fdc841617c0 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.955+0000 7fdc8a13e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc84161c10 con 0x7fdc840ad700 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.955+0000 7fdc8a13e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8406b590 con 0x7fdc840b32c0 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc83fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc841617c0 0x7fdc8415d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46088/0 (socket says 172.21.15.6:46088) 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc83fff640 1 -- 172.21.15.6:0/3373848603 learned_addr learned my addr 172.21.15.6:0/3373848603 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc837fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc840ad700 0x7fdc84160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc82ffd640 1 --2- 172.21.15.6:0/3373848603 >> v2:172.21.15.31:3300/0 conn(0x7fdc840b32c0 0x7fdc84161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc827fc640 1 -- 172.21.15.6:0/3373848603 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566698071 0 0) 0x7fdc84157c80 con 0x7fdc841617c0 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc837fe640 1 -- 172.21.15.6:0/3373848603 >> v2:172.21.15.31:3300/0 conn(0x7fdc840b32c0 msgr2=0x7fdc84161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc837fe640 1 --2- 172.21.15.6:0/3373848603 >> v2:172.21.15.31:3300/0 conn(0x7fdc840b32c0 0x7fdc84161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc837fe640 1 -- 172.21.15.6:0/3373848603 >> v1:172.21.15.6:6789/0 conn(0x7fdc841617c0 legacy=0x7fdc8415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc837fe640 1 -- 172.21.15.6:0/3373848603 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840adae0 con 0x7fdc840ad700 2023-11-28T21:08:45.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc82ffd640 1 --2- 172.21.15.6:0/3373848603 >> v2:172.21.15.31:3300/0 conn(0x7fdc840b32c0 0x7fdc84161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:45.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc837fe640 1 --2- 172.21.15.6:0/3373848603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc840ad700 0x7fdc84160d40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdc84160c70 tx=0x7fdc7401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3959cf0808e7ae70 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:45.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.959+0000 7fdc827fc640 1 -- 172.21.15.6:0/3373848603 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740a7070 con 0x7fdc840ad700 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc827fc640 1 -- 172.21.15.6:0/3373848603 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc740ab430 con 0x7fdc840ad700 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc827fc640 1 -- 172.21.15.6:0/3373848603 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8415e670 con 0x7fdc840ad700 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 -- 172.21.15.6:0/3373848603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc840ad700 msgr2=0x7fdc84160d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 --2- 172.21.15.6:0/3373848603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc840ad700 0x7fdc84160d40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdc84160c70 tx=0x7fdc7401c430 comp rx=0 tx=0).stop 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 -- 172.21.15.6:0/3373848603 shutdown_connections 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 --2- 172.21.15.6:0/3373848603 >> v2:172.21.15.31:3300/0 conn(0x7fdc840b32c0 0x7fdc84161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 --2- 172.21.15.6:0/3373848603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc840ad700 0x7fdc84160d40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 -- 172.21.15.6:0/3373848603 >> 172.21.15.6:0/3373848603 conn(0x7fdc840cf7b0 msgr2=0x7fdc840cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 -- 172.21.15.6:0/3373848603 shutdown_connections 2023-11-28T21:08:45.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 -- 172.21.15.6:0/3373848603 wait complete. 2023-11-28T21:08:45.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 Processor -- start 2023-11-28T21:08:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 -- start start 2023-11-28T21:08:45.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc840ad700 0x7fdc840af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc840b32c0 0x7fdc840ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841617c0 0x7fdc8406d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840b0aa0 con 0x7fdc841617c0 2023-11-28T21:08:45.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840afa00 con 0x7fdc840ad700 2023-11-28T21:08:45.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc8a13e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840afce0 con 0x7fdc840b32c0 2023-11-28T21:08:45.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841617c0 0x7fdc8406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841617c0 0x7fdc8406d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38194/0 (socket says 172.21.15.6:38194) 2023-11-28T21:08:45.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.963+0000 7fdc83fff640 1 -- 172.21.15.6:0/2948490575 learned_addr learned my addr 172.21.15.6:0/2948490575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:45.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc837fe640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc840ad700 0x7fdc840af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc82ffd640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc840b32c0 0x7fdc840ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc83fff640 1 -- 172.21.15.6:0/2948490575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc840b32c0 msgr2=0x7fdc840ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc83fff640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc840b32c0 0x7fdc840ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc83fff640 1 -- 172.21.15.6:0/2948490575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc840ad700 msgr2=0x7fdc840af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:45.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc83fff640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc840ad700 0x7fdc840af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:45.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc83fff640 1 -- 172.21.15.6:0/2948490575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74009420 con 0x7fdc841617c0 2023-11-28T21:08:45.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc83fff640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841617c0 0x7fdc8406d010 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00c700 tx=0x7fdc7c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:45.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc6bfff640 1 -- 172.21.15.6:0/2948490575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c00ce10 con 0x7fdc841617c0 2023-11-28T21:08:45.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc6bfff640 1 -- 172.21.15.6:0/2948490575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c00a640 con 0x7fdc841617c0 2023-11-28T21:08:45.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc6bfff640 1 -- 172.21.15.6:0/2948490575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c00aa70 con 0x7fdc841617c0 2023-11-28T21:08:45.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc840affc0 con 0x7fdc841617c0 2023-11-28T21:08:45.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc840b0580 con 0x7fdc841617c0 2023-11-28T21:08:45.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8406f630 con 0x7fdc841617c0 2023-11-28T21:08:45.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc6bfff640 1 -- 172.21.15.6:0/2948490575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdc7c00abd0 con 0x7fdc841617c0 2023-11-28T21:08:45.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc6bfff640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdc70066470 0x7fdc70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:45.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.967+0000 7fdc6bfff640 1 -- 172.21.15.6:0/2948490575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc7c083400 con 0x7fdc841617c0 2023-11-28T21:08:45.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.971+0000 7fdc837fe640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdc70066470 0x7fdc70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:45.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.971+0000 7fdc837fe640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdc70066470 0x7fdc70068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc740af000 tx=0x7fdc740b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:45.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:45.971+0000 7fdc6bfff640 1 -- 172.21.15.6:0/2948490575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc7c0507e0 con 0x7fdc841617c0 2023-11-28T21:08:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.131+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc84073af0 con 0x7fdc841617c0 2023-11-28T21:08:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.131+0000 7fdc6bfff640 1 -- 172.21.15.6:0/2948490575 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fdc7c018090 con 0x7fdc841617c0 2023-11-28T21:08:46.138 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:46.139 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdc70066470 msgr2=0x7fdc70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdc70066470 0x7fdc70068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc740af000 tx=0x7fdc740b6040 comp rx=0 tx=0).stop 2023-11-28T21:08:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841617c0 msgr2=0x7fdc8406d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841617c0 0x7fdc8406d010 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00c700 tx=0x7fdc7c00cbc0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 shutdown_connections 2023-11-28T21:08:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdc70066470 0x7fdc70068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc841617c0 0x7fdc8406d010 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdc840b32c0 0x7fdc840ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 --2- 172.21.15.6:0/2948490575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc840ad700 0x7fdc840af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 >> 172.21.15.6:0/2948490575 conn(0x7fdc840cf7b0 msgr2=0x7fdc84150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 shutdown_connections 2023-11-28T21:08:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.135+0000 7fdc8a13e640 1 -- 172.21.15.6:0/2948490575 wait complete. 2023-11-28T21:08:46.160 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:46.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:46.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.299+0000 7f095af57640 1 Processor -- start 2023-11-28T21:08:46.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f095af57640 1 -- start start 2023-11-28T21:08:46.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f095af57640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 0x7f095406ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f095af57640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0954157bd0 con 0x7f09540b42e0 2023-11-28T21:08:46.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f095af57640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095406b2b0 con 0x7f095415d780 2023-11-28T21:08:46.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f095af57640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095406b590 con 0x7f095415e270 2023-11-28T21:08:46.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f0953fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f09540b42e0 0x7f095406a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46094/0 (socket says 172.21.15.6:46094) 2023-11-28T21:08:46.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f0953fff640 1 -- 172.21.15.6:0/930293205 learned_addr learned my addr 172.21.15.6:0/930293205 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:46.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f09594f4640 1 --2- 172.21.15.6:0/930293205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 0x7f095406ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f09537fe640 1 -- 172.21.15.6:0/930293205 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137291961 0 0) 0x7f0954157bd0 con 0x7f09540b42e0 2023-11-28T21:08:46.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f09537fe640 1 -- 172.21.15.6:0/930293205 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0944003530 con 0x7f09540b42e0 2023-11-28T21:08:46.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f09537fe640 1 -- 172.21.15.6:0/930293205 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458929709 0 0) 0x7f095406b2b0 con 0x7f095415d780 2023-11-28T21:08:46.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f09537fe640 1 -- 172.21.15.6:0/930293205 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0954157bd0 con 0x7f095415d780 2023-11-28T21:08:46.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f09537fe640 1 -- 172.21.15.6:0/930293205 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1605268646 0 0) 0x7f0944003530 con 0x7f09540b42e0 2023-11-28T21:08:46.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f09594f4640 1 -- 172.21.15.6:0/930293205 >> v1:172.21.15.31:6789/0 conn(0x7f095415d780 legacy=0x7f095415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f09594f4640 1 -- 172.21.15.6:0/930293205 >> v1:172.21.15.6:6789/0 conn(0x7f09540b42e0 legacy=0x7f095406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.303+0000 7f09594f4640 1 -- 172.21.15.6:0/930293205 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095406b870 con 0x7f095415e270 2023-11-28T21:08:46.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f09594f4640 1 --2- 172.21.15.6:0/930293205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 0x7f095406ac90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f094c009dc0 tx=0x7f094c01c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=570657776698cee8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:46.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f09537fe640 1 -- 172.21.15.6:0/930293205 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940001680 con 0x7f095415e270 2023-11-28T21:08:46.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f09537fe640 1 -- 172.21.15.6:0/930293205 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c0a5610 con 0x7f095415e270 2023-11-28T21:08:46.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f09537fe640 1 -- 172.21.15.6:0/930293205 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c0a59a0 con 0x7f095415e270 2023-11-28T21:08:46.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f095af57640 1 -- 172.21.15.6:0/930293205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 msgr2=0x7f095406ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f095af57640 1 --2- 172.21.15.6:0/930293205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 0x7f095406ac90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f094c009dc0 tx=0x7f094c01c7d0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f095af57640 1 -- 172.21.15.6:0/930293205 shutdown_connections 2023-11-28T21:08:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f095af57640 1 --2- 172.21.15.6:0/930293205 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 0x7f095406ac90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f095af57640 1 -- 172.21.15.6:0/930293205 >> 172.21.15.6:0/930293205 conn(0x7f09540b1670 msgr2=0x7f09540b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f095af57640 1 -- 172.21.15.6:0/930293205 shutdown_connections 2023-11-28T21:08:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.307+0000 7f095af57640 1 -- 172.21.15.6:0/930293205 wait complete. 2023-11-28T21:08:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 Processor -- start 2023-11-28T21:08:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 -- start start 2023-11-28T21:08:46.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09540b42e0 0x7f0954152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095415d780 0x7f0954150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 0x7f0954151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540cbdc0 con 0x7f095415d780 2023-11-28T21:08:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0954151ad0 con 0x7f09540b42e0 2023-11-28T21:08:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0954151db0 con 0x7f095415e270 2023-11-28T21:08:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0953fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095415d780 0x7f0954150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0953fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095415d780 0x7f0954150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38208/0 (socket says 172.21.15.6:38208) 2023-11-28T21:08:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0953fff640 1 -- 172.21.15.6:0/2885835514 learned_addr learned my addr 172.21.15.6:0/2885835514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0958cf3640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09540b42e0 0x7f0954152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f09594f4640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 0x7f0954151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0953fff640 1 -- 172.21.15.6:0/2885835514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 msgr2=0x7f0954151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0953fff640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 0x7f0954151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0953fff640 1 -- 172.21.15.6:0/2885835514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09540b42e0 msgr2=0x7f0954152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0953fff640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09540b42e0 0x7f0954152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0953fff640 1 -- 172.21.15.6:0/2885835514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c009a70 con 0x7f095415d780 2023-11-28T21:08:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f0953fff640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095415d780 0x7f0954150f40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f094000c730 tx=0x7f094000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f09517fa640 1 -- 172.21.15.6:0/2885835514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940005ae0 con 0x7f095415d780 2023-11-28T21:08:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f09517fa640 1 -- 172.21.15.6:0/2885835514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0940005c40 con 0x7f095415d780 2023-11-28T21:08:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09540cba50 con 0x7f095415d780 2023-11-28T21:08:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f09517fa640 1 -- 172.21.15.6:0/2885835514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940007270 con 0x7f095415d780 2023-11-28T21:08:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.311+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09541f95e0 con 0x7f095415d780 2023-11-28T21:08:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.315+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09540727d0 con 0x7f095415d780 2023-11-28T21:08:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.315+0000 7f09517fa640 1 -- 172.21.15.6:0/2885835514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f09400075e0 con 0x7f095415d780 2023-11-28T21:08:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.315+0000 7f09517fa640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f09380664a0 0x7f0938068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.315+0000 7f09517fa640 1 -- 172.21.15.6:0/2885835514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0940083d60 con 0x7f095415d780 2023-11-28T21:08:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.315+0000 7f0958cf3640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f09380664a0 0x7f0938068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.315+0000 7f0958cf3640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f09380664a0 0x7f0938068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09480011f0 tx=0x7f0948009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.319+0000 7f09517fa640 1 -- 172.21.15.6:0/2885835514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f09400511d0 con 0x7f095415d780 2023-11-28T21:08:46.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f095404e930 con 0x7f095415d780 2023-11-28T21:08:46.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f09517fa640 1 -- 172.21.15.6:0/2885835514 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0940001a30 con 0x7f095415d780 2023-11-28T21:08:46.489 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f09380664a0 msgr2=0x7f0938068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f09380664a0 0x7f0938068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f09480011f0 tx=0x7f0948009040 comp rx=0 tx=0).stop 2023-11-28T21:08:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095415d780 msgr2=0x7f0954150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095415d780 0x7f0954150f40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f094000c730 tx=0x7f094000cbf0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 shutdown_connections 2023-11-28T21:08:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f09380664a0 0x7f0938068960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f095415e270 0x7f0954151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f095415d780 0x7f0954150f40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 --2- 172.21.15.6:0/2885835514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09540b42e0 0x7f0954152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 >> 172.21.15.6:0/2885835514 conn(0x7f09540b1670 msgr2=0x7f09540b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:46.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 shutdown_connections 2023-11-28T21:08:46.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.483+0000 7f095af57640 1 -- 172.21.15.6:0/2885835514 wait complete. 2023-11-28T21:08:46.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bfddf8640 1 Processor -- start 2023-11-28T21:08:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bfddf8640 1 -- start start 2023-11-28T21:08:46.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bfddf8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bf815e370 0x7f8bf80ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bfddf8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8bf815e750 0x7f8bf80cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bfddf8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8bf80cbd70 0x7f8bf815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bfddf8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80cc200 con 0x7f8bf815e370 2023-11-28T21:08:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bfddf8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80cd730 con 0x7f8bf815e750 2023-11-28T21:08:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bfddf8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf813d450 con 0x7f8bf80cbd70 2023-11-28T21:08:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bf77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bf815e370 0x7f8bf80ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bf77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bf815e370 0x7f8bf80ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38222/0 (socket says 172.21.15.6:38222) 2023-11-28T21:08:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bf77fe640 1 -- 172.21.15.6:0/1058626919 learned_addr learned my addr 172.21.15.6:0/1058626919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bf77fe640 1 -- 172.21.15.6:0/1058626919 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8bf80cbd70 msgr2=0x7f8bf815a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bf77fe640 1 --2- 172.21.15.6:0/1058626919 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8bf80cbd70 0x7f8bf815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bf77fe640 1 -- 172.21.15.6:0/1058626919 >> v2:172.21.15.31:3300/0 conn(0x7f8bf815e750 msgr2=0x7f8bf80cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8beffff640 1 --2- 172.21.15.6:0/1058626919 >> v2:172.21.15.31:3300/0 conn(0x7f8bf815e750 0x7f8bf80cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bf77fe640 1 --2- 172.21.15.6:0/1058626919 >> v2:172.21.15.31:3300/0 conn(0x7f8bf815e750 0x7f8bf80cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8bf77fe640 1 -- 172.21.15.6:0/1058626919 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf815b510 con 0x7f8bf815e370 2023-11-28T21:08:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.651+0000 7f8beffff640 1 --2- 172.21.15.6:0/1058626919 >> v2:172.21.15.31:3300/0 conn(0x7f8bf815e750 0x7f8bf80cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bf77fe640 1 --2- 172.21.15.6:0/1058626919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e370 0x7f8bf80ce700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80cb7e0 tx=0x7f8be801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b46bb3b34430656 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bf6ffd640 1 -- 172.21.15.6:0/1058626919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80ac410 con 0x7f8bf815e370 2023-11-28T21:08:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bf6ffd640 1 -- 172.21.15.6:0/1058626919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be80ac570 con 0x7f8bf815e370 2023-11-28T21:08:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bf6ffd640 1 -- 172.21.15.6:0/1058626919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80ac900 con 0x7f8bf815e370 2023-11-28T21:08:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bfddf8640 1 -- 172.21.15.6:0/1058626919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e370 msgr2=0x7f8bf80ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/1058626919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e370 0x7f8bf80ce700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80cb7e0 tx=0x7f8be801c500 comp rx=0 tx=0).stop 2023-11-28T21:08:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bfddf8640 1 -- 172.21.15.6:0/1058626919 shutdown_connections 2023-11-28T21:08:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/1058626919 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8bf80cbd70 0x7f8bf815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/1058626919 >> v2:172.21.15.31:3300/0 conn(0x7f8bf815e750 0x7f8bf80cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/1058626919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e370 0x7f8bf80ce700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bfddf8640 1 -- 172.21.15.6:0/1058626919 >> 172.21.15.6:0/1058626919 conn(0x7f8bf806a980 msgr2=0x7f8bf806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bfddf8640 1 -- 172.21.15.6:0/1058626919 shutdown_connections 2023-11-28T21:08:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.655+0000 7f8bfddf8640 1 -- 172.21.15.6:0/1058626919 wait complete. 2023-11-28T21:08:46.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 Processor -- start 2023-11-28T21:08:46.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 -- start start 2023-11-28T21:08:46.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bf80cbd70 0x7f8bf81697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8bf815e370 0x7f8bf80b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e750 0x7f8bf8135750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81688f0 con 0x7f8bf815e750 2023-11-28T21:08:46.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81693e0 con 0x7f8bf80cbd70 2023-11-28T21:08:46.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8168b40 con 0x7f8bf815e370 2023-11-28T21:08:46.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e750 0x7f8bf8135750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8beffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8bf815e370 0x7f8bf80b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bf80cbd70 0x7f8bf81697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e750 0x7f8bf8135750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38230/0 (socket says 172.21.15.6:38230) 2023-11-28T21:08:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf7fff640 1 -- 172.21.15.6:0/4136253418 learned_addr learned my addr 172.21.15.6:0/4136253418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf7fff640 1 -- 172.21.15.6:0/4136253418 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8bf815e370 msgr2=0x7f8bf80b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf7fff640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8bf815e370 0x7f8bf80b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf7fff640 1 -- 172.21.15.6:0/4136253418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bf80cbd70 msgr2=0x7f8bf81697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf7fff640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bf80cbd70 0x7f8bf81697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf7fff640 1 -- 172.21.15.6:0/4136253418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be80094d0 con 0x7f8bf815e750 2023-11-28T21:08:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf7fff640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e750 0x7f8bf8135750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000b970 tx=0x7f8bf000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf4ff9640 1 -- 172.21.15.6:0/4136253418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000cb40 con 0x7f8bf815e750 2023-11-28T21:08:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf8168e20 con 0x7f8bf815e750 2023-11-28T21:08:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf4ff9640 1 -- 172.21.15.6:0/4136253418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf000ccc0 con 0x7f8bf815e750 2023-11-28T21:08:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bf4ff9640 1 -- 172.21.15.6:0/4136253418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0014680 con 0x7f8bf815e750 2023-11-28T21:08:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.659+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf8169d00 con 0x7f8bf815e750 2023-11-28T21:08:46.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.663+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf8135470 con 0x7f8bf815e750 2023-11-28T21:08:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.663+0000 7f8bf4ff9640 1 -- 172.21.15.6:0/4136253418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8bf001d3b0 con 0x7f8bf815e750 2023-11-28T21:08:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.663+0000 7f8bf4ff9640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8bd8066470 0x7f8bd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.663+0000 7f8bf4ff9640 1 -- 172.21.15.6:0/4136253418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bf0083e40 con 0x7f8bf815e750 2023-11-28T21:08:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.663+0000 7f8bf77fe640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8bd8066470 0x7f8bd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.663+0000 7f8bf77fe640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8bd8066470 0x7f8bd8068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8be80ae000 tx=0x7f8be8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.667+0000 7f8bf4ff9640 1 -- 172.21.15.6:0/4136253418 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bf8135470 con 0x7f8bf815e750 2023-11-28T21:08:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.827+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8bf8135430 con 0x7f8bf815e750 2023-11-28T21:08:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.827+0000 7f8bf4ff9640 1 -- 172.21.15.6:0/4136253418 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8bf0051250 con 0x7f8bf815e750 2023-11-28T21:08:46.834 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8bd8066470 msgr2=0x7f8bd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8bd8066470 0x7f8bd8068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8be80ae000 tx=0x7f8be8008040 comp rx=0 tx=0).stop 2023-11-28T21:08:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e750 msgr2=0x7f8bf8135750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e750 0x7f8bf8135750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000b970 tx=0x7f8bf000be30 comp rx=0 tx=0).stop 2023-11-28T21:08:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 shutdown_connections 2023-11-28T21:08:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8bd8066470 0x7f8bd8068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf815e750 0x7f8bf8135750 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8bf815e370 0x7f8bf80b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 --2- 172.21.15.6:0/4136253418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bf80cbd70 0x7f8bf81697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 >> 172.21.15.6:0/4136253418 conn(0x7f8bf806a980 msgr2=0x7f8bf815b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 shutdown_connections 2023-11-28T21:08:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.831+0000 7f8bfddf8640 1 -- 172.21.15.6:0/4136253418 wait complete. 2023-11-28T21:08:46.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:47.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e6df8640 1 Processor -- start 2023-11-28T21:08:47.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e6df8640 1 -- start start 2023-11-28T21:08:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e6df8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e370 0x7fe1e00ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e6df8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1e015e750 0x7fe1e00cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e6df8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e00cc1d0 con 0x7fe1e00cbd70 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e6df8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e00cd730 con 0x7fe1e015e750 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e6df8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e013d450 con 0x7fe1e015e370 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1e015e750 0x7fe1e00cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e5395640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe1e00cbd70 0x7fe1e015a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46102/0 (socket says 172.21.15.6:46102) 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e5395640 1 -- 172.21.15.6:0/703201954 learned_addr learned my addr 172.21.15.6:0/703201954 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e4b94640 1 --2- 172.21.15.6:0/703201954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e370 0x7fe1e00ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1dffff640 1 -- 172.21.15.6:0/703201954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e370 msgr2=0x7fe1e00ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1dffff640 1 --2- 172.21.15.6:0/703201954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e370 0x7fe1e00ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1dffff640 1 -- 172.21.15.6:0/703201954 >> v1:172.21.15.6:6789/0 conn(0x7fe1e00cbd70 legacy=0x7fe1e015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1dffff640 1 -- 172.21.15.6:0/703201954 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e015b510 con 0x7fe1e015e750 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1e4b94640 1 --2- 172.21.15.6:0/703201954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e370 0x7fe1e00ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:46.999+0000 7fe1df7fe640 1 -- 172.21.15.6:0/703201954 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291337223 0 0) 0x7fe1e00cc1d0 con 0x7fe1e00cbd70 2023-11-28T21:08:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1dffff640 1 --2- 172.21.15.6:0/703201954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e750 0x7fe1e00cb830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0097c0 tx=0x7fe1cc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa97a5a2e9b73ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1df7fe640 1 -- 172.21.15.6:0/703201954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0ab600 con 0x7fe1e015e750 2023-11-28T21:08:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1df7fe640 1 -- 172.21.15.6:0/703201954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0a7050 con 0x7fe1e015e750 2023-11-28T21:08:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1df7fe640 1 -- 172.21.15.6:0/703201954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0ab980 con 0x7fe1e015e750 2023-11-28T21:08:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 -- 172.21.15.6:0/703201954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e750 msgr2=0x7fe1e00cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 --2- 172.21.15.6:0/703201954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e750 0x7fe1e00cb830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0097c0 tx=0x7fe1cc01c3f0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 -- 172.21.15.6:0/703201954 shutdown_connections 2023-11-28T21:08:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 --2- 172.21.15.6:0/703201954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e750 0x7fe1e00cb830 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 --2- 172.21.15.6:0/703201954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e370 0x7fe1e00ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 -- 172.21.15.6:0/703201954 >> 172.21.15.6:0/703201954 conn(0x7fe1e006a980 msgr2=0x7fe1e006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:47.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 -- 172.21.15.6:0/703201954 shutdown_connections 2023-11-28T21:08:47.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 -- 172.21.15.6:0/703201954 wait complete. 2023-11-28T21:08:47.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 Processor -- start 2023-11-28T21:08:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.003+0000 7fe1e6df8640 1 -- start start 2023-11-28T21:08:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e6df8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e00cbd70 0x7fe1e00abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e6df8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e370 0x7fe1e013b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e6df8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e750 0x7fe1e015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e6df8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00ac0c0 con 0x7fe1e015e370 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e6df8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00a8870 con 0x7fe1e00cbd70 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e6df8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00a8b50 con 0x7fe1e015e750 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e370 0x7fe1e013b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e370 0x7fe1e013b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38246/0 (socket says 172.21.15.6:38246) 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dffff640 1 -- 172.21.15.6:0/997063157 learned_addr learned my addr 172.21.15.6:0/997063157 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e5395640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e750 0x7fe1e015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e4b94640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e00cbd70 0x7fe1e00abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dffff640 1 -- 172.21.15.6:0/997063157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e750 msgr2=0x7fe1e015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dffff640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e750 0x7fe1e015c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dffff640 1 -- 172.21.15.6:0/997063157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e00cbd70 msgr2=0x7fe1e00abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dffff640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e00cbd70 0x7fe1e00abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dffff640 1 -- 172.21.15.6:0/997063157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc009420 con 0x7fe1e015e370 2023-11-28T21:08:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dffff640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e370 0x7fe1e013b960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc01a020 tx=0x7fe1cc019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dd7fa640 1 -- 172.21.15.6:0/997063157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0b4600 con 0x7fe1e015e370 2023-11-28T21:08:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dd7fa640 1 -- 172.21.15.6:0/997063157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0b4780 con 0x7fe1e015e370 2023-11-28T21:08:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1dd7fa640 1 -- 172.21.15.6:0/997063157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0b4b30 con 0x7fe1e015e370 2023-11-28T21:08:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e00a8e30 con 0x7fe1e015e370 2023-11-28T21:08:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e00a93f0 con 0x7fe1e015e370 2023-11-28T21:08:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.007+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e00a95e0 con 0x7fe1e015e370 2023-11-28T21:08:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.011+0000 7fe1dd7fa640 1 -- 172.21.15.6:0/997063157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1cc0b2040 con 0x7fe1e015e370 2023-11-28T21:08:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.011+0000 7fe1dd7fa640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe1c4066470 0x7fe1c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.011+0000 7fe1dd7fa640 1 -- 172.21.15.6:0/997063157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1cc11df90 con 0x7fe1e015e370 2023-11-28T21:08:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.011+0000 7fe1e4b94640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe1c4066470 0x7fe1c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.011+0000 7fe1e4b94640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe1c4066470 0x7fe1c4068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400ab60 tx=0x7fe1d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:47.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.015+0000 7fe1dd7fa640 1 -- 172.21.15.6:0/997063157 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1cc0eb420 con 0x7fe1e015e370 2023-11-28T21:08:47.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.171+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1e0072b90 con 0x7fe1e015e370 2023-11-28T21:08:47.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.171+0000 7fe1dd7fa640 1 -- 172.21.15.6:0/997063157 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1cc0eea40 con 0x7fe1e015e370 2023-11-28T21:08:47.178 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:47.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe1c4066470 msgr2=0x7fe1c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe1c4066470 0x7fe1c4068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400ab60 tx=0x7fe1d4008040 comp rx=0 tx=0).stop 2023-11-28T21:08:47.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e370 msgr2=0x7fe1e013b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e370 0x7fe1e013b960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc01a020 tx=0x7fe1cc019190 comp rx=0 tx=0).stop 2023-11-28T21:08:47.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 shutdown_connections 2023-11-28T21:08:47.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe1c4066470 0x7fe1c4068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1e015e750 0x7fe1e015c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1e015e370 0x7fe1e013b960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 --2- 172.21.15.6:0/997063157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1e00cbd70 0x7fe1e00abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 >> 172.21.15.6:0/997063157 conn(0x7fe1e006a980 msgr2=0x7fe1e00af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:47.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 shutdown_connections 2023-11-28T21:08:47.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.175+0000 7fe1e6df8640 1 -- 172.21.15.6:0/997063157 wait complete. 2023-11-28T21:08:47.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T21:08:47.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.339+0000 7ff189c9f640 1 Processor -- start 2023-11-28T21:08:47.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.339+0000 7ff189c9f640 1 -- start start 2023-11-28T21:08:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff189c9f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 0x7ff1840b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff189c9f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1840cb340 0x7ff184161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff189c9f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1840cee80 con 0x7ff184161a60 2023-11-28T21:08:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff189c9f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1840b2170 con 0x7ff1840cb340 2023-11-28T21:08:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff189c9f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18406c0a0 con 0x7ff184161140 2023-11-28T21:08:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff183fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1840cb340 0x7ff184161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff183fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1840cb340 0x7ff184161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38254/0 (socket says 172.21.15.6:38254) 2023-11-28T21:08:47.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff183fff640 1 -- 172.21.15.6:0/952166276 learned_addr learned my addr 172.21.15.6:0/952166276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:47.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff188c9d640 1 --2- 172.21.15.6:0/952166276 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 0x7ff1840b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff183fff640 1 -- 172.21.15.6:0/952166276 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 msgr2=0x7ff1840b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:47.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff183fff640 1 --2- 172.21.15.6:0/952166276 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 0x7ff1840b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff183fff640 1 -- 172.21.15.6:0/952166276 >> v1:172.21.15.31:6789/0 conn(0x7ff184161a60 legacy=0x7ff18415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff183fff640 1 -- 172.21.15.6:0/952166276 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1840cb7a0 con 0x7ff1840cb340 2023-11-28T21:08:47.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.343+0000 7ff183fff640 1 --2- 172.21.15.6:0/952166276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 0x7ff184161520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff170009870 tx=0x7ff17001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e925a49ba820e8bc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:47.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff1837fe640 1 -- 172.21.15.6:0/952166276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1700ab620 con 0x7ff1840cb340 2023-11-28T21:08:47.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff1837fe640 1 -- 172.21.15.6:0/952166276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1700ab780 con 0x7ff1840cb340 2023-11-28T21:08:47.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff1837fe640 1 -- 172.21.15.6:0/952166276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1700abb10 con 0x7ff1840cb340 2023-11-28T21:08:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 -- 172.21.15.6:0/952166276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 msgr2=0x7ff184161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 --2- 172.21.15.6:0/952166276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 0x7ff184161520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff170009870 tx=0x7ff17001c510 comp rx=0 tx=0).stop 2023-11-28T21:08:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 -- 172.21.15.6:0/952166276 shutdown_connections 2023-11-28T21:08:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 --2- 172.21.15.6:0/952166276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 0x7ff184161520 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 --2- 172.21.15.6:0/952166276 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 0x7ff1840b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 -- 172.21.15.6:0/952166276 >> 172.21.15.6:0/952166276 conn(0x7ff1840b2800 msgr2=0x7ff1840b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 -- 172.21.15.6:0/952166276 shutdown_connections 2023-11-28T21:08:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 -- 172.21.15.6:0/952166276 wait complete. 2023-11-28T21:08:47.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 Processor -- start 2023-11-28T21:08:47.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 -- start start 2023-11-28T21:08:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 0x7ff1840b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 0x7ff1840ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff184161a60 0x7ff18414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840c8870 con 0x7ff1840cb340 2023-11-28T21:08:47.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840c8b50 con 0x7ff184161a60 2023-11-28T21:08:47.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.347+0000 7ff189c9f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1840c8e30 con 0x7ff184161140 2023-11-28T21:08:47.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff188c9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 0x7ff1840b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff188c9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 0x7ff1840b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38266/0 (socket says 172.21.15.6:38266) 2023-11-28T21:08:47.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff188c9d640 1 -- 172.21.15.6:0/2157404198 learned_addr learned my addr 172.21.15.6:0/2157404198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff18949e640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff184161a60 0x7ff18414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff183fff640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 0x7ff1840ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff188c9d640 1 -- 172.21.15.6:0/2157404198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 msgr2=0x7ff1840ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff188c9d640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 0x7ff1840ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff188c9d640 1 -- 172.21.15.6:0/2157404198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff184161a60 msgr2=0x7ff18414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff188c9d640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff184161a60 0x7ff18414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff188c9d640 1 -- 172.21.15.6:0/2157404198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1700094d0 con 0x7ff1840cb340 2023-11-28T21:08:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff188c9d640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 0x7ff1840b3b70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff17800d800 tx=0x7ff17800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff1817fa640 1 -- 172.21.15.6:0/2157404198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17800b6c0 con 0x7ff1840cb340 2023-11-28T21:08:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff1817fa640 1 -- 172.21.15.6:0/2157404198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17800b820 con 0x7ff1840cb340 2023-11-28T21:08:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1840c9110 con 0x7ff1840cb340 2023-11-28T21:08:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff1817fa640 1 -- 172.21.15.6:0/2157404198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17800bb90 con 0x7ff1840cb340 2023-11-28T21:08:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18414fb70 con 0x7ff1840cb340 2023-11-28T21:08:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1840702c0 con 0x7ff1840cb340 2023-11-28T21:08:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff1817fa640 1 -- 172.21.15.6:0/2157404198 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff17800bcf0 con 0x7ff1840cb340 2023-11-28T21:08:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.351+0000 7ff1817fa640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff168066470 0x7ff168068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.355+0000 7ff1817fa640 1 -- 172.21.15.6:0/2157404198 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff178084280 con 0x7ff1840cb340 2023-11-28T21:08:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.355+0000 7ff183fff640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff168066470 0x7ff168068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.355+0000 7ff183fff640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff168066470 0x7ff168068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff1700af000 tx=0x7ff1700b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.355+0000 7ff1817fa640 1 -- 172.21.15.6:0/2157404198 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff1780517b0 con 0x7ff1840cb340 2023-11-28T21:08:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.527+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff18404e850 con 0x7ff1840cb340 2023-11-28T21:08:47.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.527+0000 7ff1817fa640 1 -- 172.21.15.6:0/2157404198 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff178054dd0 con 0x7ff1840cb340 2023-11-28T21:08:47.535 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-11-28T21:08:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff168066470 msgr2=0x7ff168068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff168066470 0x7ff168068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff1700af000 tx=0x7ff1700b6040 comp rx=0 tx=0).stop 2023-11-28T21:08:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 msgr2=0x7ff1840b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 0x7ff1840b3b70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff17800d800 tx=0x7ff17800dcc0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 shutdown_connections 2023-11-28T21:08:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff168066470 0x7ff168068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff184161a60 0x7ff18414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff184161140 0x7ff1840ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 --2- 172.21.15.6:0/2157404198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1840cb340 0x7ff1840b3b70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 >> 172.21.15.6:0/2157404198 conn(0x7ff1840b2800 msgr2=0x7ff18406e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:47.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 shutdown_connections 2023-11-28T21:08:47.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.531+0000 7ff189c9f640 1 -- 172.21.15.6:0/2157404198 wait complete. 2023-11-28T21:08:47.558 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-11-28T21:08:47.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:47.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-28T21:08:47.591 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:08:47.592 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-11-28T21:08:47.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:47.592 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T21:08:47.651 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:08:47.651 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:47.664 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:08:47.664 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:47.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:47.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f257a50f640 1 Processor -- start 2023-11-28T21:08:47.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f257a50f640 1 -- start start 2023-11-28T21:08:47.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f257a50f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25740d1880 0x7f25741605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f257a50f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25740aff60 con 0x7f25740b1d30 2023-11-28T21:08:47.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f257a50f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25740b0240 con 0x7f25740b2550 2023-11-28T21:08:47.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f257a50f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25740b0520 con 0x7f25740d1880 2023-11-28T21:08:47.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f2578aac640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f25740b1d30 0x7f25740b31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46110/0 (socket says 172.21.15.6:46110) 2023-11-28T21:08:47.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f2578aac640 1 -- 172.21.15.6:0/872326204 learned_addr learned my addr 172.21.15.6:0/872326204 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:47.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f2573fff640 1 --2- 172.21.15.6:0/872326204 >> v2:172.21.15.31:3300/0 conn(0x7f25740d1880 0x7f25741605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f2572ffd640 1 -- 172.21.15.6:0/872326204 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073493305 0 0) 0x7f25740aff60 con 0x7f25740b1d30 2023-11-28T21:08:47.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f2572ffd640 1 -- 172.21.15.6:0/872326204 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f255c003530 con 0x7f25740b1d30 2023-11-28T21:08:47.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f2573fff640 1 -- 172.21.15.6:0/872326204 >> v1:172.21.15.31:6789/0 conn(0x7f25740b2550 legacy=0x7f25740b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f2573fff640 1 -- 172.21.15.6:0/872326204 >> v1:172.21.15.6:6789/0 conn(0x7f25740b1d30 legacy=0x7f25740b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.859+0000 7f2573fff640 1 -- 172.21.15.6:0/872326204 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25740b0800 con 0x7f25740d1880 2023-11-28T21:08:47.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f2573fff640 1 --2- 172.21.15.6:0/872326204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25740d1880 0x7f25741605c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25640097c0 tx=0x7f256401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de560456c9193ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:47.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f2572ffd640 1 -- 172.21.15.6:0/872326204 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25640a6040 con 0x7f25740d1880 2023-11-28T21:08:47.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f2572ffd640 1 -- 172.21.15.6:0/872326204 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25640aa600 con 0x7f25740d1880 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f2572ffd640 1 -- 172.21.15.6:0/872326204 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25640aa990 con 0x7f25740d1880 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f257a50f640 1 -- 172.21.15.6:0/872326204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25740d1880 msgr2=0x7f25741605c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f257a50f640 1 --2- 172.21.15.6:0/872326204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25740d1880 0x7f25741605c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25640097c0 tx=0x7f256401c480 comp rx=0 tx=0).stop 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f257a50f640 1 -- 172.21.15.6:0/872326204 shutdown_connections 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f257a50f640 1 --2- 172.21.15.6:0/872326204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25740d1880 0x7f25741605c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f257a50f640 1 -- 172.21.15.6:0/872326204 >> 172.21.15.6:0/872326204 conn(0x7f257409c460 msgr2=0x7f25740d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f257a50f640 1 -- 172.21.15.6:0/872326204 shutdown_connections 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.863+0000 7f257a50f640 1 -- 172.21.15.6:0/872326204 wait complete. 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 Processor -- start 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 -- start start 2023-11-28T21:08:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740b1d30 0x7f257406be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25740b2550 0x7f25740b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25740d1880 0x7f25740c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25740b7d10 con 0x7f25740b1d30 2023-11-28T21:08:47.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25740b7ff0 con 0x7f25740d1880 2023-11-28T21:08:47.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25740b82d0 con 0x7f25740b2550 2023-11-28T21:08:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2573fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740b1d30 0x7f257406be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2573fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740b1d30 0x7f257406be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38274/0 (socket says 172.21.15.6:38274) 2023-11-28T21:08:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2573fff640 1 -- 172.21.15.6:0/4126131356 learned_addr learned my addr 172.21.15.6:0/4126131356 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2578aac640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25740d1880 0x7f25740c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f25737fe640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25740b2550 0x7f25740b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2573fff640 1 -- 172.21.15.6:0/4126131356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25740b2550 msgr2=0x7f25740b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2573fff640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25740b2550 0x7f25740b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2573fff640 1 -- 172.21.15.6:0/4126131356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25740d1880 msgr2=0x7f25740c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2573fff640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25740d1880 0x7f25740c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2573fff640 1 -- 172.21.15.6:0/4126131356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564009420 con 0x7f25740b1d30 2023-11-28T21:08:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f25737fe640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25740b2550 0x7f25740b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2573fff640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740b1d30 0x7f257406be60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f256401a0b0 tx=0x7f256401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2570ff9640 1 -- 172.21.15.6:0/4126131356 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25640b3600 con 0x7f25740b1d30 2023-11-28T21:08:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2570ff9640 1 -- 172.21.15.6:0/4126131356 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25640b3780 con 0x7f25740b1d30 2023-11-28T21:08:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25740b85b0 con 0x7f25740b1d30 2023-11-28T21:08:47.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f2570ff9640 1 -- 172.21.15.6:0/4126131356 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25640b3b30 con 0x7f25740b1d30 2023-11-28T21:08:47.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2574158710 con 0x7f25740b1d30 2023-11-28T21:08:47.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.867+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25740b8410 con 0x7f25740b1d30 2023-11-28T21:08:47.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.871+0000 7f2570ff9640 1 -- 172.21.15.6:0/4126131356 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25740d3c60 con 0x7f25740b1d30 2023-11-28T21:08:47.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.871+0000 7f2570ff9640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2560066470 0x7f2560068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:47.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.871+0000 7f2570ff9640 1 -- 172.21.15.6:0/4126131356 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f256411d9b0 con 0x7f25740b1d30 2023-11-28T21:08:47.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.871+0000 7f25737fe640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2560066470 0x7f2560068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:47.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.871+0000 7f25737fe640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2560066470 0x7f2560068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2574158430 tx=0x7f2568009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:47.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:47.875+0000 7f2570ff9640 1 -- 172.21.15.6:0/4126131356 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25740b8410 con 0x7f25740b1d30 2023-11-28T21:08:48.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.031+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25740b8410 con 0x7f25740b1d30 2023-11-28T21:08:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f2570ff9640 1 -- 172.21.15.6:0/4126131356 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f25740b8410 con 0x7f25740b1d30 2023-11-28T21:08:48.040 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:48.041 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2560066470 msgr2=0x7f2560068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2560066470 0x7f2560068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2574158430 tx=0x7f2568009040 comp rx=0 tx=0).stop 2023-11-28T21:08:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740b1d30 msgr2=0x7f257406be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740b1d30 0x7f257406be60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f256401a0b0 tx=0x7f256401acc0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 shutdown_connections 2023-11-28T21:08:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2560066470 0x7f2560068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25740d1880 0x7f25740c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25740b2550 0x7f25740b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 --2- 172.21.15.6:0/4126131356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740b1d30 0x7f257406be60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 >> 172.21.15.6:0/4126131356 conn(0x7f257409c460 msgr2=0x7f257406c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:48.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 shutdown_connections 2023-11-28T21:08:48.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.035+0000 7f257a50f640 1 -- 172.21.15.6:0/4126131356 wait complete. 2023-11-28T21:08:48.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:48.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.203+0000 7fc091fd1640 1 Processor -- start 2023-11-28T21:08:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.203+0000 7fc091fd1640 1 -- start start 2023-11-28T21:08:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc091fd1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc08c06ca00 0x7fc08c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc091fd1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc08c06cde0 0x7fc08c15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc091fd1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c0cc930 con 0x7fc08c15c270 2023-11-28T21:08:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc091fd1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c0cd400 con 0x7fc08c06ca00 2023-11-28T21:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc091fd1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c15c6e0 con 0x7fc08c06cde0 2023-11-28T21:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc08c06ca00 0x7fc08c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc08c06ca00 0x7fc08c0cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38284/0 (socket says 172.21.15.6:38284) 2023-11-28T21:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc08c15c270 0x7fc08c15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46118/0 (socket says 172.21.15.6:46118) 2023-11-28T21:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08b7fe640 1 -- 172.21.15.6:0/3553161639 learned_addr learned my addr 172.21.15.6:0/3553161639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08affd640 1 --2- 172.21.15.6:0/3553161639 >> v2:172.21.15.31:3300/0 conn(0x7fc08c06cde0 0x7fc08c15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08b7fe640 1 -- 172.21.15.6:0/3553161639 >> v2:172.21.15.31:3300/0 conn(0x7fc08c06cde0 msgr2=0x7fc08c15bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08b7fe640 1 --2- 172.21.15.6:0/3553161639 >> v2:172.21.15.31:3300/0 conn(0x7fc08c06cde0 0x7fc08c15bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08b7fe640 1 -- 172.21.15.6:0/3553161639 >> v1:172.21.15.6:6789/0 conn(0x7fc08c15c270 legacy=0x7fc08c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08b7fe640 1 -- 172.21.15.6:0/3553161639 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c0ccb60 con 0x7fc08c06ca00 2023-11-28T21:08:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08affd640 1 --2- 172.21.15.6:0/3553161639 >> v2:172.21.15.31:3300/0 conn(0x7fc08c06cde0 0x7fc08c15bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.207+0000 7fc08a7fc640 1 -- 172.21.15.6:0/3553161639 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003725390 0 0) 0x7fc08c0cc930 con 0x7fc08c15c270 2023-11-28T21:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc08b7fe640 1 --2- 172.21.15.6:0/3553161639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06ca00 0x7fc08c0cc3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009870 tx=0x7fc07c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a06acf3b0709ff2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc08a7fc640 1 -- 172.21.15.6:0/3553161639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0ab640 con 0x7fc08c06ca00 2023-11-28T21:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc08a7fc640 1 -- 172.21.15.6:0/3553161639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c0a7070 con 0x7fc08c06ca00 2023-11-28T21:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc08a7fc640 1 -- 172.21.15.6:0/3553161639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0ab9c0 con 0x7fc08c06ca00 2023-11-28T21:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 -- 172.21.15.6:0/3553161639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06ca00 msgr2=0x7fc08c0cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 --2- 172.21.15.6:0/3553161639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06ca00 0x7fc08c0cc3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009870 tx=0x7fc07c01c440 comp rx=0 tx=0).stop 2023-11-28T21:08:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 -- 172.21.15.6:0/3553161639 shutdown_connections 2023-11-28T21:08:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 --2- 172.21.15.6:0/3553161639 >> v2:172.21.15.31:3300/0 conn(0x7fc08c06cde0 0x7fc08c15bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 --2- 172.21.15.6:0/3553161639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06ca00 0x7fc08c0cc3f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 -- 172.21.15.6:0/3553161639 >> 172.21.15.6:0/3553161639 conn(0x7fc08c06a980 msgr2=0x7fc08c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 -- 172.21.15.6:0/3553161639 shutdown_connections 2023-11-28T21:08:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 -- 172.21.15.6:0/3553161639 wait complete. 2023-11-28T21:08:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 Processor -- start 2023-11-28T21:08:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.211+0000 7fc091fd1640 1 -- start start 2023-11-28T21:08:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc091fd1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc08c06ca00 0x7fc08c14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc091fd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06cde0 0x7fc08c155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc091fd1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc08c15c270 0x7fc08c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc091fd1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c14ada0 con 0x7fc08c06cde0 2023-11-28T21:08:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc091fd1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c1fdb70 con 0x7fc08c06ca00 2023-11-28T21:08:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc091fd1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0b28a0 con 0x7fc08c15c270 2023-11-28T21:08:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06cde0 0x7fc08c155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06cde0 0x7fc08c155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38286/0 (socket says 172.21.15.6:38286) 2023-11-28T21:08:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08affd640 1 -- 172.21.15.6:0/2153463888 learned_addr learned my addr 172.21.15.6:0/2153463888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08b7fe640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc08c06ca00 0x7fc08c14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08bfff640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc08c15c270 0x7fc08c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08affd640 1 -- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc08c15c270 msgr2=0x7fc08c152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08affd640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc08c15c270 0x7fc08c152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08affd640 1 -- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc08c06ca00 msgr2=0x7fc08c14a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08affd640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc08c06ca00 0x7fc08c14a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08affd640 1 -- 172.21.15.6:0/2153463888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0094d0 con 0x7fc08c06cde0 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08b7fe640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc08c06ca00 0x7fc08c14a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08bfff640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc08c15c270 0x7fc08c152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc08affd640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06cde0 0x7fc08c155220 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc08000e810 tx=0x7fc08000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc073fff640 1 -- 172.21.15.6:0/2153463888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000c8d0 con 0x7fc08c06cde0 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc073fff640 1 -- 172.21.15.6:0/2153463888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08000ca30 con 0x7fc08c06cde0 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c0b2b80 con 0x7fc08c06cde0 2023-11-28T21:08:48.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc073fff640 1 -- 172.21.15.6:0/2153463888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000cdc0 con 0x7fc08c06cde0 2023-11-28T21:08:48.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c0b3140 con 0x7fc08c06cde0 2023-11-28T21:08:48.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.215+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c072b90 con 0x7fc08c06cde0 2023-11-28T21:08:48.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.219+0000 7fc073fff640 1 -- 172.21.15.6:0/2153463888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc080013410 con 0x7fc08c06cde0 2023-11-28T21:08:48.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.219+0000 7fc073fff640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc0780664a0 0x7fc078068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.219+0000 7fc073fff640 1 -- 172.21.15.6:0/2153463888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc080083c80 con 0x7fc08c06cde0 2023-11-28T21:08:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.219+0000 7fc08b7fe640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc0780664a0 0x7fc078068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.219+0000 7fc08b7fe640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc0780664a0 0x7fc078068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0af000 tx=0x7fc07c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:48.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.223+0000 7fc073fff640 1 -- 172.21.15.6:0/2153463888 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc080051100 con 0x7fc08c06cde0 2023-11-28T21:08:48.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.379+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc08c0cc8a0 con 0x7fc08c06cde0 2023-11-28T21:08:48.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc073fff640 1 -- 172.21.15.6:0/2153463888 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc080009480 con 0x7fc08c06cde0 2023-11-28T21:08:48.388 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:48.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc0780664a0 msgr2=0x7fc078068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc0780664a0 0x7fc078068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0af000 tx=0x7fc07c008040 comp rx=0 tx=0).stop 2023-11-28T21:08:48.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06cde0 msgr2=0x7fc08c155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06cde0 0x7fc08c155220 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc08000e810 tx=0x7fc08000ecd0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 shutdown_connections 2023-11-28T21:08:48.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc0780664a0 0x7fc078068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc08c15c270 0x7fc08c152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08c06cde0 0x7fc08c155220 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 --2- 172.21.15.6:0/2153463888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc08c06ca00 0x7fc08c14a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 >> 172.21.15.6:0/2153463888 conn(0x7fc08c06a980 msgr2=0x7fc08c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:48.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 shutdown_connections 2023-11-28T21:08:48.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.383+0000 7fc091fd1640 1 -- 172.21.15.6:0/2153463888 wait complete. 2023-11-28T21:08:48.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:48.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0ca2632640 1 Processor -- start 2023-11-28T21:08:48.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0ca2632640 1 -- start start 2023-11-28T21:08:48.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0ca2632640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c9c06ca00 0x7f0c9c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0ca2632640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c9c06cde0 0x7f0c9c15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0ca2632640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c9c0cc930 con 0x7f0c9c15c270 2023-11-28T21:08:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0ca2632640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c0cd400 con 0x7f0c9c06ca00 2023-11-28T21:08:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0ca2632640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c9c15c6e0 con 0x7f0c9c06cde0 2023-11-28T21:08:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0c9bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0c9c06ca00 0x7f0c9c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0ca0bcf640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c9c15c270 0x7f0c9c15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34628/0 (socket says 172.21.15.6:34628) 2023-11-28T21:08:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.551+0000 7f0ca0bcf640 1 -- 172.21.15.6:0/3790733708 learned_addr learned my addr 172.21.15.6:0/3790733708 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9b7fe640 1 --2- 172.21.15.6:0/3790733708 >> v2:172.21.15.31:3300/0 conn(0x7f0c9c06cde0 0x7f0c9c15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9bfff640 1 -- 172.21.15.6:0/3790733708 >> v2:172.21.15.31:3300/0 conn(0x7f0c9c06cde0 msgr2=0x7f0c9c15bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:48.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9bfff640 1 --2- 172.21.15.6:0/3790733708 >> v2:172.21.15.31:3300/0 conn(0x7f0c9c06cde0 0x7f0c9c15bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9bfff640 1 -- 172.21.15.6:0/3790733708 >> v1:172.21.15.6:6789/0 conn(0x7f0c9c15c270 legacy=0x7f0c9c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9bfff640 1 -- 172.21.15.6:0/3790733708 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0ccb60 con 0x7f0c9c06ca00 2023-11-28T21:08:48.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9affd640 1 -- 172.21.15.6:0/3790733708 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478663346 0 0) 0x7f0c9c0cc930 con 0x7f0c9c15c270 2023-11-28T21:08:48.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9b7fe640 1 --2- 172.21.15.6:0/3790733708 >> v2:172.21.15.31:3300/0 conn(0x7f0c9c06cde0 0x7f0c9c15bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9bfff640 1 --2- 172.21.15.6:0/3790733708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06ca00 0x7f0c9c0cc3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097c0 tx=0x7f0c8c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69035aa8925e222b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:48.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9affd640 1 -- 172.21.15.6:0/3790733708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c0ad680 con 0x7f0c9c06ca00 2023-11-28T21:08:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9affd640 1 -- 172.21.15.6:0/3790733708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c0ad7e0 con 0x7f0c9c06ca00 2023-11-28T21:08:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0c9affd640 1 -- 172.21.15.6:0/3790733708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c0adb70 con 0x7f0c9c06ca00 2023-11-28T21:08:48.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0ca2632640 1 -- 172.21.15.6:0/3790733708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06ca00 msgr2=0x7f0c9c0cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.555+0000 7f0ca2632640 1 --2- 172.21.15.6:0/3790733708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06ca00 0x7f0c9c0cc3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097c0 tx=0x7f0c8c01c380 comp rx=0 tx=0).stop 2023-11-28T21:08:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 -- 172.21.15.6:0/3790733708 shutdown_connections 2023-11-28T21:08:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 --2- 172.21.15.6:0/3790733708 >> v2:172.21.15.31:3300/0 conn(0x7f0c9c06cde0 0x7f0c9c15bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 --2- 172.21.15.6:0/3790733708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06ca00 0x7f0c9c0cc3f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 -- 172.21.15.6:0/3790733708 >> 172.21.15.6:0/3790733708 conn(0x7f0c9c06a980 msgr2=0x7f0c9c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 -- 172.21.15.6:0/3790733708 shutdown_connections 2023-11-28T21:08:48.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 -- 172.21.15.6:0/3790733708 wait complete. 2023-11-28T21:08:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 Processor -- start 2023-11-28T21:08:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 -- start start 2023-11-28T21:08:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c9c06ca00 0x7f0c9c144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06cde0 0x7f0c9c14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c9c15c270 0x7f0c9c14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c150510 con 0x7f0c9c06cde0 2023-11-28T21:08:48.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c14c0d0 con 0x7f0c9c06ca00 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca2632640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c14abd0 con 0x7f0c9c15c270 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06cde0 0x7f0c9c14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06cde0 0x7f0c9c14bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43984/0 (socket says 172.21.15.6:43984) 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9b7fe640 1 -- 172.21.15.6:0/1121194860 learned_addr learned my addr 172.21.15.6:0/1121194860 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0ca0bcf640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c9c15c270 0x7f0c9c14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9bfff640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c9c06ca00 0x7f0c9c144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9b7fe640 1 -- 172.21.15.6:0/1121194860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c9c15c270 msgr2=0x7f0c9c14d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9b7fe640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c9c15c270 0x7f0c9c14d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9b7fe640 1 -- 172.21.15.6:0/1121194860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c9c06ca00 msgr2=0x7f0c9c144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9b7fe640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c9c06ca00 0x7f0c9c144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9b7fe640 1 -- 172.21.15.6:0/1121194860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c009420 con 0x7f0c9c06cde0 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.559+0000 7f0c9b7fe640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06cde0 0x7f0c9c14bb90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000e810 tx=0x7f0c9000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:48.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0c98ff9640 1 -- 172.21.15.6:0/1121194860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000c8d0 con 0x7f0c9c06cde0 2023-11-28T21:08:48.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0c98ff9640 1 -- 172.21.15.6:0/1121194860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9000ca30 con 0x7f0c9c06cde0 2023-11-28T21:08:48.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0c98ff9640 1 -- 172.21.15.6:0/1121194860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000cdc0 con 0x7f0c9c06cde0 2023-11-28T21:08:48.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c150720 con 0x7f0c9c06cde0 2023-11-28T21:08:48.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c150ce0 con 0x7f0c9c06cde0 2023-11-28T21:08:48.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c072b90 con 0x7f0c9c06cde0 2023-11-28T21:08:48.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0c98ff9640 1 -- 172.21.15.6:0/1121194860 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0c90013410 con 0x7f0c9c06cde0 2023-11-28T21:08:48.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0c98ff9640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c88066470 0x7f0c88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0c98ff9640 1 -- 172.21.15.6:0/1121194860 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c90083c80 con 0x7f0c9c06cde0 2023-11-28T21:08:48.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0c9bfff640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c88066470 0x7f0c88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.563+0000 7f0c9bfff640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c88066470 0x7f0c88068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0af000 tx=0x7f0c8c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:48.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.567+0000 7f0c98ff9640 1 -- 172.21.15.6:0/1121194860 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0c90051100 con 0x7f0c9c06cde0 2023-11-28T21:08:48.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.727+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c9c04e930 con 0x7f0c9c06cde0 2023-11-28T21:08:48.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.727+0000 7f0c98ff9640 1 -- 172.21.15.6:0/1121194860 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c90009480 con 0x7f0c9c06cde0 2023-11-28T21:08:48.734 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:48.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c88066470 msgr2=0x7f0c88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c88066470 0x7f0c88068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0af000 tx=0x7f0c8c0a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:48.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06cde0 msgr2=0x7f0c9c14bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06cde0 0x7f0c9c14bb90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000e810 tx=0x7f0c9000ecd0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 shutdown_connections 2023-11-28T21:08:48.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0c88066470 0x7f0c88068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0c9c15c270 0x7f0c9c14d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c9c06cde0 0x7f0c9c14bb90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 --2- 172.21.15.6:0/1121194860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c9c06ca00 0x7f0c9c144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 >> 172.21.15.6:0/1121194860 conn(0x7f0c9c06a980 msgr2=0x7f0c9c0b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:48.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 shutdown_connections 2023-11-28T21:08:48.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.731+0000 7f0ca2632640 1 -- 172.21.15.6:0/1121194860 wait complete. 2023-11-28T21:08:48.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.895+0000 7f9300f2a640 1 Processor -- start 2023-11-28T21:08:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.895+0000 7f9300f2a640 1 -- start start 2023-11-28T21:08:48.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.895+0000 7f9300f2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f92fc0cc3f0 0x7f92fc15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.895+0000 7f9300f2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc15c270 0x7f92fc15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.895+0000 7f9300f2a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc0cc8a0 con 0x7f92fc06ca00 2023-11-28T21:08:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.895+0000 7f9300f2a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc0cd400 con 0x7f92fc0cc3f0 2023-11-28T21:08:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.895+0000 7f9300f2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc15c700 con 0x7f92fc15c270 2023-11-28T21:08:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.895+0000 7f92fa59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f92fc06ca00 0x7f92fc06cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34644/0 (socket says 172.21.15.6:34644) 2023-11-28T21:08:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.895+0000 7f92fa59c640 1 -- 172.21.15.6:0/4044918416 learned_addr learned my addr 172.21.15.6:0/4044918416 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f3fff640 1 --2- 172.21.15.6:0/4044918416 >> v2:172.21.15.31:3300/0 conn(0x7f92fc0cc3f0 0x7f92fc15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92fad9d640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc15c270 0x7f92fc15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816114525 0 0) 0x7f92fc0cc8a0 con 0x7f92fc06ca00 2023-11-28T21:08:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e8003530 con 0x7f92fc06ca00 2023-11-28T21:08:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290933294 0 0) 0x7f92e8003530 con 0x7f92fc06ca00 2023-11-28T21:08:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc15c270 msgr2=0x7f92fc15ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc15c270 0x7f92fc15ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 >> v2:172.21.15.31:3300/0 conn(0x7f92fc0cc3f0 msgr2=0x7f92fc15bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 --2- 172.21.15.6:0/4044918416 >> v2:172.21.15.31:3300/0 conn(0x7f92fc0cc3f0 0x7f92fc15bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc0ccb60 con 0x7f92fc06ca00 2023-11-28T21:08:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f92ec001680 con 0x7f92fc06ca00 2023-11-28T21:08:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f3fff640 1 --2- 172.21.15.6:0/4044918416 >> v2:172.21.15.31:3300/0 conn(0x7f92fc0cc3f0 0x7f92fc15bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 >> v1:172.21.15.6:6789/0 conn(0x7f92fc06ca00 legacy=0x7f92fc06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92e80039b0 0x7f92e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80047d0 0x7f92e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc15c270 0x7f92e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0cd400 con 0x7f92e80039b0 2023-11-28T21:08:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc15c700 con 0x7f92e80047d0 2023-11-28T21:08:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e800b9e0 con 0x7f92fc15c270 2023-11-28T21:08:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92fa59c640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92e80039b0 0x7f92e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92f3fff640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80047d0 0x7f92e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92fad9d640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc15c270 0x7f92e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92fa59c640 1 -- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc15c270 msgr2=0x7f92e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92fa59c640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc15c270 0x7f92e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92fa59c640 1 -- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80047d0 msgr2=0x7f92e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92fa59c640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80047d0 0x7f92e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.899+0000 7f92fa59c640 1 -- 172.21.15.6:0/4044918416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8003530 con 0x7f92e80039b0 2023-11-28T21:08:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f92fa59c640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92e80039b0 0x7f92e8003dd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00c240 tx=0x7f92ec01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ee5f9469d154f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec005ae0 con 0x7f92e80039b0 2023-11-28T21:08:48.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec005c40 con 0x7f92e80039b0 2023-11-28T21:08:48.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f92f9d9b640 1 -- 172.21.15.6:0/4044918416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0a5810 con 0x7f92e80039b0 2023-11-28T21:08:48.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f9300f2a640 1 -- 172.21.15.6:0/4044918416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92e80039b0 msgr2=0x7f92e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f9300f2a640 1 --2- 172.21.15.6:0/4044918416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92e80039b0 0x7f92e8003dd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00c240 tx=0x7f92ec01cc10 comp rx=0 tx=0).stop 2023-11-28T21:08:48.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f92fad9d640 1 -- 172.21.15.6:0/4044918416 reap_dead start 2023-11-28T21:08:48.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f9300f2a640 1 -- 172.21.15.6:0/4044918416 shutdown_connections 2023-11-28T21:08:48.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f9300f2a640 1 -- 172.21.15.6:0/4044918416 >> 172.21.15.6:0/4044918416 conn(0x7f92fc06a980 msgr2=0x7f92fc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:48.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f9300f2a640 1 -- 172.21.15.6:0/4044918416 shutdown_connections 2023-11-28T21:08:48.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f9300f2a640 1 -- 172.21.15.6:0/4044918416 wait complete. 2023-11-28T21:08:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f9300f2a640 1 Processor -- start 2023-11-28T21:08:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.903+0000 7f9300f2a640 1 -- start start 2023-11-28T21:08:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f9300f2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80039b0 0x7f92fc1425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f9300f2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc156d90 0x7f92fc1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f9300f2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92fc155020 0x7f92fc1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f9300f2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc151cd0 con 0x7f92fc155020 2023-11-28T21:08:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f9300f2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc157730 con 0x7f92e80039b0 2023-11-28T21:08:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f9300f2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc1565d0 con 0x7f92fc156d90 2023-11-28T21:08:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92fc155020 0x7f92fc1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fa59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80039b0 0x7f92fc1425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fa59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80039b0 0x7f92fc1425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:54492/0 (socket says 172.21.15.6:54492) 2023-11-28T21:08:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92fc155020 0x7f92fc1554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43994/0 (socket says 172.21.15.6:43994) 2023-11-28T21:08:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fa59c640 1 -- 172.21.15.6:0/3570502737 learned_addr learned my addr 172.21.15.6:0/3570502737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:48.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92f3fff640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc156d90 0x7f92fc1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fad9d640 1 -- 172.21.15.6:0/3570502737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc156d90 msgr2=0x7f92fc1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fad9d640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc156d90 0x7f92fc1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fad9d640 1 -- 172.21.15.6:0/3570502737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80039b0 msgr2=0x7f92fc1425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:48.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fad9d640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80039b0 0x7f92fc1425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:48.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fad9d640 1 -- 172.21.15.6:0/3570502737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc155d30 con 0x7f92fc155020 2023-11-28T21:08:48.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92fad9d640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92fc155020 0x7f92fc1554a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f92e800bb70 tx=0x7f92f400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:48.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92f2ffd640 1 -- 172.21.15.6:0/3570502737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f400e040 con 0x7f92fc155020 2023-11-28T21:08:48.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92f2ffd640 1 -- 172.21.15.6:0/3570502737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f400f040 con 0x7f92fc155020 2023-11-28T21:08:48.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc156010 con 0x7f92fc155020 2023-11-28T21:08:48.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92f2ffd640 1 -- 172.21.15.6:0/3570502737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4003be0 con 0x7f92fc155020 2023-11-28T21:08:48.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc1559e0 con 0x7f92fc155020 2023-11-28T21:08:48.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc151e10 con 0x7f92fc155020 2023-11-28T21:08:48.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.907+0000 7f92f2ffd640 1 -- 172.21.15.6:0/3570502737 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92f4003d40 con 0x7f92fc155020 2023-11-28T21:08:48.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.911+0000 7f92f2ffd640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f92dc0664a0 0x7f92dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:48.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.911+0000 7f92f2ffd640 1 -- 172.21.15.6:0/3570502737 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92f40846f0 con 0x7f92fc155020 2023-11-28T21:08:48.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.911+0000 7f92fa59c640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f92dc0664a0 0x7f92dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:48.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.911+0000 7f92fa59c640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f92dc0664a0 0x7f92dc068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92ec01cc50 tx=0x7f92ec0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:48.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:48.915+0000 7f92f2ffd640 1 -- 172.21.15.6:0/3570502737 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92fc151e10 con 0x7f92fc155020 2023-11-28T21:08:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92fc151e10 con 0x7f92fc155020 2023-11-28T21:08:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f92f2ffd640 1 -- 172.21.15.6:0/3570502737 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f92fc151e10 con 0x7f92fc155020 2023-11-28T21:08:49.077 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f92dc0664a0 msgr2=0x7f92dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f92dc0664a0 0x7f92dc068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92ec01cc50 tx=0x7f92ec0a7070 comp rx=0 tx=0).stop 2023-11-28T21:08:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92fc155020 msgr2=0x7f92fc1554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92fc155020 0x7f92fc1554a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f92e800bb70 tx=0x7f92f400f580 comp rx=0 tx=0).stop 2023-11-28T21:08:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 shutdown_connections 2023-11-28T21:08:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f92dc0664a0 0x7f92dc068960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92fc155020 0x7f92fc1554a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92fc156d90 0x7f92fc1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 --2- 172.21.15.6:0/3570502737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92e80039b0 0x7f92fc1425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 >> 172.21.15.6:0/3570502737 conn(0x7f92fc06a980 msgr2=0x7f92fc071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 shutdown_connections 2023-11-28T21:08:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.071+0000 7f9300f2a640 1 -- 172.21.15.6:0/3570502737 wait complete. 2023-11-28T21:08:49.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T21:08:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.235+0000 7fed07b72640 1 Processor -- start 2023-11-28T21:08:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.235+0000 7fed07b72640 1 -- start start 2023-11-28T21:08:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed07b72640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed000b42e0 0x7fed0006a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed07b72640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed0015e270 0x7fed0006aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed07b72640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed00157bd0 con 0x7fed0015d780 2023-11-28T21:08:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed07b72640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0006b000 con 0x7fed000b42e0 2023-11-28T21:08:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed07b72640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0006b2b0 con 0x7fed0015e270 2023-11-28T21:08:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0510d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed000b42e0 0x7fed0006a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0590e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fed0015d780 0x7fed0015db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34658/0 (socket says 172.21.15.6:34658) 2023-11-28T21:08:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0510d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed000b42e0 0x7fed0006a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44004/0 (socket says 172.21.15.6:44004) 2023-11-28T21:08:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0590e640 1 -- 172.21.15.6:0/2158723366 learned_addr learned my addr 172.21.15.6:0/2158723366 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0610f640 1 --2- 172.21.15.6:0/2158723366 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed0015e270 0x7fed0006aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0510d640 1 -- 172.21.15.6:0/2158723366 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed0015e270 msgr2=0x7fed0006aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0510d640 1 --2- 172.21.15.6:0/2158723366 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed0015e270 0x7fed0006aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0510d640 1 -- 172.21.15.6:0/2158723366 >> v1:172.21.15.6:6789/0 conn(0x7fed0015d780 legacy=0x7fed0015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0510d640 1 -- 172.21.15.6:0/2158723366 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0006b590 con 0x7fed000b42e0 2023-11-28T21:08:49.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.239+0000 7fed0490c640 1 -- 172.21.15.6:0/2158723366 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108266806 0 0) 0x7fed00157bd0 con 0x7fed0015d780 2023-11-28T21:08:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed0510d640 1 --2- 172.21.15.6:0/2158723366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed000b42e0 0x7fed0006a580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fecf00097c0 tx=0x7fecf001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6007515c00c14357 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed0490c640 1 -- 172.21.15.6:0/2158723366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00ac620 con 0x7fed000b42e0 2023-11-28T21:08:49.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed0490c640 1 -- 172.21.15.6:0/2158723366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00ac780 con 0x7fed000b42e0 2023-11-28T21:08:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed0490c640 1 -- 172.21.15.6:0/2158723366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00acb10 con 0x7fed000b42e0 2023-11-28T21:08:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 -- 172.21.15.6:0/2158723366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed000b42e0 msgr2=0x7fed0006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 --2- 172.21.15.6:0/2158723366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed000b42e0 0x7fed0006a580 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fecf00097c0 tx=0x7fecf001c3c0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 -- 172.21.15.6:0/2158723366 shutdown_connections 2023-11-28T21:08:49.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 --2- 172.21.15.6:0/2158723366 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed0015e270 0x7fed0006aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 --2- 172.21.15.6:0/2158723366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed000b42e0 0x7fed0006a580 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 -- 172.21.15.6:0/2158723366 >> 172.21.15.6:0/2158723366 conn(0x7fed000b1670 msgr2=0x7fed000b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:49.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 -- 172.21.15.6:0/2158723366 shutdown_connections 2023-11-28T21:08:49.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 -- 172.21.15.6:0/2158723366 wait complete. 2023-11-28T21:08:49.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 Processor -- start 2023-11-28T21:08:49.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.243+0000 7fed07b72640 1 -- start start 2023-11-28T21:08:49.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed07b72640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed000b42e0 0x7fed0014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed07b72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015d780 0x7fed0014bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed07b72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0015e270 0x7fed0015e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed07b72640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0006dca0 con 0x7fed0015d780 2023-11-28T21:08:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed07b72640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0014c0f0 con 0x7fed0015e270 2023-11-28T21:08:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed07b72640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0015f1e0 con 0x7fed000b42e0 2023-11-28T21:08:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0510d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015d780 0x7fed0014bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0510d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015d780 0x7fed0014bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44020/0 (socket says 172.21.15.6:44020) 2023-11-28T21:08:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0510d640 1 -- 172.21.15.6:0/4214962162 learned_addr learned my addr 172.21.15.6:0/4214962162 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0590e640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed000b42e0 0x7fed0014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0610f640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0015e270 0x7fed0015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0510d640 1 -- 172.21.15.6:0/4214962162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed000b42e0 msgr2=0x7fed0014ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0510d640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed000b42e0 0x7fed0014ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0510d640 1 -- 172.21.15.6:0/4214962162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0015e270 msgr2=0x7fed0015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0510d640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0015e270 0x7fed0015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0510d640 1 -- 172.21.15.6:0/4214962162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0009420 con 0x7fed0015d780 2023-11-28T21:08:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0610f640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0015e270 0x7fed0015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed0510d640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015d780 0x7fed0014bbb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fecf0019ff0 tx=0x7fecf0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fecf67fc640 1 -- 172.21.15.6:0/4214962162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00b5410 con 0x7fed0015d780 2023-11-28T21:08:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fecf67fc640 1 -- 172.21.15.6:0/4214962162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00b5590 con 0x7fed0015d780 2023-11-28T21:08:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fecf67fc640 1 -- 172.21.15.6:0/4214962162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00b5940 con 0x7fed0015d780 2023-11-28T21:08:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0015f4c0 con 0x7fed0015d780 2023-11-28T21:08:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0006d8c0 con 0x7fed0015d780 2023-11-28T21:08:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0006d720 con 0x7fed0015d780 2023-11-28T21:08:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.247+0000 7fecf67fc640 1 -- 172.21.15.6:0/4214962162 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fecf00b3040 con 0x7fed0015d780 2023-11-28T21:08:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.251+0000 7fecf67fc640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fece4066470 0x7fece4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.251+0000 7fecf67fc640 1 -- 172.21.15.6:0/4214962162 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecf011da40 con 0x7fed0015d780 2023-11-28T21:08:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.251+0000 7fed0590e640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fece4066470 0x7fece4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.251+0000 7fed0590e640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fece4066470 0x7fece4068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fecfc007fd0 tx=0x7fecfc007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.255+0000 7fecf67fc640 1 -- 172.21.15.6:0/4214962162 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed0006d720 con 0x7fed0015d780 2023-11-28T21:08:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.423+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fed0006d720 con 0x7fed0015d780 2023-11-28T21:08:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fecf67fc640 1 -- 172.21.15.6:0/4214962162 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fed0006d720 con 0x7fed0015d780 2023-11-28T21:08:49.431 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-11-28T21:08:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fece4066470 msgr2=0x7fece4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fece4066470 0x7fece4068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fecfc007fd0 tx=0x7fecfc007d60 comp rx=0 tx=0).stop 2023-11-28T21:08:49.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015d780 msgr2=0x7fed0014bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015d780 0x7fed0014bbb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fecf0019ff0 tx=0x7fecf0019160 comp rx=0 tx=0).stop 2023-11-28T21:08:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 shutdown_connections 2023-11-28T21:08:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fece4066470 0x7fece4068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed0015e270 0x7fed0015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015d780 0x7fed0014bbb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 --2- 172.21.15.6:0/4214962162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed000b42e0 0x7fed0014ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 >> 172.21.15.6:0/4214962162 conn(0x7fed000b1670 msgr2=0x7fed0014daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 shutdown_connections 2023-11-28T21:08:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.427+0000 7fed07b72640 1 -- 172.21.15.6:0/4214962162 wait complete. 2023-11-28T21:08:49.453 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:08:49.453 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:49.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:49.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.599+0000 7f960b357640 1 Processor -- start 2023-11-28T21:08:49.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.599+0000 7f960b357640 1 -- start start 2023-11-28T21:08:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f960b357640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9604142da0 0x7f9604071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f960b357640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f960415e7d0 0x7f960406d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f960b357640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960415e340 con 0x7f96041437f0 2023-11-28T21:08:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f960b357640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960415dae0 con 0x7f960415e7d0 2023-11-28T21:08:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f960b357640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96040b39b0 con 0x7f9604142da0 2023-11-28T21:08:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f96088f2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f960415e7d0 0x7f960406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f96098f4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f96041437f0 0x7f96040703d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34664/0 (socket says 172.21.15.6:34664) 2023-11-28T21:08:49.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f96098f4640 1 -- 172.21.15.6:0/2099588737 learned_addr learned my addr 172.21.15.6:0/2099588737 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:49.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f96090f3640 1 --2- 172.21.15.6:0/2099588737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9604142da0 0x7f9604071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f96088f2640 1 -- 172.21.15.6:0/2099588737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9604142da0 msgr2=0x7f9604071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:49.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f96088f2640 1 --2- 172.21.15.6:0/2099588737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9604142da0 0x7f9604071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f96088f2640 1 -- 172.21.15.6:0/2099588737 >> v1:172.21.15.6:6789/0 conn(0x7f96041437f0 legacy=0x7f96040703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.603+0000 7f96088f2640 1 -- 172.21.15.6:0/2099588737 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604143440 con 0x7f960415e7d0 2023-11-28T21:08:49.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f96088f2640 1 --2- 172.21.15.6:0/2099588737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 0x7f960406d680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097c0 tx=0x7f95f401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78531848cd7423c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:49.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f95fbfff640 1 -- 172.21.15.6:0/2099588737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40ad660 con 0x7f960415e7d0 2023-11-28T21:08:49.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f95fbfff640 1 -- 172.21.15.6:0/2099588737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f40ad7c0 con 0x7f960415e7d0 2023-11-28T21:08:49.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f95fbfff640 1 -- 172.21.15.6:0/2099588737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40adb50 con 0x7f960415e7d0 2023-11-28T21:08:49.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 -- 172.21.15.6:0/2099588737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 msgr2=0x7f960406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 --2- 172.21.15.6:0/2099588737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 0x7f960406d680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097c0 tx=0x7f95f401c450 comp rx=0 tx=0).stop 2023-11-28T21:08:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 -- 172.21.15.6:0/2099588737 shutdown_connections 2023-11-28T21:08:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 --2- 172.21.15.6:0/2099588737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 0x7f960406d680 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 --2- 172.21.15.6:0/2099588737 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9604142da0 0x7f9604071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 -- 172.21.15.6:0/2099588737 >> 172.21.15.6:0/2099588737 conn(0x7f960406ab80 msgr2=0x7f96040b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 -- 172.21.15.6:0/2099588737 shutdown_connections 2023-11-28T21:08:49.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 -- 172.21.15.6:0/2099588737 wait complete. 2023-11-28T21:08:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 Processor -- start 2023-11-28T21:08:49.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.607+0000 7f960b357640 1 -- start start 2023-11-28T21:08:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f960b357640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9604142da0 0x7f960413d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f960b357640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96041437f0 0x7f9604139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f960b357640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 0x7f960413a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f960b357640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960413d7a0 con 0x7f960415e7d0 2023-11-28T21:08:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f960b357640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604159420 con 0x7f9604142da0 2023-11-28T21:08:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f960b357640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960413d990 con 0x7f96041437f0 2023-11-28T21:08:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96098f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 0x7f960413a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96098f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 0x7f960413a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44034/0 (socket says 172.21.15.6:44034) 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96098f4640 1 -- 172.21.15.6:0/1736692854 learned_addr learned my addr 172.21.15.6:0/1736692854 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96098f4640 1 -- 172.21.15.6:0/1736692854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96041437f0 msgr2=0x7f9604139d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96098f4640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96041437f0 0x7f9604139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96098f4640 1 -- 172.21.15.6:0/1736692854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9604142da0 msgr2=0x7f960413d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96090f3640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9604142da0 0x7f960413d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96098f4640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9604142da0 0x7f960413d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96098f4640 1 -- 172.21.15.6:0/1736692854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4009420 con 0x7f960415e7d0 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96090f3640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9604142da0 0x7f960413d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f96098f4640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 0x7f960413a240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00cbc0 tx=0x7f95fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f95f9ffb640 1 -- 172.21.15.6:0/1736692854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00ad40 con 0x7f960415e7d0 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f95f9ffb640 1 -- 172.21.15.6:0/1736692854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc012400 con 0x7f960415e7d0 2023-11-28T21:08:49.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f95f9ffb640 1 -- 172.21.15.6:0/1736692854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00aea0 con 0x7f960415e7d0 2023-11-28T21:08:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960413dc70 con 0x7f960415e7d0 2023-11-28T21:08:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960413e230 con 0x7f960415e7d0 2023-11-28T21:08:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96040674d0 con 0x7f960415e7d0 2023-11-28T21:08:49.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.611+0000 7f95f9ffb640 1 -- 172.21.15.6:0/1736692854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f95fc007070 con 0x7f960415e7d0 2023-11-28T21:08:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.615+0000 7f95f9ffb640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f95e8066470 0x7f95e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.615+0000 7f95f9ffb640 1 -- 172.21.15.6:0/1736692854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95fc083ce0 con 0x7f960415e7d0 2023-11-28T21:08:49.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.615+0000 7f96090f3640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f95e8066470 0x7f95e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.615+0000 7f96090f3640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f95e8066470 0x7f95e8068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9600009840 tx=0x7f9600008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:49.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.619+0000 7f95f9ffb640 1 -- 172.21.15.6:0/1736692854 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95fc051200 con 0x7f960415e7d0 2023-11-28T21:08:49.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96040b3010 con 0x7f960415e7d0 2023-11-28T21:08:49.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f95f9ffb640 1 -- 172.21.15.6:0/1736692854 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f95fc017090 con 0x7f960415e7d0 2023-11-28T21:08:49.785 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:49.785 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:11.187544+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f95e8066470 msgr2=0x7f95e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f95e8066470 0x7f95e8068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9600009840 tx=0x7f9600008040 comp rx=0 tx=0).stop 2023-11-28T21:08:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 msgr2=0x7f960413a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 0x7f960413a240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00cbc0 tx=0x7f95fc00a430 comp rx=0 tx=0).stop 2023-11-28T21:08:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 shutdown_connections 2023-11-28T21:08:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f95e8066470 0x7f95e8068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960415e7d0 0x7f960413a240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f96041437f0 0x7f9604139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 --2- 172.21.15.6:0/1736692854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9604142da0 0x7f960413d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.779+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 >> 172.21.15.6:0/1736692854 conn(0x7f960406ab80 msgr2=0x7f96040713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.783+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 shutdown_connections 2023-11-28T21:08:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.783+0000 7f960b357640 1 -- 172.21.15.6:0/1736692854 wait complete. 2023-11-28T21:08:49.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:49.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.947+0000 7fb300232640 1 Processor -- start 2023-11-28T21:08:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.947+0000 7fb300232640 1 -- start start 2023-11-28T21:08:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb300232640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f806d060 0x7fb2f80cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb300232640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f80b2850 con 0x7fb2f814b0e0 2023-11-28T21:08:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb300232640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f80b2b30 con 0x7fb2f80b1e70 2023-11-28T21:08:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb300232640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f814b4c0 con 0x7fb2f806d060 2023-11-28T21:08:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fdfce640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb2f814b0e0 0x7fb2f80b38f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34670/0 (socket says 172.21.15.6:34670) 2023-11-28T21:08:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fdfce640 1 -- 172.21.15.6:0/490273777 learned_addr learned my addr 172.21.15.6:0/490273777 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fe7cf640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f806d060 0x7fb2f80cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416909984 0 0) 0x7fb2f80b2850 con 0x7fb2f814b0e0 2023-11-28T21:08:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2e4003530 con 0x7fb2f814b0e0 2023-11-28T21:08:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2300705349 0 0) 0x7fb2e4003530 con 0x7fb2f814b0e0 2023-11-28T21:08:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f806d060 msgr2=0x7fb2f80cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f806d060 0x7fb2f80cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 >> v1:172.21.15.31:6789/0 conn(0x7fb2f80b1e70 legacy=0x7fb2f806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f80b2e10 con 0x7fb2f814b0e0 2023-11-28T21:08:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fb2f4001680 con 0x7fb2f814b0e0 2023-11-28T21:08:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 >> v1:172.21.15.6:6789/0 conn(0x7fb2f814b0e0 legacy=0x7fb2f80b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2e40039b0 0x7fb2e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2e4004360 0x7fb2e4004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f806d060 0x7fb2e4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e400b990 con 0x7fb2e40039b0 2023-11-28T21:08:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e400bb00 con 0x7fb2e4004360 2023-11-28T21:08:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e400bcc0 con 0x7fb2f806d060 2023-11-28T21:08:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fdfce640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2e40039b0 0x7fb2e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fd7cd640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2e4004360 0x7fb2e4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fe7cf640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f806d060 0x7fb2e4005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fdfce640 1 -- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f806d060 msgr2=0x7fb2e4005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fdfce640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f806d060 0x7fb2e4005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fdfce640 1 -- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2e4004360 msgr2=0x7fb2e4004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fdfce640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2e4004360 0x7fb2e4004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.951+0000 7fb2fdfce640 1 -- 172.21.15.6:0/490273777 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4003530 con 0x7fb2e40039b0 2023-11-28T21:08:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb2fdfce640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2e40039b0 0x7fb2e4003d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c190 tx=0x7fb2f401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2420d49cbe4a3318 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4005ae0 con 0x7fb2e40039b0 2023-11-28T21:08:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f4005c60 con 0x7fb2e40039b0 2023-11-28T21:08:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb2fcfcc640 1 -- 172.21.15.6:0/490273777 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40a58b0 con 0x7fb2e40039b0 2023-11-28T21:08:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb300232640 1 -- 172.21.15.6:0/490273777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2e40039b0 msgr2=0x7fb2e4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb300232640 1 --2- 172.21.15.6:0/490273777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2e40039b0 0x7fb2e4003d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c190 tx=0x7fb2f401cbb0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb2fe7cf640 1 -- 172.21.15.6:0/490273777 reap_dead start 2023-11-28T21:08:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb300232640 1 -- 172.21.15.6:0/490273777 shutdown_connections 2023-11-28T21:08:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb300232640 1 -- 172.21.15.6:0/490273777 >> 172.21.15.6:0/490273777 conn(0x7fb2f806a980 msgr2=0x7fb2f806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb300232640 1 -- 172.21.15.6:0/490273777 shutdown_connections 2023-11-28T21:08:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb300232640 1 -- 172.21.15.6:0/490273777 wait complete. 2023-11-28T21:08:49.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb300232640 1 Processor -- start 2023-11-28T21:08:49.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.955+0000 7fb300232640 1 -- start start 2023-11-28T21:08:49.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb300232640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2e40039b0 0x7fb2f8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb300232640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f8162800 0x7fb2f8140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb300232640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f8156690 0x7fb2f8156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb300232640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8141460 con 0x7fb2f8156690 2023-11-28T21:08:49.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb300232640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8157050 con 0x7fb2e40039b0 2023-11-28T21:08:49.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb300232640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f8162c60 con 0x7fb2f8162800 2023-11-28T21:08:49.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fe7cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f8156690 0x7fb2f8156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fe7cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f8156690 0x7fb2f8156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44058/0 (socket says 172.21.15.6:44058) 2023-11-28T21:08:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fe7cf640 1 -- 172.21.15.6:0/3030081568 learned_addr learned my addr 172.21.15.6:0/3030081568 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fdfce640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2e40039b0 0x7fb2f8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fd7cd640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f8162800 0x7fb2f8140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fe7cf640 1 -- 172.21.15.6:0/3030081568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f8162800 msgr2=0x7fb2f8140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fe7cf640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f8162800 0x7fb2f8140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fe7cf640 1 -- 172.21.15.6:0/3030081568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2e40039b0 msgr2=0x7fb2f8159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fe7cf640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2e40039b0 0x7fb2f8159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fe7cf640 1 -- 172.21.15.6:0/3030081568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f81fb3f0 con 0x7fb2f8156690 2023-11-28T21:08:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fd7cd640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f8162800 0x7fb2f8140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2fe7cf640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f8156690 0x7fb2f8156b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb2f806d800 tx=0x7fb2f000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:49.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2ee7fc640 1 -- 172.21.15.6:0/3030081568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000e040 con 0x7fb2f8156690 2023-11-28T21:08:49.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2ee7fc640 1 -- 172.21.15.6:0/3030081568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000f040 con 0x7fb2f8156690 2023-11-28T21:08:49.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb2ee7fc640 1 -- 172.21.15.6:0/3030081568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0003be0 con 0x7fb2f8156690 2023-11-28T21:08:49.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f81fb110 con 0x7fb2f8156690 2023-11-28T21:08:49.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f81631e0 con 0x7fb2f8156690 2023-11-28T21:08:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.959+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f80cb6c0 con 0x7fb2f8156690 2023-11-28T21:08:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.963+0000 7fb2ee7fc640 1 -- 172.21.15.6:0/3030081568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2f0003d40 con 0x7fb2f8156690 2023-11-28T21:08:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.963+0000 7fb2ee7fc640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb2dc066470 0x7fb2dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:49.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.963+0000 7fb2ee7fc640 1 -- 172.21.15.6:0/3030081568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2f00845a0 con 0x7fb2f8156690 2023-11-28T21:08:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.963+0000 7fb2fdfce640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb2dc066470 0x7fb2dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.963+0000 7fb2fdfce640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb2dc066470 0x7fb2dc068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40ab000 tx=0x7fb2f40a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:49.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:49.967+0000 7fb2ee7fc640 1 -- 172.21.15.6:0/3030081568 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2f0051980 con 0x7fb2f8156690 2023-11-28T21:08:50.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2f80b3c70 con 0x7fb2f8156690 2023-11-28T21:08:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb2ee7fc640 1 -- 172.21.15.6:0/3030081568 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2f0054fa0 con 0x7fb2f8156690 2023-11-28T21:08:50.137 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb2dc066470 msgr2=0x7fb2dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb2dc066470 0x7fb2dc068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40ab000 tx=0x7fb2f40a7070 comp rx=0 tx=0).stop 2023-11-28T21:08:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f8156690 msgr2=0x7fb2f8156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f8156690 0x7fb2f8156b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb2f806d800 tx=0x7fb2f000f580 comp rx=0 tx=0).stop 2023-11-28T21:08:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 shutdown_connections 2023-11-28T21:08:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb2dc066470 0x7fb2dc068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2f8156690 0x7fb2f8156b10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2f8162800 0x7fb2f8140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 --2- 172.21.15.6:0/3030081568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2e40039b0 0x7fb2f8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 >> 172.21.15.6:0/3030081568 conn(0x7fb2f806a980 msgr2=0x7fb2f80af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 shutdown_connections 2023-11-28T21:08:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.131+0000 7fb300232640 1 -- 172.21.15.6:0/3030081568 wait complete. 2023-11-28T21:08:50.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:50.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff89dd2a640 1 Processor -- start 2023-11-28T21:08:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff89dd2a640 1 -- start start 2023-11-28T21:08:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff89dd2a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff89815e370 0x7ff8980ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff89dd2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff8980cbf40 0x7ff89815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff89dd2a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89815b510 con 0x7ff89815e750 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff89dd2a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8980cd730 con 0x7ff89815e370 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff89dd2a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89813d450 con 0x7ff8980cbf40 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff8977fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff89815e370 0x7ff8980ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff8977fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff89815e370 0x7ff8980ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44062/0 (socket says 172.21.15.6:44062) 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff8977fe640 1 -- 172.21.15.6:0/1379964628 learned_addr learned my addr 172.21.15.6:0/1379964628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff897fff640 1 --2- 172.21.15.6:0/1379964628 >> v2:172.21.15.31:3300/0 conn(0x7ff8980cbf40 0x7ff89815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff8977fe640 1 -- 172.21.15.6:0/1379964628 >> v2:172.21.15.31:3300/0 conn(0x7ff8980cbf40 msgr2=0x7ff89815a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff8977fe640 1 --2- 172.21.15.6:0/1379964628 >> v2:172.21.15.31:3300/0 conn(0x7ff8980cbf40 0x7ff89815a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff8977fe640 1 -- 172.21.15.6:0/1379964628 >> v1:172.21.15.31:6789/0 conn(0x7ff89815e750 legacy=0x7ff8980cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff8977fe640 1 -- 172.21.15.6:0/1379964628 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8980cd940 con 0x7ff89815e370 2023-11-28T21:08:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.303+0000 7ff897fff640 1 --2- 172.21.15.6:0/1379964628 >> v2:172.21.15.31:3300/0 conn(0x7ff8980cbf40 0x7ff89815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff8977fe640 1 --2- 172.21.15.6:0/1379964628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e370 0x7ff8980ce700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff89815ec30 tx=0x7ff88801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a6c4fab7021ef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff8967fc640 1 -- 172.21.15.6:0/1379964628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880ab5f0 con 0x7ff89815e370 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff8967fc640 1 -- 172.21.15.6:0/1379964628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8880ab750 con 0x7ff89815e370 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff8967fc640 1 -- 172.21.15.6:0/1379964628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880abae0 con 0x7ff89815e370 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff89dd2a640 1 -- 172.21.15.6:0/1379964628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e370 msgr2=0x7ff8980ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff89dd2a640 1 --2- 172.21.15.6:0/1379964628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e370 0x7ff8980ce700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff89815ec30 tx=0x7ff88801c500 comp rx=0 tx=0).stop 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff89dd2a640 1 -- 172.21.15.6:0/1379964628 shutdown_connections 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff89dd2a640 1 --2- 172.21.15.6:0/1379964628 >> v2:172.21.15.31:3300/0 conn(0x7ff8980cbf40 0x7ff89815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff89dd2a640 1 --2- 172.21.15.6:0/1379964628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e370 0x7ff8980ce700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff89dd2a640 1 -- 172.21.15.6:0/1379964628 >> 172.21.15.6:0/1379964628 conn(0x7ff89806a980 msgr2=0x7ff89806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:50.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff89dd2a640 1 -- 172.21.15.6:0/1379964628 shutdown_connections 2023-11-28T21:08:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.307+0000 7ff89dd2a640 1 -- 172.21.15.6:0/1379964628 wait complete. 2023-11-28T21:08:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 Processor -- start 2023-11-28T21:08:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 -- start start 2023-11-28T21:08:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8980cbf40 0x7ff89813bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff89815e370 0x7ff8981f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e750 0x7ff898159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981399a0 con 0x7ff89815e750 2023-11-28T21:08:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff898139c80 con 0x7ff8980cbf40 2023-11-28T21:08:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff898139f60 con 0x7ff89815e370 2023-11-28T21:08:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff8977fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8980cbf40 0x7ff89813bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff897fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e750 0x7ff898159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff8977fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8980cbf40 0x7ff89813bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:54538/0 (socket says 172.21.15.6:54538) 2023-11-28T21:08:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff8977fe640 1 -- 172.21.15.6:0/3868983754 learned_addr learned my addr 172.21.15.6:0/3868983754 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff896ffd640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff89815e370 0x7ff8981f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff897fff640 1 -- 172.21.15.6:0/3868983754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff89815e370 msgr2=0x7ff8981f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff897fff640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff89815e370 0x7ff8981f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff897fff640 1 -- 172.21.15.6:0/3868983754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8980cbf40 msgr2=0x7ff89813bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff897fff640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8980cbf40 0x7ff89813bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff897fff640 1 -- 172.21.15.6:0/3868983754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880094d0 con 0x7ff89815e750 2023-11-28T21:08:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff897fff640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e750 0x7ff898159010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff890007ec0 tx=0x7ff89000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff87ffff640 1 -- 172.21.15.6:0/3868983754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890003ba0 con 0x7ff89815e750 2023-11-28T21:08:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff87ffff640 1 -- 172.21.15.6:0/3868983754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89000f040 con 0x7ff89815e750 2023-11-28T21:08:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff87ffff640 1 -- 172.21.15.6:0/3868983754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890004030 con 0x7ff89815e750 2023-11-28T21:08:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89813a240 con 0x7ff89815e750 2023-11-28T21:08:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.311+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89813c040 con 0x7ff89815e750 2023-11-28T21:08:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.315+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff898072b90 con 0x7ff89815e750 2023-11-28T21:08:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.315+0000 7ff87ffff640 1 -- 172.21.15.6:0/3868983754 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff890004190 con 0x7ff89815e750 2023-11-28T21:08:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.315+0000 7ff87ffff640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff884066470 0x7ff884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.315+0000 7ff87ffff640 1 -- 172.21.15.6:0/3868983754 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff890084120 con 0x7ff89815e750 2023-11-28T21:08:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.315+0000 7ff8977fe640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff884066470 0x7ff884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.315+0000 7ff8977fe640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff884066470 0x7ff884068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff88801c540 tx=0x7ff8880b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:50.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.319+0000 7ff87ffff640 1 -- 172.21.15.6:0/3868983754 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff890051640 con 0x7ff89815e750 2023-11-28T21:08:50.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.479+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff89813a6f0 con 0x7ff89815e750 2023-11-28T21:08:50.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.479+0000 7ff87ffff640 1 -- 172.21.15.6:0/3868983754 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff890054c60 con 0x7ff89815e750 2023-11-28T21:08:50.486 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff884066470 msgr2=0x7ff884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff884066470 0x7ff884068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff88801c540 tx=0x7ff8880b6040 comp rx=0 tx=0).stop 2023-11-28T21:08:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e750 msgr2=0x7ff898159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e750 0x7ff898159010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff890007ec0 tx=0x7ff89000d4a0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 shutdown_connections 2023-11-28T21:08:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff884066470 0x7ff884068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff89815e750 0x7ff898159010 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff89815e370 0x7ff8981f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 --2- 172.21.15.6:0/3868983754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8980cbf40 0x7ff89813bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 >> 172.21.15.6:0/3868983754 conn(0x7ff89806a980 msgr2=0x7ff89806ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:50.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 shutdown_connections 2023-11-28T21:08:50.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.483+0000 7ff89dd2a640 1 -- 172.21.15.6:0/3868983754 wait complete. 2023-11-28T21:08:50.507 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:50.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.647+0000 7fbe22a6b640 1 Processor -- start 2023-11-28T21:08:50.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.647+0000 7fbe22a6b640 1 -- start start 2023-11-28T21:08:50.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.647+0000 7fbe22a6b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c15e370 0x7fbe1c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.647+0000 7fbe22a6b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe1c15e750 0x7fbe1c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.647+0000 7fbe22a6b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c0cc1d0 con 0x7fbe1c0cbd70 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.647+0000 7fbe22a6b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c0cd730 con 0x7fbe1c15e750 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.647+0000 7fbe22a6b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c13d450 con 0x7fbe1c15e370 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe21008640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbe1c0cbd70 0x7fbe1c15a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34676/0 (socket says 172.21.15.6:34676) 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe21008640 1 -- 172.21.15.6:0/431331665 learned_addr learned my addr 172.21.15.6:0/431331665 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe1bfff640 1 --2- 172.21.15.6:0/431331665 >> v2:172.21.15.31:3300/0 conn(0x7fbe1c15e750 0x7fbe1c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe20807640 1 --2- 172.21.15.6:0/431331665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c15e370 0x7fbe1c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe1b7fe640 1 -- 172.21.15.6:0/431331665 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937140887 0 0) 0x7fbe1c0cc1d0 con 0x7fbe1c0cbd70 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe1b7fe640 1 -- 172.21.15.6:0/431331665 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe0c005740 con 0x7fbe1c0cbd70 2023-11-28T21:08:50.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe1bfff640 1 -- 172.21.15.6:0/431331665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c15e370 msgr2=0x7fbe1c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe1bfff640 1 --2- 172.21.15.6:0/431331665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c15e370 0x7fbe1c0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe1bfff640 1 -- 172.21.15.6:0/431331665 >> v1:172.21.15.6:6789/0 conn(0x7fbe1c0cbd70 legacy=0x7fbe1c15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe1bfff640 1 -- 172.21.15.6:0/431331665 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c15b510 con 0x7fbe1c15e750 2023-11-28T21:08:50.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe1bfff640 1 --2- 172.21.15.6:0/431331665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e750 0x7fbe1c0cb830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbe080097c0 tx=0x7fbe0801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=205de97d69a119a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:50.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.651+0000 7fbe1b7fe640 1 -- 172.21.15.6:0/431331665 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe080ab600 con 0x7fbe1c15e750 2023-11-28T21:08:50.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe1b7fe640 1 -- 172.21.15.6:0/431331665 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe080a7050 con 0x7fbe1c15e750 2023-11-28T21:08:50.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe1b7fe640 1 -- 172.21.15.6:0/431331665 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe080ab960 con 0x7fbe1c15e750 2023-11-28T21:08:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 -- 172.21.15.6:0/431331665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e750 msgr2=0x7fbe1c0cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 --2- 172.21.15.6:0/431331665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e750 0x7fbe1c0cb830 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbe080097c0 tx=0x7fbe0801c3f0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 -- 172.21.15.6:0/431331665 shutdown_connections 2023-11-28T21:08:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 --2- 172.21.15.6:0/431331665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e750 0x7fbe1c0cb830 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 --2- 172.21.15.6:0/431331665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c15e370 0x7fbe1c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 -- 172.21.15.6:0/431331665 >> 172.21.15.6:0/431331665 conn(0x7fbe1c06a980 msgr2=0x7fbe1c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 -- 172.21.15.6:0/431331665 shutdown_connections 2023-11-28T21:08:50.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 -- 172.21.15.6:0/431331665 wait complete. 2023-11-28T21:08:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 Processor -- start 2023-11-28T21:08:50.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 -- start start 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c0cbd70 0x7fbe1c154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e370 0x7fbe1c1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe1c15e750 0x7fbe1c13f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c155140 con 0x7fbe1c15e750 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c13cce0 con 0x7fbe1c15e370 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.655+0000 7fbe22a6b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c158e00 con 0x7fbe1c0cbd70 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe21008640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe1c15e750 0x7fbe1c13f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe20807640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c0cbd70 0x7fbe1c154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe1bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e370 0x7fbe1c1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe21008640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe1c15e750 0x7fbe1c13f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44084/0 (socket says 172.21.15.6:44084) 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe21008640 1 -- 172.21.15.6:0/2039335979 learned_addr learned my addr 172.21.15.6:0/2039335979 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:50.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe20807640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c0cbd70 0x7fbe1c154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:42062/0 (socket says 172.21.15.6:42062) 2023-11-28T21:08:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe21008640 1 -- 172.21.15.6:0/2039335979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c0cbd70 msgr2=0x7fbe1c154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe21008640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c0cbd70 0x7fbe1c154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe21008640 1 -- 172.21.15.6:0/2039335979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e370 msgr2=0x7fbe1c1588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe21008640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e370 0x7fbe1c1588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe21008640 1 -- 172.21.15.6:0/2039335979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08009420 con 0x7fbe1c15e750 2023-11-28T21:08:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe20807640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c0cbd70 0x7fbe1c154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe1bfff640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e370 0x7fbe1c1588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:50.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe21008640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe1c15e750 0x7fbe1c13f7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400cb70 tx=0x7fbe1400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe197fa640 1 -- 172.21.15.6:0/2039335979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400ad40 con 0x7fbe1c15e750 2023-11-28T21:08:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe197fa640 1 -- 172.21.15.6:0/2039335979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe14012400 con 0x7fbe1c15e750 2023-11-28T21:08:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe197fa640 1 -- 172.21.15.6:0/2039335979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400aea0 con 0x7fbe1c15e750 2023-11-28T21:08:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c1568a0 con 0x7fbe1c15e750 2023-11-28T21:08:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c155330 con 0x7fbe1c15e750 2023-11-28T21:08:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.659+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1c156a30 con 0x7fbe1c15e750 2023-11-28T21:08:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.663+0000 7fbe197fa640 1 -- 172.21.15.6:0/2039335979 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe14007070 con 0x7fbe1c15e750 2023-11-28T21:08:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.663+0000 7fbe197fa640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbe00066470 0x7fbe00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.663+0000 7fbe197fa640 1 -- 172.21.15.6:0/2039335979 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe14083de0 con 0x7fbe1c15e750 2023-11-28T21:08:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.663+0000 7fbe20807640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbe00066470 0x7fbe00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.663+0000 7fbe20807640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbe00066470 0x7fbe00068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c152040 tx=0x7fbe10009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.667+0000 7fbe197fa640 1 -- 172.21.15.6:0/2039335979 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe14051310 con 0x7fbe1c15e750 2023-11-28T21:08:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe1c072b90 con 0x7fbe1c15e750 2023-11-28T21:08:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe197fa640 1 -- 172.21.15.6:0/2039335979 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe140170a0 con 0x7fbe1c15e750 2023-11-28T21:08:50.832 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:50.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbe00066470 msgr2=0x7fbe00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbe00066470 0x7fbe00068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c152040 tx=0x7fbe10009190 comp rx=0 tx=0).stop 2023-11-28T21:08:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe1c15e750 msgr2=0x7fbe1c13f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe1c15e750 0x7fbe1c13f7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400cb70 tx=0x7fbe1400a430 comp rx=0 tx=0).stop 2023-11-28T21:08:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 shutdown_connections 2023-11-28T21:08:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fbe00066470 0x7fbe00068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe1c15e750 0x7fbe1c13f7a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe1c15e370 0x7fbe1c1588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 --2- 172.21.15.6:0/2039335979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe1c0cbd70 0x7fbe1c154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 >> 172.21.15.6:0/2039335979 conn(0x7fbe1c06a980 msgr2=0x7fbe1c0b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:50.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 shutdown_connections 2023-11-28T21:08:50.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.827+0000 7fbe22a6b640 1 -- 172.21.15.6:0/2039335979 wait complete. 2023-11-28T21:08:50.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T21:08:50.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1c3c4640 1 Processor -- start 2023-11-28T21:08:50.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1c3c4640 1 -- start start 2023-11-28T21:08:50.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1c3c4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406ca00 0x7f3e140cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1c3c4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3e1406cde0 0x7f3e1415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1c3c4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e1415c270 0x7f3e1415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1c3c4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e140cd400 con 0x7f3e1406cde0 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1c3c4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1415c700 con 0x7f3e1415c270 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1c3c4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140cc930 con 0x7f3e1406ca00 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1995f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3e1406cde0 0x7f3e1415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1995f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3e1406cde0 0x7f3e1415bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44094/0 (socket says 172.21.15.6:44094) 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1995f640 1 -- 172.21.15.6:0/1292906339 learned_addr learned my addr 172.21.15.6:0/1292906339 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1a160640 1 --2- 172.21.15.6:0/1292906339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406ca00 0x7f3e140cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1a961640 1 --2- 172.21.15.6:0/1292906339 >> v2:172.21.15.31:3300/0 conn(0x7f3e1415c270 0x7f3e1415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1995f640 1 -- 172.21.15.6:0/1292906339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406ca00 msgr2=0x7f3e140cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:50.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1995f640 1 --2- 172.21.15.6:0/1292906339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406ca00 0x7f3e140cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1995f640 1 -- 172.21.15.6:0/1292906339 >> v2:172.21.15.31:3300/0 conn(0x7f3e1415c270 msgr2=0x7f3e1415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:51.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1995f640 1 --2- 172.21.15.6:0/1292906339 >> v2:172.21.15.31:3300/0 conn(0x7f3e1415c270 0x7f3e1415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1995f640 1 -- 172.21.15.6:0/1292906339 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e140ccb60 con 0x7f3e1406cde0 2023-11-28T21:08:51.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1a160640 1 --2- 172.21.15.6:0/1292906339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406ca00 0x7f3e140cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:51.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.991+0000 7f3e1a961640 1 --2- 172.21.15.6:0/1292906339 >> v2:172.21.15.31:3300/0 conn(0x7f3e1415c270 0x7f3e1415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:51.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1995f640 1 --2- 172.21.15.6:0/1292906339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406cde0 0x7f3e1415bd30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3e1406e680 tx=0x7f3e0401c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a786412421b5ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:51.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1915e640 1 -- 172.21.15.6:0/1292906339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040ab600 con 0x7f3e1406cde0 2023-11-28T21:08:51.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1915e640 1 -- 172.21.15.6:0/1292906339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e040a7050 con 0x7f3e1406cde0 2023-11-28T21:08:51.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1915e640 1 -- 172.21.15.6:0/1292906339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040ab980 con 0x7f3e1406cde0 2023-11-28T21:08:51.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/1292906339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406cde0 msgr2=0x7f3e1415bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/1292906339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406cde0 0x7f3e1415bd30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3e1406e680 tx=0x7f3e0401c180 comp rx=0 tx=0).stop 2023-11-28T21:08:51.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/1292906339 shutdown_connections 2023-11-28T21:08:51.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/1292906339 >> v2:172.21.15.31:3300/0 conn(0x7f3e1415c270 0x7f3e1415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/1292906339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406cde0 0x7f3e1415bd30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/1292906339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406ca00 0x7f3e140cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/1292906339 >> 172.21.15.6:0/1292906339 conn(0x7f3e1406a980 msgr2=0x7f3e1406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:51.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/1292906339 shutdown_connections 2023-11-28T21:08:51.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.995+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/1292906339 wait complete. 2023-11-28T21:08:51.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 Processor -- start 2023-11-28T21:08:51.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 -- start start 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406ca00 0x7f3e14071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406cde0 0x7f3e1414c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e1415c270 0x7f3e141486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1414e720 con 0x7f3e1406ca00 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e14158180 con 0x7f3e1415c270 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e14072160 con 0x7f3e1406cde0 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a160640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406ca00 0x7f3e14071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a160640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406ca00 0x7f3e14071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44104/0 (socket says 172.21.15.6:44104) 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a160640 1 -- 172.21.15.6:0/2822789785 learned_addr learned my addr 172.21.15.6:0/2822789785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1995f640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406cde0 0x7f3e1414c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a961640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e1415c270 0x7f3e141486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a160640 1 -- 172.21.15.6:0/2822789785 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406cde0 msgr2=0x7f3e1414c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a160640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406cde0 0x7f3e1414c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a160640 1 -- 172.21.15.6:0/2822789785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e1415c270 msgr2=0x7f3e141486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a160640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e1415c270 0x7f3e141486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a160640 1 -- 172.21.15.6:0/2822789785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e040094d0 con 0x7f3e1406ca00 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a961640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e1415c270 0x7f3e141486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1a160640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406ca00 0x7f3e14071110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000c7c0 tx=0x7f3e1000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e0affd640 1 -- 172.21.15.6:0/2822789785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10007a30 con 0x7f3e1406ca00 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e0affd640 1 -- 172.21.15.6:0/2822789785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10007b90 con 0x7f3e1406ca00 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e0affd640 1 -- 172.21.15.6:0/2822789785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000ce70 con 0x7f3e1406ca00 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1414e440 con 0x7f3e1406ca00 2023-11-28T21:08:51.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:50.999+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e14157ea0 con 0x7f3e1406ca00 2023-11-28T21:08:51.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.003+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e14157a20 con 0x7f3e1406ca00 2023-11-28T21:08:51.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.003+0000 7f3e0affd640 1 -- 172.21.15.6:0/2822789785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e100113f0 con 0x7f3e1406ca00 2023-11-28T21:08:51.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.003+0000 7f3e0affd640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3df8066470 0x7f3df8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.003+0000 7f3e0affd640 1 -- 172.21.15.6:0/2822789785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e10083fd0 con 0x7f3e1406ca00 2023-11-28T21:08:51.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.003+0000 7f3e1995f640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3df8066470 0x7f3df8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.003+0000 7f3e1995f640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3df8066470 0x7f3df8068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e040ad000 tx=0x7f3e04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:51.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.007+0000 7f3e0affd640 1 -- 172.21.15.6:0/2822789785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e14157a20 con 0x7f3e1406ca00 2023-11-28T21:08:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.175+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3e14157a20 con 0x7f3e1406ca00 2023-11-28T21:08:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.175+0000 7f3e0affd640 1 -- 172.21.15.6:0/2822789785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3e14157a20 con 0x7f3e1406ca00 2023-11-28T21:08:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-11-28T21:08:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3df8066470 msgr2=0x7f3df8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3df8066470 0x7f3df8068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e040ad000 tx=0x7f3e04008040 comp rx=0 tx=0).stop 2023-11-28T21:08:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406ca00 msgr2=0x7f3e14071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406ca00 0x7f3e14071110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000c7c0 tx=0x7f3e1000cc80 comp rx=0 tx=0).stop 2023-11-28T21:08:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 shutdown_connections 2023-11-28T21:08:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3df8066470 0x7f3df8068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e1415c270 0x7f3e141486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e1406cde0 0x7f3e1414c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 --2- 172.21.15.6:0/2822789785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e1406ca00 0x7f3e14071110 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 >> 172.21.15.6:0/2822789785 conn(0x7f3e1406a980 msgr2=0x7f3e1414e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 shutdown_connections 2023-11-28T21:08:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.179+0000 7f3e1c3c4640 1 -- 172.21.15.6:0/2822789785 wait complete. 2023-11-28T21:08:51.203 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2023-11-28T21:08:51.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:51.204 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-28T21:08:51.233 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:08:51.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-28T21:08:51.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:51.233 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T21:08:51.300 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:08:51.301 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:51.310 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:08:51.310 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:51.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.539+0000 7f41a8432640 1 Processor -- start 2023-11-28T21:08:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.539+0000 7f41a8432640 1 -- start start 2023-11-28T21:08:51.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a8432640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a0071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a8432640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41a015e7d0 0x7f41a00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a8432640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a015e340 con 0x7f41a0142da0 2023-11-28T21:08:51.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a8432640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a015dae0 con 0x7f41a015e7d0 2023-11-28T21:08:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a8432640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a00b39b0 con 0x7f41a006dd90 2023-11-28T21:08:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a69cf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41a015e7d0 0x7f41a00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a69cf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41a015e7d0 0x7f41a00b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44106/0 (socket says 172.21.15.6:44106) 2023-11-28T21:08:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a69cf640 1 -- 172.21.15.6:0/1384026119 learned_addr learned my addr 172.21.15.6:0/1384026119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a59cd640 1 --2- 172.21.15.6:0/1384026119 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a0071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a69cf640 1 -- 172.21.15.6:0/1384026119 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 msgr2=0x7f41a0071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a69cf640 1 --2- 172.21.15.6:0/1384026119 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a0071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a69cf640 1 -- 172.21.15.6:0/1384026119 >> v1:172.21.15.31:6789/0 conn(0x7f41a0142da0 legacy=0x7f41a006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.543+0000 7f41a69cf640 1 -- 172.21.15.6:0/1384026119 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a0143440 con 0x7f41a015e7d0 2023-11-28T21:08:51.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a69cf640 1 --2- 172.21.15.6:0/1384026119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 0x7f41a00b1d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4198009e80 tx=0x7f419801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bd3329f9e19cde server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:51.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a51cc640 1 -- 172.21.15.6:0/1384026119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980a5880 con 0x7f41a015e7d0 2023-11-28T21:08:51.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a51cc640 1 -- 172.21.15.6:0/1384026119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41980a59e0 con 0x7f41a015e7d0 2023-11-28T21:08:51.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a51cc640 1 -- 172.21.15.6:0/1384026119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980a5d70 con 0x7f41a015e7d0 2023-11-28T21:08:51.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 -- 172.21.15.6:0/1384026119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 msgr2=0x7f41a00b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 --2- 172.21.15.6:0/1384026119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 0x7f41a00b1d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4198009e80 tx=0x7f419801c9c0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 -- 172.21.15.6:0/1384026119 shutdown_connections 2023-11-28T21:08:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 --2- 172.21.15.6:0/1384026119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 0x7f41a00b1d90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 --2- 172.21.15.6:0/1384026119 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a0071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 -- 172.21.15.6:0/1384026119 >> 172.21.15.6:0/1384026119 conn(0x7f41a006ab80 msgr2=0x7f41a00b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 -- 172.21.15.6:0/1384026119 shutdown_connections 2023-11-28T21:08:51.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 -- 172.21.15.6:0/1384026119 wait complete. 2023-11-28T21:08:51.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 Processor -- start 2023-11-28T21:08:51.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.547+0000 7f41a8432640 1 -- start start 2023-11-28T21:08:51.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a8432640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a01fa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a8432640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a0142da0 0x7f41a00ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a8432640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 0x7f41a013cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a8432640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a01fa8f0 con 0x7f41a015e7d0 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a8432640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0139330 con 0x7f41a0142da0 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a8432640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a013a170 con 0x7f41a006dd90 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a69cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 0x7f41a013cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a61ce640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a01fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a61ce640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a01fa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:42076/0 (socket says 172.21.15.6:42076) 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a61ce640 1 -- 172.21.15.6:0/4283933294 learned_addr learned my addr 172.21.15.6:0/4283933294 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a69cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 0x7f41a013cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44116/0 (socket says 172.21.15.6:44116) 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a59cd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a0142da0 0x7f41a00ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a69cf640 1 -- 172.21.15.6:0/4283933294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 msgr2=0x7f41a01fa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a69cf640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a01fa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a69cf640 1 -- 172.21.15.6:0/4283933294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a0142da0 msgr2=0x7f41a00ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a69cf640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a0142da0 0x7f41a00ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a69cf640 1 -- 172.21.15.6:0/4283933294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198009b30 con 0x7f41a015e7d0 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a61ce640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a01fa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a69cf640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 0x7f41a013cc40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f41980ab000 tx=0x7f4198019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f4196ffd640 1 -- 172.21.15.6:0/4283933294 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980b8470 con 0x7f41a015e7d0 2023-11-28T21:08:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f4196ffd640 1 -- 172.21.15.6:0/4283933294 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41980b85f0 con 0x7f41a015e7d0 2023-11-28T21:08:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a0139560 con 0x7f41a015e7d0 2023-11-28T21:08:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f4196ffd640 1 -- 172.21.15.6:0/4283933294 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980b89a0 con 0x7f41a015e7d0 2023-11-28T21:08:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a0139b20 con 0x7f41a015e7d0 2023-11-28T21:08:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a013a300 con 0x7f41a015e7d0 2023-11-28T21:08:51.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.551+0000 7f4196ffd640 1 -- 172.21.15.6:0/4283933294 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f41980b8b00 con 0x7f41a015e7d0 2023-11-28T21:08:51.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.555+0000 7f4196ffd640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4184066470 0x7f4184068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.555+0000 7f4196ffd640 1 -- 172.21.15.6:0/4283933294 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f419811ecb0 con 0x7f41a015e7d0 2023-11-28T21:08:51.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.555+0000 7f41a61ce640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4184066470 0x7f4184068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.555+0000 7f41a61ce640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4184066470 0x7f4184068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41a013df00 tx=0x7f419c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:51.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.559+0000 7f4196ffd640 1 -- 172.21.15.6:0/4283933294 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41980ec310 con 0x7f41a015e7d0 2023-11-28T21:08:51.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.715+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41a00674d0 con 0x7f41a015e7d0 2023-11-28T21:08:51.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.715+0000 7f4196ffd640 1 -- 172.21.15.6:0/4283933294 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16590 (secure 0 0 0) 0x7f41980ef930 con 0x7f41a015e7d0 2023-11-28T21:08:51.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:51.723 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:51.355467+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:51.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4184066470 msgr2=0x7f4184068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4184066470 0x7f4184068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41a013df00 tx=0x7f419c009040 comp rx=0 tx=0).stop 2023-11-28T21:08:51.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 msgr2=0x7f41a013cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 0x7f41a013cc40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f41980ab000 tx=0x7f4198019760 comp rx=0 tx=0).stop 2023-11-28T21:08:51.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 shutdown_connections 2023-11-28T21:08:51.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4184066470 0x7f4184068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41a015e7d0 0x7f41a013cc40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41a0142da0 0x7f41a00ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 --2- 172.21.15.6:0/4283933294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41a006dd90 0x7f41a01fa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 >> 172.21.15.6:0/4283933294 conn(0x7f41a006ab80 msgr2=0x7f41a00703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 shutdown_connections 2023-11-28T21:08:51.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.719+0000 7f41a8432640 1 -- 172.21.15.6:0/4283933294 wait complete. 2023-11-28T21:08:51.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:51.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52ead2a640 1 Processor -- start 2023-11-28T21:08:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52ead2a640 1 -- start start 2023-11-28T21:08:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52ead2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52e406ca00 0x7f52e40cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52ead2a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52e415c440 0x7f52e415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52ead2a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e40cc930 con 0x7f52e406cde0 2023-11-28T21:08:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52ead2a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e40cd400 con 0x7f52e415c440 2023-11-28T21:08:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52ead2a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e40ccb60 con 0x7f52e406ca00 2023-11-28T21:08:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f52e406cde0 0x7f52e415bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34678/0 (socket says 172.21.15.6:34678) 2023-11-28T21:08:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e3fff640 1 -- 172.21.15.6:0/225515774 learned_addr learned my addr 172.21.15.6:0/225515774 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e92c7640 1 --2- 172.21.15.6:0/225515774 >> v2:172.21.15.6:3300/0 conn(0x7f52e415c440 0x7f52e415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e8ac6640 1 --2- 172.21.15.6:0/225515774 >> v2:172.21.15.31:3300/0 conn(0x7f52e406ca00 0x7f52e40cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e37fe640 1 -- 172.21.15.6:0/225515774 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373929931 0 0) 0x7f52e40cc930 con 0x7f52e406cde0 2023-11-28T21:08:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e37fe640 1 -- 172.21.15.6:0/225515774 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d4003530 con 0x7f52e406cde0 2023-11-28T21:08:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e92c7640 1 -- 172.21.15.6:0/225515774 >> v2:172.21.15.31:3300/0 conn(0x7f52e406ca00 msgr2=0x7f52e40cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e92c7640 1 --2- 172.21.15.6:0/225515774 >> v2:172.21.15.31:3300/0 conn(0x7f52e406ca00 0x7f52e40cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e92c7640 1 -- 172.21.15.6:0/225515774 >> v1:172.21.15.6:6789/0 conn(0x7f52e406cde0 legacy=0x7f52e415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.887+0000 7f52e92c7640 1 -- 172.21.15.6:0/225515774 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40cce40 con 0x7f52e415c440 2023-11-28T21:08:51.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52e92c7640 1 --2- 172.21.15.6:0/225515774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 0x7f52e415ce40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009d90 tx=0x7f52dc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa8523dc8bee8a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:51.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52e37fe640 1 -- 172.21.15.6:0/225515774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0a5910 con 0x7f52e415c440 2023-11-28T21:08:51.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52e37fe640 1 -- 172.21.15.6:0/225515774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc0a5a70 con 0x7f52e415c440 2023-11-28T21:08:51.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52e37fe640 1 -- 172.21.15.6:0/225515774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0a5e00 con 0x7f52e415c440 2023-11-28T21:08:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52ead2a640 1 -- 172.21.15.6:0/225515774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 msgr2=0x7f52e415ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52ead2a640 1 --2- 172.21.15.6:0/225515774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 0x7f52e415ce40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009d90 tx=0x7f52dc01c850 comp rx=0 tx=0).stop 2023-11-28T21:08:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52ead2a640 1 -- 172.21.15.6:0/225515774 shutdown_connections 2023-11-28T21:08:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52ead2a640 1 --2- 172.21.15.6:0/225515774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 0x7f52e415ce40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52ead2a640 1 --2- 172.21.15.6:0/225515774 >> v2:172.21.15.31:3300/0 conn(0x7f52e406ca00 0x7f52e40cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52ead2a640 1 -- 172.21.15.6:0/225515774 >> 172.21.15.6:0/225515774 conn(0x7f52e406a980 msgr2=0x7f52e406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52ead2a640 1 -- 172.21.15.6:0/225515774 shutdown_connections 2023-11-28T21:08:51.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.891+0000 7f52ead2a640 1 -- 172.21.15.6:0/225515774 wait complete. 2023-11-28T21:08:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 Processor -- start 2023-11-28T21:08:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 -- start start 2023-11-28T21:08:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e406ca00 0x7f52e4151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e406cde0 0x7f52e41640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 0x7f52e41f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4164b70 con 0x7f52e415c440 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e41645f0 con 0x7f52e406cde0 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4164890 con 0x7f52e406ca00 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e92c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 0x7f52e41f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e92c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 0x7f52e41f5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44126/0 (socket says 172.21.15.6:44126) 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e92c7640 1 -- 172.21.15.6:0/3258332009 learned_addr learned my addr 172.21.15.6:0/3258332009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e3fff640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e406cde0 0x7f52e41640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e8ac6640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e406ca00 0x7f52e4151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e92c7640 1 -- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e406ca00 msgr2=0x7f52e4151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e92c7640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e406ca00 0x7f52e4151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e92c7640 1 -- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e406cde0 msgr2=0x7f52e41640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e92c7640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e406cde0 0x7f52e41640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e92c7640 1 -- 172.21.15.6:0/3258332009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc009a70 con 0x7f52e415c440 2023-11-28T21:08:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e3fff640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e406cde0 0x7f52e41640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e8ac6640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e406ca00 0x7f52e4151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e92c7640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 0x7f52e41f5250 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f52dc01a480 tx=0x7f52dc0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e17fa640 1 -- 172.21.15.6:0/3258332009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0b9650 con 0x7f52e415c440 2023-11-28T21:08:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e17fa640 1 -- 172.21.15.6:0/3258332009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc0b97b0 con 0x7f52e415c440 2023-11-28T21:08:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e41f90f0 con 0x7f52e415c440 2023-11-28T21:08:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52e17fa640 1 -- 172.21.15.6:0/3258332009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0b9b20 con 0x7f52e415c440 2023-11-28T21:08:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e41f96b0 con 0x7f52e415c440 2023-11-28T21:08:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.895+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e41f8f50 con 0x7f52e415c440 2023-11-28T21:08:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.899+0000 7f52e17fa640 1 -- 172.21.15.6:0/3258332009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52dc0b9c80 con 0x7f52e415c440 2023-11-28T21:08:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.899+0000 7f52e17fa640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52c8066470 0x7f52c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.899+0000 7f52e17fa640 1 -- 172.21.15.6:0/3258332009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f52dc11f290 con 0x7f52e415c440 2023-11-28T21:08:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.899+0000 7f52e8ac6640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52c8066470 0x7f52c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.899+0000 7f52e8ac6640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52c8066470 0x7f52c8068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009ae0 tx=0x7f52d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:51.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:51.903+0000 7f52e17fa640 1 -- 172.21.15.6:0/3258332009 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52e41f8f50 con 0x7f52e415c440 2023-11-28T21:08:52.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.059+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52e41f8f50 con 0x7f52e415c440 2023-11-28T21:08:52.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.059+0000 7f52e17fa640 1 -- 172.21.15.6:0/3258332009 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52e41f8f50 con 0x7f52e415c440 2023-11-28T21:08:52.067 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52c8066470 msgr2=0x7f52c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52c8066470 0x7f52c8068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009ae0 tx=0x7f52d8008040 comp rx=0 tx=0).stop 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 msgr2=0x7f52e41f5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 0x7f52e41f5250 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f52dc01a480 tx=0x7f52dc0195f0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 shutdown_connections 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52c8066470 0x7f52c8068930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e415c440 0x7f52e41f5250 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52e406cde0 0x7f52e41640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 --2- 172.21.15.6:0/3258332009 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52e406ca00 0x7f52e4151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 >> 172.21.15.6:0/3258332009 conn(0x7f52e406a980 msgr2=0x7f52e415bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 shutdown_connections 2023-11-28T21:08:52.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.063+0000 7f52ead2a640 1 -- 172.21.15.6:0/3258332009 wait complete. 2023-11-28T21:08:52.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.227+0000 7f20397c3640 1 Processor -- start 2023-11-28T21:08:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.227+0000 7f20397c3640 1 -- start start 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f20397c3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f20340b42e0 0x7f203406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f20397c3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f203415e270 0x7f203406aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f20397c3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2034157bd0 con 0x7f203415d780 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f20397c3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203406b000 con 0x7f20340b42e0 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f20397c3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203406b2b0 con 0x7f203415e270 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f2032ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f203415d780 0x7f203415db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34686/0 (socket says 172.21.15.6:34686) 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f2032ffd640 1 -- 172.21.15.6:0/1775537161 learned_addr learned my addr 172.21.15.6:0/1775537161 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f202bfff640 1 --2- 172.21.15.6:0/1775537161 >> v2:172.21.15.31:3300/0 conn(0x7f20340b42e0 0x7f203406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f20337fe640 1 --2- 172.21.15.6:0/1775537161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f203415e270 0x7f203406aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f20327fc640 1 -- 172.21.15.6:0/1775537161 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173553343 0 0) 0x7f2034157bd0 con 0x7f203415d780 2023-11-28T21:08:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f20327fc640 1 -- 172.21.15.6:0/1775537161 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2020003530 con 0x7f203415d780 2023-11-28T21:08:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f202bfff640 1 -- 172.21.15.6:0/1775537161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f203415e270 msgr2=0x7f203406aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f202bfff640 1 --2- 172.21.15.6:0/1775537161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f203415e270 0x7f203406aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f202bfff640 1 -- 172.21.15.6:0/1775537161 >> v1:172.21.15.6:6789/0 conn(0x7f203415d780 legacy=0x7f203415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.231+0000 7f202bfff640 1 -- 172.21.15.6:0/1775537161 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203406b590 con 0x7f20340b42e0 2023-11-28T21:08:52.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f202bfff640 1 --2- 172.21.15.6:0/1775537161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20340b42e0 0x7f203406a580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097c0 tx=0x7f201c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3f688c18d424867 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:52.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20327fc640 1 -- 172.21.15.6:0/1775537161 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0ac620 con 0x7f20340b42e0 2023-11-28T21:08:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20327fc640 1 -- 172.21.15.6:0/1775537161 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0ac780 con 0x7f20340b42e0 2023-11-28T21:08:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20327fc640 1 -- 172.21.15.6:0/1775537161 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0acaf0 con 0x7f20340b42e0 2023-11-28T21:08:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 -- 172.21.15.6:0/1775537161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20340b42e0 msgr2=0x7f203406a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 --2- 172.21.15.6:0/1775537161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20340b42e0 0x7f203406a580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097c0 tx=0x7f201c01c3c0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 -- 172.21.15.6:0/1775537161 shutdown_connections 2023-11-28T21:08:52.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 --2- 172.21.15.6:0/1775537161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f203415e270 0x7f203406aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 --2- 172.21.15.6:0/1775537161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20340b42e0 0x7f203406a580 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 -- 172.21.15.6:0/1775537161 >> 172.21.15.6:0/1775537161 conn(0x7f20340b1670 msgr2=0x7f20340b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 -- 172.21.15.6:0/1775537161 shutdown_connections 2023-11-28T21:08:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 -- 172.21.15.6:0/1775537161 wait complete. 2023-11-28T21:08:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 Processor -- start 2023-11-28T21:08:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.235+0000 7f20397c3640 1 -- start start 2023-11-28T21:08:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20397c3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20340b42e0 0x7f2034139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20397c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415d780 0x7f20340cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20397c3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203415e270 0x7f2034154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20397c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203414f520 con 0x7f203415d780 2023-11-28T21:08:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20397c3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340cbed0 con 0x7f203415e270 2023-11-28T21:08:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20397c3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203414e1a0 con 0x7f20340b42e0 2023-11-28T21:08:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415d780 0x7f20340cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415d780 0x7f20340cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44130/0 (socket says 172.21.15.6:44130) 2023-11-28T21:08:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202bfff640 1 -- 172.21.15.6:0/2829142920 learned_addr learned my addr 172.21.15.6:0/2829142920 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:52.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20337fe640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203415e270 0x7f2034154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f2032ffd640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20340b42e0 0x7f2034139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202bfff640 1 -- 172.21.15.6:0/2829142920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20340b42e0 msgr2=0x7f2034139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202bfff640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20340b42e0 0x7f2034139960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202bfff640 1 -- 172.21.15.6:0/2829142920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203415e270 msgr2=0x7f2034154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202bfff640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203415e270 0x7f2034154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202bfff640 1 -- 172.21.15.6:0/2829142920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009420 con 0x7f203415d780 2023-11-28T21:08:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202bfff640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415d780 0x7f20340cb990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f201c019ff0 tx=0x7f201c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202b7fe640 1 -- 172.21.15.6:0/2829142920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0b9070 con 0x7f203415d780 2023-11-28T21:08:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202b7fe640 1 -- 172.21.15.6:0/2829142920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0ac4e0 con 0x7f203415d780 2023-11-28T21:08:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203414e480 con 0x7f203415d780 2023-11-28T21:08:52.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202b7fe640 1 -- 172.21.15.6:0/2829142920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0acaf0 con 0x7f203415d780 2023-11-28T21:08:52.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203414ea40 con 0x7f203415d780 2023-11-28T21:08:52.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20340727d0 con 0x7f203415d780 2023-11-28T21:08:52.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.239+0000 7f202b7fe640 1 -- 172.21.15.6:0/2829142920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f201c0b3040 con 0x7f203415d780 2023-11-28T21:08:52.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.243+0000 7f202b7fe640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2014066470 0x7f2014068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.243+0000 7f202b7fe640 1 -- 172.21.15.6:0/2829142920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f201c11d7f0 con 0x7f203415d780 2023-11-28T21:08:52.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.243+0000 7f2032ffd640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2014066470 0x7f2014068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.243+0000 7f2032ffd640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2014066470 0x7f2014068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f20240011f0 tx=0x7f2024009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:52.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.247+0000 7f202b7fe640 1 -- 172.21.15.6:0/2829142920 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f201c0eab50 con 0x7f203415d780 2023-11-28T21:08:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.407+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f203404e930 con 0x7f203415d780 2023-11-28T21:08:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.407+0000 7f202b7fe640 1 -- 172.21.15.6:0/2829142920 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f201c0ee170 con 0x7f203415d780 2023-11-28T21:08:52.414 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2014066470 msgr2=0x7f2014068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2014066470 0x7f2014068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f20240011f0 tx=0x7f2024009040 comp rx=0 tx=0).stop 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415d780 msgr2=0x7f20340cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415d780 0x7f20340cb990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f201c019ff0 tx=0x7f201c019160 comp rx=0 tx=0).stop 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 shutdown_connections 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2014066470 0x7f2014068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203415e270 0x7f2034154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415d780 0x7f20340cb990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 --2- 172.21.15.6:0/2829142920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20340b42e0 0x7f2034139960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 >> 172.21.15.6:0/2829142920 conn(0x7f20340b1670 msgr2=0x7f20340b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 shutdown_connections 2023-11-28T21:08:52.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.411+0000 7f20397c3640 1 -- 172.21.15.6:0/2829142920 wait complete. 2023-11-28T21:08:52.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.575+0000 7effa0ff8640 1 Processor -- start 2023-11-28T21:08:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.575+0000 7effa0ff8640 1 -- start start 2023-11-28T21:08:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.575+0000 7effa0ff8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff9c160a70 0x7eff9c0cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.575+0000 7effa0ff8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0d04c0 con 0x7eff9c0d00b0 2023-11-28T21:08:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.575+0000 7effa0ff8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0d2260 con 0x7eff9c0d1500 2023-11-28T21:08:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.575+0000 7effa0ff8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c0cf470 con 0x7eff9c160a70 2023-11-28T21:08:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.575+0000 7eff9ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff9c0d00b0 0x7eff9c0ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34700/0 (socket says 172.21.15.6:34700) 2023-11-28T21:08:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.575+0000 7eff9ad9d640 1 -- 172.21.15.6:0/2432808816 learned_addr learned my addr 172.21.15.6:0/2432808816 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.579+0000 7eff9a59c640 1 --2- 172.21.15.6:0/2432808816 >> v2:172.21.15.31:3300/0 conn(0x7eff9c160a70 0x7eff9c0cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.579+0000 7eff99d9b640 1 -- 172.21.15.6:0/2432808816 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488789883 0 0) 0x7eff9c0d04c0 con 0x7eff9c0d00b0 2023-11-28T21:08:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.579+0000 7eff99d9b640 1 -- 172.21.15.6:0/2432808816 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff88003530 con 0x7eff9c0d00b0 2023-11-28T21:08:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.579+0000 7eff9a59c640 1 -- 172.21.15.6:0/2432808816 >> v1:172.21.15.31:6789/0 conn(0x7eff9c0d1500 legacy=0x7eff9c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.579+0000 7eff9a59c640 1 -- 172.21.15.6:0/2432808816 >> v1:172.21.15.6:6789/0 conn(0x7eff9c0d00b0 legacy=0x7eff9c0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.579+0000 7eff9a59c640 1 -- 172.21.15.6:0/2432808816 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0d19c0 con 0x7eff9c160a70 2023-11-28T21:08:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.579+0000 7eff9a59c640 1 --2- 172.21.15.6:0/2432808816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff9c160a70 0x7eff9c0cfb70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0097c0 tx=0x7eff8c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e07b0994597b392d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.579+0000 7eff99d9b640 1 -- 172.21.15.6:0/2432808816 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0ab5f0 con 0x7eff9c160a70 2023-11-28T21:08:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7eff99d9b640 1 -- 172.21.15.6:0/2432808816 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c0ab750 con 0x7eff9c160a70 2023-11-28T21:08:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7eff99d9b640 1 -- 172.21.15.6:0/2432808816 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0abae0 con 0x7eff9c160a70 2023-11-28T21:08:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 -- 172.21.15.6:0/2432808816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff9c160a70 msgr2=0x7eff9c0cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 --2- 172.21.15.6:0/2432808816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff9c160a70 0x7eff9c0cfb70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0097c0 tx=0x7eff8c01c3f0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 -- 172.21.15.6:0/2432808816 shutdown_connections 2023-11-28T21:08:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 --2- 172.21.15.6:0/2432808816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff9c160a70 0x7eff9c0cfb70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 -- 172.21.15.6:0/2432808816 >> 172.21.15.6:0/2432808816 conn(0x7eff9c09c490 msgr2=0x7eff9c0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 -- 172.21.15.6:0/2432808816 shutdown_connections 2023-11-28T21:08:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 -- 172.21.15.6:0/2432808816 wait complete. 2023-11-28T21:08:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 Processor -- start 2023-11-28T21:08:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 -- start start 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff9c0d00b0 0x7eff9c0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff9c0d1500 0x7eff9c14bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff9c160a70 0x7eff9c0b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0cd180 con 0x7eff9c160a70 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0cbba0 con 0x7eff9c0d1500 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7effa0ff8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c0cbe80 con 0x7eff9c0d00b0 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.583+0000 7eff9ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff9c160a70 0x7eff9c0b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff9ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff9c160a70 0x7eff9c0b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44138/0 (socket says 172.21.15.6:44138) 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff9ad9d640 1 -- 172.21.15.6:0/3703588807 learned_addr learned my addr 172.21.15.6:0/3703588807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff9a59c640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff9c0d00b0 0x7eff9c0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff93fff640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff9c0d1500 0x7eff9c14bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff9ad9d640 1 -- 172.21.15.6:0/3703588807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff9c0d00b0 msgr2=0x7eff9c0ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff9ad9d640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff9c0d00b0 0x7eff9c0ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff9ad9d640 1 -- 172.21.15.6:0/3703588807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff9c0d1500 msgr2=0x7eff9c14bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff9ad9d640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff9c0d1500 0x7eff9c14bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff9ad9d640 1 -- 172.21.15.6:0/3703588807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c009420 con 0x7eff9c160a70 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff9ad9d640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff9c160a70 0x7eff9c0b8260 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff9400cb40 tx=0x7eff9400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff92ffd640 1 -- 172.21.15.6:0/3703588807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400aca0 con 0x7eff9c160a70 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff92ffd640 1 -- 172.21.15.6:0/3703588807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9400ae00 con 0x7eff9c160a70 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff92ffd640 1 -- 172.21.15.6:0/3703588807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94012620 con 0x7eff9c160a70 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c0cc160 con 0x7eff9c160a70 2023-11-28T21:08:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c0cc720 con 0x7eff9c160a70 2023-11-28T21:08:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c0cc940 con 0x7eff9c160a70 2023-11-28T21:08:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.587+0000 7eff92ffd640 1 -- 172.21.15.6:0/3703588807 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff94007070 con 0x7eff9c160a70 2023-11-28T21:08:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.591+0000 7eff92ffd640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff7c0664a0 0x7eff7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.591+0000 7eff92ffd640 1 -- 172.21.15.6:0/3703588807 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7eff94083d90 con 0x7eff9c160a70 2023-11-28T21:08:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.591+0000 7eff9a59c640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff7c0664a0 0x7eff7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.591+0000 7eff9a59c640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff7c0664a0 0x7eff7c068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0af000 tx=0x7eff8c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.595+0000 7eff92ffd640 1 -- 172.21.15.6:0/3703588807 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff940512d0 con 0x7eff9c160a70 2023-11-28T21:08:52.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.751+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff9c0a1170 con 0x7eff9c160a70 2023-11-28T21:08:52.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.751+0000 7eff92ffd640 1 -- 172.21.15.6:0/3703588807 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff940170a0 con 0x7eff9c160a70 2023-11-28T21:08:52.758 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:52.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff7c0664a0 msgr2=0x7eff7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff7c0664a0 0x7eff7c068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0af000 tx=0x7eff8c0a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:52.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff9c160a70 msgr2=0x7eff9c0b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff9c160a70 0x7eff9c0b8260 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff9400cb40 tx=0x7eff9400a060 comp rx=0 tx=0).stop 2023-11-28T21:08:52.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 shutdown_connections 2023-11-28T21:08:52.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff7c0664a0 0x7eff7c068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff9c160a70 0x7eff9c0b8260 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff9c0d1500 0x7eff9c14bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 --2- 172.21.15.6:0/3703588807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff9c0d00b0 0x7eff9c0ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 >> 172.21.15.6:0/3703588807 conn(0x7eff9c09c490 msgr2=0x7eff9c066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:52.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 shutdown_connections 2023-11-28T21:08:52.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.755+0000 7effa0ff8640 1 -- 172.21.15.6:0/3703588807 wait complete. 2023-11-28T21:08:52.780 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T21:08:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.919+0000 7fe011765640 1 Processor -- start 2023-11-28T21:08:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.919+0000 7fe011765640 1 -- start start 2023-11-28T21:08:52.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe011765640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe00c15e370 0x7fe00c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe011765640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c15e750 0x7fe00c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe011765640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00c0cc1d0 con 0x7fe00c0cbd70 2023-11-28T21:08:52.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe011765640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0cd730 con 0x7fe00c15e370 2023-11-28T21:08:52.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe011765640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c13d450 con 0x7fe00c15e750 2023-11-28T21:08:52.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe00c0cbd70 0x7fe00c15a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34702/0 (socket says 172.21.15.6:34702) 2023-11-28T21:08:52.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00b7fe640 1 -- 172.21.15.6:0/4101393594 learned_addr learned my addr 172.21.15.6:0/4101393594 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe003fff640 1 --2- 172.21.15.6:0/4101393594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c15e750 0x7fe00c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00affd640 1 --2- 172.21.15.6:0/4101393594 >> v2:172.21.15.31:3300/0 conn(0x7fe00c15e370 0x7fe00c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00a7fc640 1 -- 172.21.15.6:0/4101393594 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530870773 0 0) 0x7fe00c0cc1d0 con 0x7fe00c0cbd70 2023-11-28T21:08:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00a7fc640 1 -- 172.21.15.6:0/4101393594 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff8003530 con 0x7fe00c0cbd70 2023-11-28T21:08:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00affd640 1 -- 172.21.15.6:0/4101393594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c15e750 msgr2=0x7fe00c0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00affd640 1 --2- 172.21.15.6:0/4101393594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c15e750 0x7fe00c0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00affd640 1 -- 172.21.15.6:0/4101393594 >> v1:172.21.15.6:6789/0 conn(0x7fe00c0cbd70 legacy=0x7fe00c15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00a7fc640 1 -- 172.21.15.6:0/4101393594 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 609393304 0 0) 0x7fdff8003530 con 0x7fe00c0cbd70 2023-11-28T21:08:52.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.923+0000 7fe00affd640 1 -- 172.21.15.6:0/4101393594 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c15b510 con 0x7fe00c15e370 2023-11-28T21:08:52.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe00affd640 1 --2- 172.21.15.6:0/4101393594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 0x7fe00c0ce700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0097c0 tx=0x7fdffc01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d57bd7d01546ef1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe00a7fc640 1 -- 172.21.15.6:0/4101393594 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004001a00 con 0x7fe00c15e370 2023-11-28T21:08:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe00a7fc640 1 -- 172.21.15.6:0/4101393594 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc0a7050 con 0x7fe00c15e370 2023-11-28T21:08:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe00a7fc640 1 -- 172.21.15.6:0/4101393594 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc0ab600 con 0x7fe00c15e370 2023-11-28T21:08:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 -- 172.21.15.6:0/4101393594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 msgr2=0x7fe00c0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 --2- 172.21.15.6:0/4101393594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 0x7fe00c0ce700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0097c0 tx=0x7fdffc01c310 comp rx=0 tx=0).stop 2023-11-28T21:08:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 -- 172.21.15.6:0/4101393594 shutdown_connections 2023-11-28T21:08:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 --2- 172.21.15.6:0/4101393594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c15e750 0x7fe00c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 --2- 172.21.15.6:0/4101393594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 0x7fe00c0ce700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 -- 172.21.15.6:0/4101393594 >> 172.21.15.6:0/4101393594 conn(0x7fe00c06a980 msgr2=0x7fe00c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:52.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 -- 172.21.15.6:0/4101393594 shutdown_connections 2023-11-28T21:08:52.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 -- 172.21.15.6:0/4101393594 wait complete. 2023-11-28T21:08:52.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 Processor -- start 2023-11-28T21:08:52.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.927+0000 7fe011765640 1 -- start start 2023-11-28T21:08:52.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe011765640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c0cbd70 0x7fe00c135670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe011765640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 0x7fe00c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe011765640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe00c15e750 0x7fe00c0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe011765640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c135bb0 con 0x7fe00c15e750 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe011765640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0b3580 con 0x7fe00c15e370 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe011765640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0b2970 con 0x7fe00c0cbd70 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe00c15e750 0x7fe00c0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe00c15e750 0x7fe00c0afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44148/0 (socket says 172.21.15.6:44148) 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00b7fe640 1 -- 172.21.15.6:0/4050105462 learned_addr learned my addr 172.21.15.6:0/4050105462 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00affd640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c0cbd70 0x7fe00c135670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe003fff640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 0x7fe00c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00b7fe640 1 -- 172.21.15.6:0/4050105462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c0cbd70 msgr2=0x7fe00c135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00b7fe640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c0cbd70 0x7fe00c135670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00b7fe640 1 -- 172.21.15.6:0/4050105462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 msgr2=0x7fe00c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00b7fe640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 0x7fe00c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00b7fe640 1 -- 172.21.15.6:0/4050105462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc009420 con 0x7fe00c15e750 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe003fff640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 0x7fe00c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe00b7fe640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe00c15e750 0x7fe00c0afc70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe004001f80 tx=0x7fe00400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe0037fe640 1 -- 172.21.15.6:0/4050105462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004012400 con 0x7fe00c15e750 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe0037fe640 1 -- 172.21.15.6:0/4050105462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe004012560 con 0x7fe00c15e750 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe0037fe640 1 -- 172.21.15.6:0/4050105462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040128d0 con 0x7fe00c15e750 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c0b2c50 con 0x7fe00c15e750 2023-11-28T21:08:52.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c0b3210 con 0x7fe00c15e750 2023-11-28T21:08:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c072b90 con 0x7fe00c15e750 2023-11-28T21:08:52.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.931+0000 7fe0037fe640 1 -- 172.21.15.6:0/4050105462 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe004012a30 con 0x7fe00c15e750 2023-11-28T21:08:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.935+0000 7fe0037fe640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdfec066470 0x7fdfec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.935+0000 7fe0037fe640 1 -- 172.21.15.6:0/4050105462 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe0040847d0 con 0x7fe00c15e750 2023-11-28T21:08:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.935+0000 7fe00affd640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdfec066470 0x7fdfec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:52.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.935+0000 7fe00affd640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdfec066470 0x7fdfec068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0ad000 tx=0x7fdffc0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:52.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:52.939+0000 7fe0037fe640 1 -- 172.21.15.6:0/4050105462 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe004051b30 con 0x7fe00c15e750 2023-11-28T21:08:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe00c15a050 con 0x7fe00c15e750 2023-11-28T21:08:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe0037fe640 1 -- 172.21.15.6:0/4050105462 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe004055150 con 0x7fe00c15e750 2023-11-28T21:08:53.112 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-11-28T21:08:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdfec066470 msgr2=0x7fdfec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdfec066470 0x7fdfec068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0ad000 tx=0x7fdffc0a6000 comp rx=0 tx=0).stop 2023-11-28T21:08:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe00c15e750 msgr2=0x7fe00c0afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe00c15e750 0x7fe00c0afc70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe004001f80 tx=0x7fe00400a430 comp rx=0 tx=0).stop 2023-11-28T21:08:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 shutdown_connections 2023-11-28T21:08:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdfec066470 0x7fdfec068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe00c15e750 0x7fe00c0afc70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe00c15e370 0x7fe00c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 --2- 172.21.15.6:0/4050105462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe00c0cbd70 0x7fe00c135670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 >> 172.21.15.6:0/4050105462 conn(0x7fe00c06a980 msgr2=0x7fe00c159850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 shutdown_connections 2023-11-28T21:08:53.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.107+0000 7fe011765640 1 -- 172.21.15.6:0/4050105462 wait complete. 2023-11-28T21:08:53.133 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:08:53.134 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:53.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:53.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff65d85f640 1 Processor -- start 2023-11-28T21:08:53.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff65d85f640 1 -- start start 2023-11-28T21:08:53.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff65d85f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 0x7ff658160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff65d85f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff65806a580 0x7ff65806a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff65d85f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff658157c80 con 0x7ff6580b32c0 2023-11-28T21:08:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff65d85f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6580adae0 con 0x7ff65806a580 2023-11-28T21:08:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff65d85f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6580b3880 con 0x7ff6580ad700 2023-11-28T21:08:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff6577fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff65806a580 0x7ff65806a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff64ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff6580b32c0 0x7ff658161280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34708/0 (socket says 172.21.15.6:34708) 2023-11-28T21:08:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.323+0000 7ff64ffff640 1 -- 172.21.15.6:0/3463663029 learned_addr learned my addr 172.21.15.6:0/3463663029 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.327+0000 7ff656ffd640 1 --2- 172.21.15.6:0/3463663029 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 0x7ff658160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.327+0000 7ff6577fe640 1 -- 172.21.15.6:0/3463663029 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 msgr2=0x7ff658160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.327+0000 7ff6577fe640 1 --2- 172.21.15.6:0/3463663029 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 0x7ff658160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.327+0000 7ff6577fe640 1 -- 172.21.15.6:0/3463663029 >> v1:172.21.15.6:6789/0 conn(0x7ff6580b32c0 legacy=0x7ff658161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.327+0000 7ff6577fe640 1 -- 172.21.15.6:0/3463663029 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6580b3b60 con 0x7ff65806a580 2023-11-28T21:08:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.327+0000 7ff6577fe640 1 --2- 172.21.15.6:0/3463663029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65806a580 0x7ff65806a9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff65001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8c450de5e388a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.327+0000 7ff6567fc640 1 -- 172.21.15.6:0/3463663029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500a59e0 con 0x7ff65806a580 2023-11-28T21:08:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.327+0000 7ff6567fc640 1 -- 172.21.15.6:0/3463663029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6500a5b40 con 0x7ff65806a580 2023-11-28T21:08:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.327+0000 7ff6567fc640 1 -- 172.21.15.6:0/3463663029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500ad440 con 0x7ff65806a580 2023-11-28T21:08:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 -- 172.21.15.6:0/3463663029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65806a580 msgr2=0x7ff65806a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 --2- 172.21.15.6:0/3463663029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65806a580 0x7ff65806a9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff65001c900 comp rx=0 tx=0).stop 2023-11-28T21:08:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 -- 172.21.15.6:0/3463663029 shutdown_connections 2023-11-28T21:08:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 --2- 172.21.15.6:0/3463663029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65806a580 0x7ff65806a9d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 --2- 172.21.15.6:0/3463663029 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 0x7ff658160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 -- 172.21.15.6:0/3463663029 >> 172.21.15.6:0/3463663029 conn(0x7ff6580cf7b0 msgr2=0x7ff6580cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 -- 172.21.15.6:0/3463663029 shutdown_connections 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 -- 172.21.15.6:0/3463663029 wait complete. 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 Processor -- start 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 -- start start 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65806a580 0x7ff65814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 0x7ff6581566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6580b32c0 0x7ff658153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65815c480 con 0x7ff6580b32c0 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65815c760 con 0x7ff65806a580 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff65d85f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65815ca40 con 0x7ff6580ad700 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff6577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6580b32c0 0x7ff658153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff6577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6580b32c0 0x7ff658153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44166/0 (socket says 172.21.15.6:44166) 2023-11-28T21:08:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff6577fe640 1 -- 172.21.15.6:0/1531869806 learned_addr learned my addr 172.21.15.6:0/1531869806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff64ffff640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 0x7ff6581566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff656ffd640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65806a580 0x7ff65814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff6577fe640 1 -- 172.21.15.6:0/1531869806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 msgr2=0x7ff6581566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff6577fe640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 0x7ff6581566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff6577fe640 1 -- 172.21.15.6:0/1531869806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65806a580 msgr2=0x7ff65814fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff6577fe640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65806a580 0x7ff65814fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff6577fe640 1 -- 172.21.15.6:0/1531869806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009a70 con 0x7ff6580b32c0 2023-11-28T21:08:53.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.331+0000 7ff656ffd640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65806a580 0x7ff65814fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:53.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff6577fe640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6580b32c0 0x7ff658153280 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff65001afb0 tx=0x7ff6500196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:53.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff654ff9640 1 -- 172.21.15.6:0/1531869806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500add90 con 0x7ff6580b32c0 2023-11-28T21:08:53.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff654ff9640 1 -- 172.21.15.6:0/1531869806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650009450 con 0x7ff6580b32c0 2023-11-28T21:08:53.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6580b4aa0 con 0x7ff6580b32c0 2023-11-28T21:08:53.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff654ff9640 1 -- 172.21.15.6:0/1531869806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500b9670 con 0x7ff6580b32c0 2023-11-28T21:08:53.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff658157eb0 con 0x7ff6580b32c0 2023-11-28T21:08:53.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65806f630 con 0x7ff6580b32c0 2023-11-28T21:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff654ff9640 1 -- 172.21.15.6:0/1531869806 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6500039a0 con 0x7ff6580b32c0 2023-11-28T21:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff654ff9640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff6380664a0 0x7ff638068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff654ff9640 1 -- 172.21.15.6:0/1531869806 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff65011f210 con 0x7ff6580b32c0 2023-11-28T21:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.335+0000 7ff656ffd640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff6380664a0 0x7ff638068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.339+0000 7ff656ffd640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff6380664a0 0x7ff638068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff6580b0a70 tx=0x7ff648008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:53.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.339+0000 7ff654ff9640 1 -- 172.21.15.6:0/1531869806 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6500ec570 con 0x7ff6580b32c0 2023-11-28T21:08:53.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.499+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6581580a0 con 0x7ff6580b32c0 2023-11-28T21:08:53.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff654ff9640 1 -- 172.21.15.6:0/1531869806 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16590 (secure 0 0 0) 0x7ff6500efb90 con 0x7ff6580b32c0 2023-11-28T21:08:53.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:52.362503+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff6380664a0 msgr2=0x7ff638068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff6380664a0 0x7ff638068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff6580b0a70 tx=0x7ff648008040 comp rx=0 tx=0).stop 2023-11-28T21:08:53.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6580b32c0 msgr2=0x7ff658153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6580b32c0 0x7ff658153280 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff65001afb0 tx=0x7ff6500196a0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 shutdown_connections 2023-11-28T21:08:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff6380664a0 0x7ff638068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6580b32c0 0x7ff658153280 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6580ad700 0x7ff6581566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 --2- 172.21.15.6:0/1531869806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65806a580 0x7ff65814fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 >> 172.21.15.6:0/1531869806 conn(0x7ff6580cf7b0 msgr2=0x7ff6581547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 shutdown_connections 2023-11-28T21:08:53.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.503+0000 7ff65d85f640 1 -- 172.21.15.6:0/1531869806 wait complete. 2023-11-28T21:08:53.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:53.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:53.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.667+0000 7fe8c3c17640 1 Processor -- start 2023-11-28T21:08:53.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.667+0000 7fe8c3c17640 1 -- start start 2023-11-28T21:08:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c3c17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc0b4110 0x7fe8bc15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c3c17640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc0b30b0 con 0x7fe8bc06d060 2023-11-28T21:08:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c3c17640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc0b3350 con 0x7fe8bc143970 2023-11-28T21:08:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c3c17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc15e7e0 con 0x7fe8bc0b4110 2023-11-28T21:08:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c11b2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe8bc06d060 0x7fe8bc15da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34724/0 (socket says 172.21.15.6:34724) 2023-11-28T21:08:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c11b2640 1 -- 172.21.15.6:0/723097658 learned_addr learned my addr 172.21.15.6:0/723097658 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c21b4640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc0b4110 0x7fe8bc15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743811741 0 0) 0x7fe8bc0b30b0 con 0x7fe8bc06d060 2023-11-28T21:08:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a8003530 con 0x7fe8bc06d060 2023-11-28T21:08:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3603346990 0 0) 0x7fe8a8003530 con 0x7fe8bc06d060 2023-11-28T21:08:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc0b4110 msgr2=0x7fe8bc15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc0b4110 0x7fe8bc15e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 >> v1:172.21.15.31:6789/0 conn(0x7fe8bc143970 legacy=0x7fe8bc06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc0b3630 con 0x7fe8bc06d060 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fe8ac001680 con 0x7fe8bc06d060 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 >> v1:172.21.15.6:6789/0 conn(0x7fe8bc06d060 legacy=0x7fe8bc15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80039b0 0x7fe8a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8a80047d0 0x7fe8a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc0b4110 0x7fe8a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc15e7e0 con 0x7fe8a80047d0 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a800ba70 con 0x7fe8a80039b0 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a800bc30 con 0x7fe8bc0b4110 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c11b2640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8a80047d0 0x7fe8a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c19b3640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80039b0 0x7fe8a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c21b4640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc0b4110 0x7fe8a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c11b2640 1 -- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc0b4110 msgr2=0x7fe8a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c11b2640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc0b4110 0x7fe8a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c11b2640 1 -- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80039b0 msgr2=0x7fe8a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c11b2640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80039b0 0x7fe8a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.671+0000 7fe8c11b2640 1 -- 172.21.15.6:0/723097658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8003530 con 0x7fe8a80047d0 2023-11-28T21:08:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c11b2640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8a80047d0 0x7fe8a8004c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c210 tx=0x7fe8ac01f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf07833d30578b7b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac005ae0 con 0x7fe8a80047d0 2023-11-28T21:08:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac0ab070 con 0x7fe8a80047d0 2023-11-28T21:08:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c09b1640 1 -- 172.21.15.6:0/723097658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac005e80 con 0x7fe8a80047d0 2023-11-28T21:08:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c3c17640 1 -- 172.21.15.6:0/723097658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8a80047d0 msgr2=0x7fe8a8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c3c17640 1 --2- 172.21.15.6:0/723097658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8a80047d0 0x7fe8a8004c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c210 tx=0x7fe8ac01f350 comp rx=0 tx=0).stop 2023-11-28T21:08:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c21b4640 1 -- 172.21.15.6:0/723097658 reap_dead start 2023-11-28T21:08:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c3c17640 1 -- 172.21.15.6:0/723097658 shutdown_connections 2023-11-28T21:08:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c3c17640 1 -- 172.21.15.6:0/723097658 >> 172.21.15.6:0/723097658 conn(0x7fe8bc06a980 msgr2=0x7fe8bc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c3c17640 1 -- 172.21.15.6:0/723097658 shutdown_connections 2023-11-28T21:08:53.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.675+0000 7fe8c3c17640 1 -- 172.21.15.6:0/723097658 wait complete. 2023-11-28T21:08:53.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 Processor -- start 2023-11-28T21:08:53.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 -- start start 2023-11-28T21:08:53.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80047d0 0x7fe8bc1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0af7c0 0x7fe8bc0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc144020 0x7fe8bc1444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0b0180 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1f45c0 con 0x7fe8a80047d0 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1f35a0 con 0x7fe8bc144020 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c11b2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0af7c0 0x7fe8bc0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c11b2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0af7c0 0x7fe8bc0afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44186/0 (socket says 172.21.15.6:44186) 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c11b2640 1 -- 172.21.15.6:0/206069589 learned_addr learned my addr 172.21.15.6:0/206069589 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c21b4640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc144020 0x7fe8bc1444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c19b3640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80047d0 0x7fe8bc1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c11b2640 1 -- 172.21.15.6:0/206069589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc144020 msgr2=0x7fe8bc1444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c11b2640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc144020 0x7fe8bc1444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c11b2640 1 -- 172.21.15.6:0/206069589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80047d0 msgr2=0x7fe8bc1468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c11b2640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80047d0 0x7fe8bc1468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c11b2640 1 -- 172.21.15.6:0/206069589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc144d50 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c19b3640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80047d0 0x7fe8bc1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c11b2640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0af7c0 0x7fe8bc0afc40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac01f180 tx=0x7fe8a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8b27fc640 1 -- 172.21.15.6:0/206069589 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0049f0 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8b27fc640 1 -- 172.21.15.6:0/206069589 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac004b70 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc146e30 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8b27fc640 1 -- 172.21.15.6:0/206069589 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac007070 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc1f3ae0 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.679+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc072b90 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.683+0000 7fe8b27fc640 1 -- 172.21.15.6:0/206069589 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8ac0071d0 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.683+0000 7fe8b27fc640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe8a0066470 0x7fe8a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.683+0000 7fe8b27fc640 1 -- 172.21.15.6:0/206069589 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe8ac0b7040 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.683+0000 7fe8c19b3640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe8a0066470 0x7fe8a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:53.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.683+0000 7fe8c19b3640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe8a0066470 0x7fe8a0068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007fd0 tx=0x7fe8b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:53.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.687+0000 7fe8b27fc640 1 -- 172.21.15.6:0/206069589 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8ac0eec80 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.843+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8bc067800 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.843+0000 7fe8b27fc640 1 -- 172.21.15.6:0/206069589 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8ac0f22a0 con 0x7fe8bc0af7c0 2023-11-28T21:08:53.851 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe8a0066470 msgr2=0x7fe8a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe8a0066470 0x7fe8a0068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007fd0 tx=0x7fe8b8009040 comp rx=0 tx=0).stop 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0af7c0 msgr2=0x7fe8bc0afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0af7c0 0x7fe8bc0afc40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac01f180 tx=0x7fe8a8005800 comp rx=0 tx=0).stop 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 shutdown_connections 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe8a0066470 0x7fe8a0068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe8bc144020 0x7fe8bc1444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0af7c0 0x7fe8bc0afc40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 --2- 172.21.15.6:0/206069589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8a80047d0 0x7fe8bc1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 >> 172.21.15.6:0/206069589 conn(0x7fe8bc06a980 msgr2=0x7fe8bc15f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 shutdown_connections 2023-11-28T21:08:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:53.847+0000 7fe8c3c17640 1 -- 172.21.15.6:0/206069589 wait complete. 2023-11-28T21:08:53.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdceae54640 1 Processor -- start 2023-11-28T21:08:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdceae54640 1 -- start start 2023-11-28T21:08:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdceae54640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce406d8f0 0x7fdce40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdceae54640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce415d550 con 0x7fdce4159360 2023-11-28T21:08:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdceae54640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce415d830 con 0x7fdce40b3320 2023-11-28T21:08:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdceae54640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce415db10 con 0x7fdce406d8f0 2023-11-28T21:08:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce8bf0640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdce4159360 0x7fdce406d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34728/0 (socket says 172.21.15.6:34728) 2023-11-28T21:08:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce8bf0640 1 -- 172.21.15.6:0/3392679769 learned_addr learned my addr 172.21.15.6:0/3392679769 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce3fff640 1 --2- 172.21.15.6:0/3392679769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce406d8f0 0x7fdce40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce37fe640 1 -- 172.21.15.6:0/3392679769 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081808968 0 0) 0x7fdce415d550 con 0x7fdce4159360 2023-11-28T21:08:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce37fe640 1 -- 172.21.15.6:0/3392679769 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd4003530 con 0x7fdce4159360 2023-11-28T21:08:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce37fe640 1 -- 172.21.15.6:0/3392679769 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810653592 0 0) 0x7fdce415d830 con 0x7fdce40b3320 2023-11-28T21:08:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce37fe640 1 -- 172.21.15.6:0/3392679769 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce415d550 con 0x7fdce40b3320 2023-11-28T21:08:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce3fff640 1 -- 172.21.15.6:0/3392679769 >> v1:172.21.15.31:6789/0 conn(0x7fdce40b3320 legacy=0x7fdce40b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce3fff640 1 -- 172.21.15.6:0/3392679769 >> v1:172.21.15.6:6789/0 conn(0x7fdce4159360 legacy=0x7fdce406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.015+0000 7fdce3fff640 1 -- 172.21.15.6:0/3392679769 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce415ddf0 con 0x7fdce406d8f0 2023-11-28T21:08:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdce3fff640 1 --2- 172.21.15.6:0/3392679769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce406d8f0 0x7fdce40ccea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000a990 tx=0x7fdcd001c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef00e89f8d50a3e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdce37fe640 1 -- 172.21.15.6:0/3392679769 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00a66b0 con 0x7fdce406d8f0 2023-11-28T21:08:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdce37fe640 1 -- 172.21.15.6:0/3392679769 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd00a6810 con 0x7fdce406d8f0 2023-11-28T21:08:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdce37fe640 1 -- 172.21.15.6:0/3392679769 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00a6ba0 con 0x7fdce406d8f0 2023-11-28T21:08:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdceae54640 1 -- 172.21.15.6:0/3392679769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce406d8f0 msgr2=0x7fdce40ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdceae54640 1 --2- 172.21.15.6:0/3392679769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce406d8f0 0x7fdce40ccea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000a990 tx=0x7fdcd001c790 comp rx=0 tx=0).stop 2023-11-28T21:08:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdceae54640 1 -- 172.21.15.6:0/3392679769 shutdown_connections 2023-11-28T21:08:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdceae54640 1 --2- 172.21.15.6:0/3392679769 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce406d8f0 0x7fdce40ccea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdceae54640 1 -- 172.21.15.6:0/3392679769 >> 172.21.15.6:0/3392679769 conn(0x7fdce406a980 msgr2=0x7fdce406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdceae54640 1 -- 172.21.15.6:0/3392679769 shutdown_connections 2023-11-28T21:08:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.019+0000 7fdceae54640 1 -- 172.21.15.6:0/3392679769 wait complete. 2023-11-28T21:08:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 Processor -- start 2023-11-28T21:08:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 -- start start 2023-11-28T21:08:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce406d8f0 0x7fdce414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40b3320 0x7fdce4154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce4159360 0x7fdce4154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40af6a0 con 0x7fdce406d8f0 2023-11-28T21:08:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40aea90 con 0x7fdce4159360 2023-11-28T21:08:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40aed70 con 0x7fdce40b3320 2023-11-28T21:08:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce8bf0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce406d8f0 0x7fdce414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce8bf0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce406d8f0 0x7fdce414da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44190/0 (socket says 172.21.15.6:44190) 2023-11-28T21:08:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce8bf0640 1 -- 172.21.15.6:0/818924415 learned_addr learned my addr 172.21.15.6:0/818924415 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce3fff640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40b3320 0x7fdce4154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce93f1640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce4159360 0x7fdce4154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce8bf0640 1 -- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40b3320 msgr2=0x7fdce4154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce8bf0640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40b3320 0x7fdce4154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce8bf0640 1 -- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce4159360 msgr2=0x7fdce4154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce8bf0640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce4159360 0x7fdce4154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce8bf0640 1 -- 172.21.15.6:0/818924415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd000a5c0 con 0x7fdce406d8f0 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce3fff640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40b3320 0x7fdce4154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce93f1640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce4159360 0x7fdce4154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce8bf0640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce406d8f0 0x7fdce414da10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c4d0 tx=0x7fdcd800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce17fa640 1 -- 172.21.15.6:0/818924415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8005cf0 con 0x7fdce406d8f0 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce17fa640 1 -- 172.21.15.6:0/818924415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8005e50 con 0x7fdce406d8f0 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdce17fa640 1 -- 172.21.15.6:0/818924415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8007290 con 0x7fdce406d8f0 2023-11-28T21:08:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce40af050 con 0x7fdce406d8f0 2023-11-28T21:08:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce414df50 con 0x7fdce406d8f0 2023-11-28T21:08:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.023+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce4072b90 con 0x7fdce406d8f0 2023-11-28T21:08:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.027+0000 7fdce17fa640 1 -- 172.21.15.6:0/818924415 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdcd80073f0 con 0x7fdce406d8f0 2023-11-28T21:08:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.027+0000 7fdce17fa640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdcc8066470 0x7fdcc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.027+0000 7fdce17fa640 1 -- 172.21.15.6:0/818924415 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdcd8083510 con 0x7fdce406d8f0 2023-11-28T21:08:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.027+0000 7fdce3fff640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdcc8066470 0x7fdcc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.027+0000 7fdce3fff640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdcc8066470 0x7fdcc8068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00af000 tx=0x7fdcd00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.031+0000 7fdce17fa640 1 -- 172.21.15.6:0/818924415 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdcd8050900 con 0x7fdce406d8f0 2023-11-28T21:08:54.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdce415ca80 con 0x7fdce406d8f0 2023-11-28T21:08:54.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdce17fa640 1 -- 172.21.15.6:0/818924415 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdcd8053f20 con 0x7fdce406d8f0 2023-11-28T21:08:54.192 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdcc8066470 msgr2=0x7fdcc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdcc8066470 0x7fdcc8068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00af000 tx=0x7fdcd00a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce406d8f0 msgr2=0x7fdce414da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce406d8f0 0x7fdce414da10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800c4d0 tx=0x7fdcd800c990 comp rx=0 tx=0).stop 2023-11-28T21:08:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 shutdown_connections 2023-11-28T21:08:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdcc8066470 0x7fdcc8068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdce4159360 0x7fdce4154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdce40b3320 0x7fdce4154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 --2- 172.21.15.6:0/818924415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce406d8f0 0x7fdce414da10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 >> 172.21.15.6:0/818924415 conn(0x7fdce406a980 msgr2=0x7fdce414b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 shutdown_connections 2023-11-28T21:08:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.187+0000 7fdceae54640 1 -- 172.21.15.6:0/818924415 wait complete. 2023-11-28T21:08:54.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:54.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb45bff8640 1 Processor -- start 2023-11-28T21:08:54.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb45bff8640 1 -- start start 2023-11-28T21:08:54.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb45bff8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45406ca00 0x7fb4540cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb45bff8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb45415c440 0x7fb45415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb45bff8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4540cc930 con 0x7fb45406cde0 2023-11-28T21:08:54.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb45bff8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4540cd400 con 0x7fb45415c440 2023-11-28T21:08:54.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb45bff8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540ccb60 con 0x7fb45406ca00 2023-11-28T21:08:54.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb459593640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb45406cde0 0x7fb45415bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34740/0 (socket says 172.21.15.6:34740) 2023-11-28T21:08:54.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb459593640 1 -- 172.21.15.6:0/1493485385 learned_addr learned my addr 172.21.15.6:0/1493485385 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb459d94640 1 --2- 172.21.15.6:0/1493485385 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45406ca00 0x7fb4540cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb45a595640 1 --2- 172.21.15.6:0/1493485385 >> v2:172.21.15.31:3300/0 conn(0x7fb45415c440 0x7fb45415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb458d92640 1 -- 172.21.15.6:0/1493485385 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336046972 0 0) 0x7fb4540cc930 con 0x7fb45406cde0 2023-11-28T21:08:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb458d92640 1 -- 172.21.15.6:0/1493485385 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb440003530 con 0x7fb45406cde0 2023-11-28T21:08:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb459d94640 1 -- 172.21.15.6:0/1493485385 >> v2:172.21.15.31:3300/0 conn(0x7fb45415c440 msgr2=0x7fb45415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb459d94640 1 --2- 172.21.15.6:0/1493485385 >> v2:172.21.15.31:3300/0 conn(0x7fb45415c440 0x7fb45415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb459d94640 1 -- 172.21.15.6:0/1493485385 >> v1:172.21.15.6:6789/0 conn(0x7fb45406cde0 legacy=0x7fb45415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb458d92640 1 -- 172.21.15.6:0/1493485385 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 593233907 0 0) 0x7fb440003530 con 0x7fb45406cde0 2023-11-28T21:08:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb459d94640 1 -- 172.21.15.6:0/1493485385 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540cce40 con 0x7fb45406ca00 2023-11-28T21:08:54.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.355+0000 7fb45a595640 1 --2- 172.21.15.6:0/1493485385 >> v2:172.21.15.31:3300/0 conn(0x7fb45415c440 0x7fb45415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:54.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb459d94640 1 --2- 172.21.15.6:0/1493485385 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45406ca00 0x7fb4540cc3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4500097c0 tx=0x7fb45001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b87d4eb573962a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:54.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb458d92640 1 -- 172.21.15.6:0/1493485385 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500ac620 con 0x7fb45406ca00 2023-11-28T21:08:54.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb458d92640 1 -- 172.21.15.6:0/1493485385 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4500ac780 con 0x7fb45406ca00 2023-11-28T21:08:54.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb458d92640 1 -- 172.21.15.6:0/1493485385 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500acb10 con 0x7fb45406ca00 2023-11-28T21:08:54.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb45bff8640 1 -- 172.21.15.6:0/1493485385 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45406ca00 msgr2=0x7fb4540cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb45bff8640 1 --2- 172.21.15.6:0/1493485385 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45406ca00 0x7fb4540cc3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4500097c0 tx=0x7fb45001c3c0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb45bff8640 1 -- 172.21.15.6:0/1493485385 shutdown_connections 2023-11-28T21:08:54.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb45bff8640 1 --2- 172.21.15.6:0/1493485385 >> v2:172.21.15.31:3300/0 conn(0x7fb45415c440 0x7fb45415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb45bff8640 1 --2- 172.21.15.6:0/1493485385 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45406ca00 0x7fb4540cc3f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb45bff8640 1 -- 172.21.15.6:0/1493485385 >> 172.21.15.6:0/1493485385 conn(0x7fb45406a980 msgr2=0x7fb45406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb45bff8640 1 -- 172.21.15.6:0/1493485385 shutdown_connections 2023-11-28T21:08:54.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.359+0000 7fb45bff8640 1 -- 172.21.15.6:0/1493485385 wait complete. 2023-11-28T21:08:54.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 Processor -- start 2023-11-28T21:08:54.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 -- start start 2023-11-28T21:08:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45406ca00 0x7fb4540a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb45406cde0 0x7fb454153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45415c440 0x7fb4541543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540aa3f0 con 0x7fb45406ca00 2023-11-28T21:08:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b3f60 con 0x7fb45406cde0 2023-11-28T21:08:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540b2ec0 con 0x7fb45415c440 2023-11-28T21:08:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459d94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45406ca00 0x7fb4540a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459d94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45406ca00 0x7fb4540a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44206/0 (socket says 172.21.15.6:44206) 2023-11-28T21:08:54.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459d94640 1 -- 172.21.15.6:0/2180313529 learned_addr learned my addr 172.21.15.6:0/2180313529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45a595640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45415c440 0x7fb4541543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459593640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb45406cde0 0x7fb454153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459d94640 1 -- 172.21.15.6:0/2180313529 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45415c440 msgr2=0x7fb4541543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459d94640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45415c440 0x7fb4541543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459d94640 1 -- 172.21.15.6:0/2180313529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb45406cde0 msgr2=0x7fb454153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459d94640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb45406cde0 0x7fb454153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459d94640 1 -- 172.21.15.6:0/2180313529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009a70 con 0x7fb45406ca00 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb459d94640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45406ca00 0x7fb4540a8f30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb450019ff0 tx=0x7fb45001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb44a7fc640 1 -- 172.21.15.6:0/2180313529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500ac620 con 0x7fb45406ca00 2023-11-28T21:08:54.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb44a7fc640 1 -- 172.21.15.6:0/2180313529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4500b8450 con 0x7fb45406ca00 2023-11-28T21:08:54.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb450009420 con 0x7fb45406ca00 2023-11-28T21:08:54.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb44a7fc640 1 -- 172.21.15.6:0/2180313529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500b87e0 con 0x7fb45406ca00 2023-11-28T21:08:54.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.363+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4540b3480 con 0x7fb45406ca00 2023-11-28T21:08:54.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.367+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45415b360 con 0x7fb45406ca00 2023-11-28T21:08:54.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.367+0000 7fb44a7fc640 1 -- 172.21.15.6:0/2180313529 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4500aa070 con 0x7fb45406ca00 2023-11-28T21:08:54.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.367+0000 7fb44a7fc640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb438066470 0x7fb438068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.367+0000 7fb44a7fc640 1 -- 172.21.15.6:0/2180313529 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb45011e4e0 con 0x7fb45406ca00 2023-11-28T21:08:54.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.367+0000 7fb459593640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb438066470 0x7fb438068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.367+0000 7fb459593640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb438066470 0x7fb438068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4440013d0 tx=0x7fb444009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:54.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.371+0000 7fb44a7fc640 1 -- 172.21.15.6:0/2180313529 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4500eb8e0 con 0x7fb45406ca00 2023-11-28T21:08:54.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.531+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb454072b90 con 0x7fb45406ca00 2023-11-28T21:08:54.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.531+0000 7fb44a7fc640 1 -- 172.21.15.6:0/2180313529 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4500eef00 con 0x7fb45406ca00 2023-11-28T21:08:54.538 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb438066470 msgr2=0x7fb438068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb438066470 0x7fb438068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb4440013d0 tx=0x7fb444009040 comp rx=0 tx=0).stop 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45406ca00 msgr2=0x7fb4540a8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45406ca00 0x7fb4540a8f30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb450019ff0 tx=0x7fb45001ac00 comp rx=0 tx=0).stop 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 shutdown_connections 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb438066470 0x7fb438068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb45415c440 0x7fb4541543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb45406cde0 0x7fb454153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 --2- 172.21.15.6:0/2180313529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45406ca00 0x7fb4540a8f30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 >> 172.21.15.6:0/2180313529 conn(0x7fb45406a980 msgr2=0x7fb4540aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 shutdown_connections 2023-11-28T21:08:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.535+0000 7fb45bff8640 1 -- 172.21.15.6:0/2180313529 wait complete. 2023-11-28T21:08:54.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T21:08:54.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f420b59e640 1 Processor -- start 2023-11-28T21:08:54.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f420b59e640 1 -- start start 2023-11-28T21:08:54.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f420b59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f420c0d1c20 0x7f420c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f420b59e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f420c0cffe0 0x7f420c0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f420b59e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c0d0d10 con 0x7f420c0c94c0 2023-11-28T21:08:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f420b59e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0d3a50 con 0x7f420c0d1c20 2023-11-28T21:08:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f420b59e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c0c98a0 con 0x7f420c0cffe0 2023-11-28T21:08:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f4203fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f420c0d1c20 0x7f420c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f4203fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f420c0d1c20 0x7f420c0b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44208/0 (socket says 172.21.15.6:44208) 2023-11-28T21:08:54.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f4203fff640 1 -- 172.21.15.6:0/2890644460 learned_addr learned my addr 172.21.15.6:0/2890644460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:54.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f420ad9d640 1 --2- 172.21.15.6:0/2890644460 >> v2:172.21.15.31:3300/0 conn(0x7f420c0cffe0 0x7f420c0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f4203fff640 1 -- 172.21.15.6:0/2890644460 >> v2:172.21.15.31:3300/0 conn(0x7f420c0cffe0 msgr2=0x7f420c0cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:54.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f4203fff640 1 --2- 172.21.15.6:0/2890644460 >> v2:172.21.15.31:3300/0 conn(0x7f420c0cffe0 0x7f420c0cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f4203fff640 1 -- 172.21.15.6:0/2890644460 >> v1:172.21.15.31:6789/0 conn(0x7f420c0c94c0 legacy=0x7f420c0d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:54.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.699+0000 7f4203fff640 1 -- 172.21.15.6:0/2890644460 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0b46f0 con 0x7f420c0d1c20 2023-11-28T21:08:54.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f4203fff640 1 --2- 172.21.15.6:0/2890644460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 0x7f420c0b3eb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f420c08d280 tx=0x7f41f401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6b1d1cdade0b4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:54.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f4209d9b640 1 -- 172.21.15.6:0/2890644460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40aa5f0 con 0x7f420c0d1c20 2023-11-28T21:08:54.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f4209d9b640 1 -- 172.21.15.6:0/2890644460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f40aa750 con 0x7f420c0d1c20 2023-11-28T21:08:54.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f4209d9b640 1 -- 172.21.15.6:0/2890644460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40aaae0 con 0x7f420c0d1c20 2023-11-28T21:08:54.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f420b59e640 1 -- 172.21.15.6:0/2890644460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 msgr2=0x7f420c0b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f420b59e640 1 --2- 172.21.15.6:0/2890644460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 0x7f420c0b3eb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f420c08d280 tx=0x7f41f401c490 comp rx=0 tx=0).stop 2023-11-28T21:08:54.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f420b59e640 1 -- 172.21.15.6:0/2890644460 shutdown_connections 2023-11-28T21:08:54.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f420b59e640 1 --2- 172.21.15.6:0/2890644460 >> v2:172.21.15.31:3300/0 conn(0x7f420c0cffe0 0x7f420c0cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f420b59e640 1 --2- 172.21.15.6:0/2890644460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 0x7f420c0b3eb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f420b59e640 1 -- 172.21.15.6:0/2890644460 >> 172.21.15.6:0/2890644460 conn(0x7f420c0d2f30 msgr2=0x7f420c0d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:54.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f420b59e640 1 -- 172.21.15.6:0/2890644460 shutdown_connections 2023-11-28T21:08:54.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.703+0000 7f420b59e640 1 -- 172.21.15.6:0/2890644460 wait complete. 2023-11-28T21:08:54.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 Processor -- start 2023-11-28T21:08:54.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 -- start start 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0c94c0 0x7f420c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0cffe0 0x7f420c157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 0x7f420c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c06caa0 con 0x7f420c0d1c20 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1565a0 con 0x7f420c0cffe0 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c156880 con 0x7f420c0c94c0 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 0x7f420c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 0x7f420c15b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44212/0 (socket says 172.21.15.6:44212) 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420ad9d640 1 -- 172.21.15.6:0/2181748693 learned_addr learned my addr 172.21.15.6:0/2181748693 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f4203fff640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0cffe0 0x7f420c157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420a59c640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0c94c0 0x7f420c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420ad9d640 1 -- 172.21.15.6:0/2181748693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0c94c0 msgr2=0x7f420c0ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420ad9d640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0c94c0 0x7f420c0ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420ad9d640 1 -- 172.21.15.6:0/2181748693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0cffe0 msgr2=0x7f420c157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420ad9d640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0cffe0 0x7f420c157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420ad9d640 1 -- 172.21.15.6:0/2181748693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40094d0 con 0x7f420c0d1c20 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420a59c640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0c94c0 0x7f420c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420ad9d640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 0x7f420c15b570 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4204007e40 tx=0x7f420400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f4202ffd640 1 -- 172.21.15.6:0/2181748693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204014620 con 0x7f420c0d1c20 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f4202ffd640 1 -- 172.21.15.6:0/2181748693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420400ee90 con 0x7f420c0d1c20 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f4202ffd640 1 -- 172.21.15.6:0/2181748693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42040149e0 con 0x7f420c0d1c20 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c156b60 con 0x7f420c0d1c20 2023-11-28T21:08:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.707+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c157120 con 0x7f420c0d1c20 2023-11-28T21:08:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.711+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c04e850 con 0x7f420c0d1c20 2023-11-28T21:08:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.711+0000 7f4202ffd640 1 -- 172.21.15.6:0/2181748693 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4204014b40 con 0x7f420c0d1c20 2023-11-28T21:08:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.711+0000 7f4202ffd640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f41ec066470 0x7f41ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.711+0000 7f4202ffd640 1 -- 172.21.15.6:0/2181748693 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4204084830 con 0x7f420c0d1c20 2023-11-28T21:08:54.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.711+0000 7f420a59c640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f41ec066470 0x7f41ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:54.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.711+0000 7f420a59c640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f41ec066470 0x7f41ec068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f420c0b2570 tx=0x7f41fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.715+0000 7f4202ffd640 1 -- 172.21.15.6:0/2181748693 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4204051c20 con 0x7f420c0d1c20 2023-11-28T21:08:54.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f420c0b8d20 con 0x7f420c0d1c20 2023-11-28T21:08:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f4202ffd640 1 -- 172.21.15.6:0/2181748693 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4204055240 con 0x7f420c0d1c20 2023-11-28T21:08:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f41ec066470 msgr2=0x7f41ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f41ec066470 0x7f41ec068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f420c0b2570 tx=0x7f41fc009040 comp rx=0 tx=0).stop 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 msgr2=0x7f420c15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 0x7f420c15b570 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4204007e40 tx=0x7f420400e4b0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 shutdown_connections 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f41ec066470 0x7f41ec068930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f420c0d1c20 0x7f420c15b570 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f420c0cffe0 0x7f420c157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 --2- 172.21.15.6:0/2181748693 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f420c0c94c0 0x7f420c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 >> 172.21.15.6:0/2181748693 conn(0x7f420c0d2f30 msgr2=0x7f420c0d3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 shutdown_connections 2023-11-28T21:08:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:54.887+0000 7f420b59e640 1 -- 172.21.15.6:0/2181748693 wait complete. 2023-11-28T21:08:54.913 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-11-28T21:08:54.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:54.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-28T21:08:54.936 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:08:54.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-11-28T21:08:54.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:54.936 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T21:08:54.988 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:08:54.988 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:54.999 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:08:54.999 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:55.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:55.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa3655f8640 1 Processor -- start 2023-11-28T21:08:55.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa3655f8640 1 -- start start 2023-11-28T21:08:55.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa3655f8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa36013e090 0x7fa3600cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa3655f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa360140e90 0x7fa36006cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa3655f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3600cea50 con 0x7fa36015c250 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa3655f8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36013e470 con 0x7fa36013e090 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa3655f8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3600ce1b0 con 0x7fa360140e90 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa35effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa36013e090 0x7fa3600cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa35effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa36013e090 0x7fa3600cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44222/0 (socket says 172.21.15.6:44222) 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa35effd640 1 -- 172.21.15.6:0/2405323319 learned_addr learned my addr 172.21.15.6:0/2405323319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.191+0000 7fa35f7fe640 1 --2- 172.21.15.6:0/2405323319 >> v2:172.21.15.31:3300/0 conn(0x7fa360140e90 0x7fa36006cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.195+0000 7fa35effd640 1 -- 172.21.15.6:0/2405323319 >> v2:172.21.15.31:3300/0 conn(0x7fa360140e90 msgr2=0x7fa36006cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.195+0000 7fa35effd640 1 --2- 172.21.15.6:0/2405323319 >> v2:172.21.15.31:3300/0 conn(0x7fa360140e90 0x7fa36006cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.195+0000 7fa35effd640 1 -- 172.21.15.6:0/2405323319 >> v1:172.21.15.31:6789/0 conn(0x7fa36015c250 legacy=0x7fa360140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:55.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.195+0000 7fa35effd640 1 -- 172.21.15.6:0/2405323319 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600ce490 con 0x7fa36013e090 2023-11-28T21:08:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.195+0000 7fa35effd640 1 --2- 172.21.15.6:0/2405323319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa36013e090 0x7fa3600cd740 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa3600b14a0 tx=0x7fa35001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f6eabc097eb78f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.195+0000 7fa35e7fc640 1 -- 172.21.15.6:0/2405323319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3500ab600 con 0x7fa36013e090 2023-11-28T21:08:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.195+0000 7fa35e7fc640 1 -- 172.21.15.6:0/2405323319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3500ab760 con 0x7fa36013e090 2023-11-28T21:08:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.195+0000 7fa35e7fc640 1 -- 172.21.15.6:0/2405323319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3500abaf0 con 0x7fa36013e090 2023-11-28T21:08:55.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 -- 172.21.15.6:0/2405323319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa36013e090 msgr2=0x7fa3600cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 --2- 172.21.15.6:0/2405323319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa36013e090 0x7fa3600cd740 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa3600b14a0 tx=0x7fa35001c400 comp rx=0 tx=0).stop 2023-11-28T21:08:55.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 -- 172.21.15.6:0/2405323319 shutdown_connections 2023-11-28T21:08:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 --2- 172.21.15.6:0/2405323319 >> v2:172.21.15.31:3300/0 conn(0x7fa360140e90 0x7fa36006cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 --2- 172.21.15.6:0/2405323319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa36013e090 0x7fa3600cd740 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 -- 172.21.15.6:0/2405323319 >> 172.21.15.6:0/2405323319 conn(0x7fa36006ab80 msgr2=0x7fa3600b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 -- 172.21.15.6:0/2405323319 shutdown_connections 2023-11-28T21:08:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 -- 172.21.15.6:0/2405323319 wait complete. 2023-11-28T21:08:55.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 Processor -- start 2023-11-28T21:08:55.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 -- start start 2023-11-28T21:08:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa36013e090 0x7fa360154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa360140e90 0x7fa3600accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa36015c250 0x7fa3600ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600b06e0 con 0x7fa360140e90 2023-11-28T21:08:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3600ad730 con 0x7fa36013e090 2023-11-28T21:08:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa3655f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36012d0d0 con 0x7fa36015c250 2023-11-28T21:08:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa357fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa360140e90 0x7fa3600accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa35effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa36013e090 0x7fa360154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa357fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa360140e90 0x7fa3600accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44236/0 (socket says 172.21.15.6:44236) 2023-11-28T21:08:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa357fff640 1 -- 172.21.15.6:0/1938296747 learned_addr learned my addr 172.21.15.6:0/1938296747 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.199+0000 7fa35f7fe640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa36015c250 0x7fa3600ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa357fff640 1 -- 172.21.15.6:0/1938296747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa36015c250 msgr2=0x7fa3600ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa357fff640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa36015c250 0x7fa3600ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa357fff640 1 -- 172.21.15.6:0/1938296747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa36013e090 msgr2=0x7fa360154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa357fff640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa36013e090 0x7fa360154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa357fff640 1 -- 172.21.15.6:0/1938296747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3500094d0 con 0x7fa360140e90 2023-11-28T21:08:55.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa357fff640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa360140e90 0x7fa3600accb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa34800c410 tx=0x7fa34800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa3577fe640 1 -- 172.21.15.6:0/1938296747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011790 con 0x7fa360140e90 2023-11-28T21:08:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa3577fe640 1 -- 172.21.15.6:0/1938296747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3480118f0 con 0x7fa360140e90 2023-11-28T21:08:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36012d3b0 con 0x7fa360140e90 2023-11-28T21:08:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa3577fe640 1 -- 172.21.15.6:0/1938296747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011ce0 con 0x7fa360140e90 2023-11-28T21:08:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36012d970 con 0x7fa360140e90 2023-11-28T21:08:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36012db90 con 0x7fa360140e90 2023-11-28T21:08:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa3577fe640 1 -- 172.21.15.6:0/1938296747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa34801c460 con 0x7fa360140e90 2023-11-28T21:08:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa3577fe640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa340066470 0x7fa340068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa3577fe640 1 -- 172.21.15.6:0/1938296747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa348083be0 con 0x7fa360140e90 2023-11-28T21:08:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.203+0000 7fa35effd640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa340066470 0x7fa340068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.207+0000 7fa35effd640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa340066470 0x7fa340068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa3500af000 tx=0x7fa3500b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.207+0000 7fa3577fe640 1 -- 172.21.15.6:0/1938296747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa348050ff0 con 0x7fa360140e90 2023-11-28T21:08:55.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.367+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3600674d0 con 0x7fa360140e90 2023-11-28T21:08:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3577fe640 1 -- 172.21.15.6:0/1938296747 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16590 (secure 0 0 0) 0x7fa348054610 con 0x7fa360140e90 2023-11-28T21:08:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:55.376 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:52.362503+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa340066470 msgr2=0x7fa340068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa340066470 0x7fa340068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa3500af000 tx=0x7fa3500b6040 comp rx=0 tx=0).stop 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa360140e90 msgr2=0x7fa3600accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa360140e90 0x7fa3600accb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa34800c410 tx=0x7fa34800c8d0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 shutdown_connections 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa340066470 0x7fa340068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa36015c250 0x7fa3600ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa360140e90 0x7fa3600accb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 --2- 172.21.15.6:0/1938296747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa36013e090 0x7fa360154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 >> 172.21.15.6:0/1938296747 conn(0x7fa36006ab80 msgr2=0x7fa3600b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 shutdown_connections 2023-11-28T21:08:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.371+0000 7fa3655f8640 1 -- 172.21.15.6:0/1938296747 wait complete. 2023-11-28T21:08:55.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:55.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:55.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d9966b640 1 Processor -- start 2023-11-28T21:08:55.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d9966b640 1 -- start start 2023-11-28T21:08:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d9966b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9415e270 0x7f9d9406ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d9966b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d94157bd0 con 0x7f9d9415d780 2023-11-28T21:08:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d9966b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9406b2b0 con 0x7f9d940b42e0 2023-11-28T21:08:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d9966b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9406b590 con 0x7f9d9415e270 2023-11-28T21:08:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d92ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9d9415d780 0x7f9d9415db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34742/0 (socket says 172.21.15.6:34742) 2023-11-28T21:08:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d92ffd640 1 -- 172.21.15.6:0/3645406272 learned_addr learned my addr 172.21.15.6:0/3645406272 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d937fe640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9415e270 0x7f9d9406ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659780857 0 0) 0x7f9d94157bd0 con 0x7f9d9415d780 2023-11-28T21:08:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.539+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d80003530 con 0x7f9d9415d780 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777445912 0 0) 0x7f9d9406b2b0 con 0x7f9d940b42e0 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d94157bd0 con 0x7f9d940b42e0 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2141447591 0 0) 0x7f9d80003530 con 0x7f9d9415d780 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9415e270 msgr2=0x7f9d9406ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9415e270 0x7f9d9406ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 >> v1:172.21.15.31:6789/0 conn(0x7f9d940b42e0 legacy=0x7f9d9406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9406b870 con 0x7f9d9415d780 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f9d84001680 con 0x7f9d9415d780 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d937fe640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9415e270 0x7f9d9406ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 >> v1:172.21.15.6:6789/0 conn(0x7f9d9415d780 legacy=0x7f9d9415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9415e270 0x7f9d80003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d80004d10 0x7f9d80005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9406b590 con 0x7f9d800040d0 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8000bb50 con 0x7f9d80004d10 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8000bd10 con 0x7f9d9415e270 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d92ffd640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9415e270 0x7f9d80003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d937fe640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d80004d10 0x7f9d80005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d8bfff640 1 -- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9415e270 msgr2=0x7f9d80003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9415e270 0x7f9d80003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d8bfff640 1 -- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d80004d10 msgr2=0x7f9d80005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d80004d10 0x7f9d80005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d8bfff640 1 -- 172.21.15.6:0/3645406272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c009a70 con 0x7f9d800040d0 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.543+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d800047d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9d940b4770 tx=0x7f9d7c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd51faca2d2cc71 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0052d0 con 0x7f9d800040d0 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c0a7050 con 0x7f9d800040d0 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d927fc640 1 -- 172.21.15.6:0/3645406272 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c003600 con 0x7f9d800040d0 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 -- 172.21.15.6:0/3645406272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 msgr2=0x7f9d800047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 --2- 172.21.15.6:0/3645406272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d800047d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9d940b4770 tx=0x7f9d7c01c510 comp rx=0 tx=0).stop 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d937fe640 1 -- 172.21.15.6:0/3645406272 reap_dead start 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 -- 172.21.15.6:0/3645406272 shutdown_connections 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 -- 172.21.15.6:0/3645406272 >> 172.21.15.6:0/3645406272 conn(0x7f9d940b1670 msgr2=0x7f9d940b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 -- 172.21.15.6:0/3645406272 shutdown_connections 2023-11-28T21:08:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 -- 172.21.15.6:0/3645406272 wait complete. 2023-11-28T21:08:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 Processor -- start 2023-11-28T21:08:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 -- start start 2023-11-28T21:08:55.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d9414fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d9414b310 0x7f9d9406e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9414f050 0x7f9d9414f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9414b790 con 0x7f9d800040d0 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9414fa10 con 0x7f9d9414b310 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d9966b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9406ec50 con 0x7f9d9414f050 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d92ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d9414fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d92ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d9414fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44254/0 (socket says 172.21.15.6:44254) 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.547+0000 7f9d92ffd640 1 -- 172.21.15.6:0/2427304456 learned_addr learned my addr 172.21.15.6:0/2427304456 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d9414b310 0x7f9d9406e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d937fe640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9414f050 0x7f9d9414f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d92ffd640 1 -- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9414f050 msgr2=0x7f9d9414f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d92ffd640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9414f050 0x7f9d9414f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d92ffd640 1 -- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d9414b310 msgr2=0x7f9d9406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d92ffd640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d9414b310 0x7f9d9406e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d92ffd640 1 -- 172.21.15.6:0/2427304456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9406cdb0 con 0x7f9d800040d0 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d9414b310 0x7f9d9406e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d937fe640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9414f050 0x7f9d9414f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d92ffd640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d9414fe40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9d84004f00 tx=0x7f9d84007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2427304456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8400f7b0 con 0x7f9d800040d0 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2427304456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8400f930 con 0x7f9d800040d0 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9414ce30 con 0x7f9d800040d0 2023-11-28T21:08:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2427304456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8400fce0 con 0x7f9d800040d0 2023-11-28T21:08:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9414d4f0 con 0x7f9d800040d0 2023-11-28T21:08:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9406cc10 con 0x7f9d800040d0 2023-11-28T21:08:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2427304456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d8401d460 con 0x7f9d800040d0 2023-11-28T21:08:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d8b7fe640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d740664a0 0x7f9d74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2427304456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9d84083fb0 con 0x7f9d800040d0 2023-11-28T21:08:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.551+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d740664a0 0x7f9d74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.555+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d740664a0 0x7f9d74068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c007fd0 tx=0x7f9d7c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.555+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2427304456 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d9406cc10 con 0x7f9d800040d0 2023-11-28T21:08:55.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.715+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d9406cc10 con 0x7f9d800040d0 2023-11-28T21:08:55.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.715+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2427304456 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d9406cc10 con 0x7f9d800040d0 2023-11-28T21:08:55.722 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d740664a0 msgr2=0x7f9d74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d740664a0 0x7f9d74068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c007fd0 tx=0x7f9d7c0a6000 comp rx=0 tx=0).stop 2023-11-28T21:08:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 msgr2=0x7f9d9414fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d9414fe40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9d84004f00 tx=0x7f9d84007430 comp rx=0 tx=0).stop 2023-11-28T21:08:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 shutdown_connections 2023-11-28T21:08:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d740664a0 0x7f9d74068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d9414f050 0x7f9d9414f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d9414b310 0x7f9d9406e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 --2- 172.21.15.6:0/2427304456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d800040d0 0x7f9d9414fe40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 >> 172.21.15.6:0/2427304456 conn(0x7f9d940b1670 msgr2=0x7f9d9415db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 shutdown_connections 2023-11-28T21:08:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.719+0000 7f9d9966b640 1 -- 172.21.15.6:0/2427304456 wait complete. 2023-11-28T21:08:55.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.883+0000 7fb39e9e6640 1 Processor -- start 2023-11-28T21:08:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.883+0000 7fb39e9e6640 1 -- start start 2023-11-28T21:08:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39e9e6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e370 0x7fb3980ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39e9e6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb3980cbf40 0x7fb39815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39e9e6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39815b510 con 0x7fb39815e750 2023-11-28T21:08:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39e9e6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3980cd730 con 0x7fb3980cbf40 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39e9e6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39813d450 con 0x7fb39815e370 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb3977fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb39815e750 0x7fb3980cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34752/0 (socket says 172.21.15.6:34752) 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb3977fe640 1 -- 172.21.15.6:0/2028743475 learned_addr learned my addr 172.21.15.6:0/2028743475 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39cf83640 1 --2- 172.21.15.6:0/2028743475 >> v2:172.21.15.31:3300/0 conn(0x7fb3980cbf40 0x7fb39815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb397fff640 1 --2- 172.21.15.6:0/2028743475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e370 0x7fb3980ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb396ffd640 1 -- 172.21.15.6:0/2028743475 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177591790 0 0) 0x7fb39815b510 con 0x7fb39815e750 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb396ffd640 1 -- 172.21.15.6:0/2028743475 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb380003530 con 0x7fb39815e750 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39cf83640 1 -- 172.21.15.6:0/2028743475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e370 msgr2=0x7fb3980ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39cf83640 1 --2- 172.21.15.6:0/2028743475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e370 0x7fb3980ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39cf83640 1 -- 172.21.15.6:0/2028743475 >> v1:172.21.15.6:6789/0 conn(0x7fb39815e750 legacy=0x7fb3980cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb39cf83640 1 -- 172.21.15.6:0/2028743475 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3980cd940 con 0x7fb3980cbf40 2023-11-28T21:08:55.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.887+0000 7fb397fff640 1 --2- 172.21.15.6:0/2028743475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e370 0x7fb3980ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:08:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39cf83640 1 --2- 172.21.15.6:0/2028743475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 0x7fb39815a7e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb390009d90 tx=0x7fb39001ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e19302486ead3a54 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb396ffd640 1 -- 172.21.15.6:0/2028743475 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3900a7990 con 0x7fb3980cbf40 2023-11-28T21:08:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb396ffd640 1 -- 172.21.15.6:0/2028743475 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3900a7af0 con 0x7fb3980cbf40 2023-11-28T21:08:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb396ffd640 1 -- 172.21.15.6:0/2028743475 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3900a7e80 con 0x7fb3980cbf40 2023-11-28T21:08:55.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2028743475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 msgr2=0x7fb39815a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 --2- 172.21.15.6:0/2028743475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 0x7fb39815a7e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb390009d90 tx=0x7fb39001ead0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2028743475 shutdown_connections 2023-11-28T21:08:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 --2- 172.21.15.6:0/2028743475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 0x7fb39815a7e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 --2- 172.21.15.6:0/2028743475 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e370 0x7fb3980ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2028743475 >> 172.21.15.6:0/2028743475 conn(0x7fb39806a980 msgr2=0x7fb39806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2028743475 shutdown_connections 2023-11-28T21:08:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2028743475 wait complete. 2023-11-28T21:08:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 Processor -- start 2023-11-28T21:08:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.891+0000 7fb39e9e6640 1 -- start start 2023-11-28T21:08:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39e9e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 0x7fb39813ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39e9e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39815e370 0x7fb3980b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39e9e6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e750 0x7fb3981354d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39e9e6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3981404b0 con 0x7fb39815e370 2023-11-28T21:08:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39e9e6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39813f540 con 0x7fb3980cbf40 2023-11-28T21:08:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39e9e6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb398137d90 con 0x7fb39815e750 2023-11-28T21:08:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb3977fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39815e370 0x7fb3980b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb3977fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39815e370 0x7fb3980b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44268/0 (socket says 172.21.15.6:44268) 2023-11-28T21:08:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb3977fe640 1 -- 172.21.15.6:0/2696331406 learned_addr learned my addr 172.21.15.6:0/2696331406 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb397fff640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 0x7fb39813ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39cf83640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e750 0x7fb3981354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb3977fe640 1 -- 172.21.15.6:0/2696331406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e750 msgr2=0x7fb3981354d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb3977fe640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e750 0x7fb3981354d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb3977fe640 1 -- 172.21.15.6:0/2696331406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 msgr2=0x7fb39813ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb3977fe640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 0x7fb39813ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb3977fe640 1 -- 172.21.15.6:0/2696331406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388009420 con 0x7fb39815e370 2023-11-28T21:08:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb397fff640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 0x7fb39813ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb3977fe640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39815e370 0x7fb3980b13b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00c450 tx=0x7fb38c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb394ff9640 1 -- 172.21.15.6:0/2696331406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c005cf0 con 0x7fb39815e370 2023-11-28T21:08:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb394ff9640 1 -- 172.21.15.6:0/2696331406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c005e50 con 0x7fb39815e370 2023-11-28T21:08:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb390009a70 con 0x7fb39815e370 2023-11-28T21:08:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb394ff9640 1 -- 172.21.15.6:0/2696331406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c007270 con 0x7fb39815e370 2023-11-28T21:08:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39813f770 con 0x7fb39815e370 2023-11-28T21:08:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb398072b90 con 0x7fb39815e370 2023-11-28T21:08:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.895+0000 7fb394ff9640 1 -- 172.21.15.6:0/2696331406 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb38c0073d0 con 0x7fb39815e370 2023-11-28T21:08:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.899+0000 7fb394ff9640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb384066470 0x7fb384068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.899+0000 7fb394ff9640 1 -- 172.21.15.6:0/2696331406 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb38c083400 con 0x7fb39815e370 2023-11-28T21:08:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.899+0000 7fb397fff640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb384066470 0x7fb384068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:55.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.899+0000 7fb397fff640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb384066470 0x7fb384068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb388009d40 tx=0x7fb388008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:55.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:55.903+0000 7fb394ff9640 1 -- 172.21.15.6:0/2696331406 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb38c050780 con 0x7fb39815e370 2023-11-28T21:08:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.059+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb39804e930 con 0x7fb39815e370 2023-11-28T21:08:56.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.059+0000 7fb394ff9640 1 -- 172.21.15.6:0/2696331406 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb38c017020 con 0x7fb39815e370 2023-11-28T21:08:56.065 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb384066470 msgr2=0x7fb384068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb384066470 0x7fb384068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb388009d40 tx=0x7fb388008040 comp rx=0 tx=0).stop 2023-11-28T21:08:56.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39815e370 msgr2=0x7fb3980b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39815e370 0x7fb3980b13b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb38c00c450 tx=0x7fb38c00c910 comp rx=0 tx=0).stop 2023-11-28T21:08:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 shutdown_connections 2023-11-28T21:08:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb384066470 0x7fb384068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb39815e750 0x7fb3981354d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb39815e370 0x7fb3980b13b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 --2- 172.21.15.6:0/2696331406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb3980cbf40 0x7fb39813ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 >> 172.21.15.6:0/2696331406 conn(0x7fb39806a980 msgr2=0x7fb3980b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 shutdown_connections 2023-11-28T21:08:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.063+0000 7fb39e9e6640 1 -- 172.21.15.6:0/2696331406 wait complete. 2023-11-28T21:08:56.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:56.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f849853e640 1 Processor -- start 2023-11-28T21:08:56.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f849853e640 1 -- start start 2023-11-28T21:08:56.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f849853e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f849015e370 0x7f84900ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f849853e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84900cbf40 0x7f849015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f849853e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849015b510 con 0x7f849015e750 2023-11-28T21:08:56.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f849853e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900cd730 con 0x7f84900cbf40 2023-11-28T21:08:56.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f849853e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849013d450 con 0x7f849015e370 2023-11-28T21:08:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f8496adb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84900cbf40 0x7f849015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f8496adb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84900cbf40 0x7f849015a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44274/0 (socket says 172.21.15.6:44274) 2023-11-28T21:08:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f8496adb640 1 -- 172.21.15.6:0/1368571444 learned_addr learned my addr 172.21.15.6:0/1368571444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f84962da640 1 --2- 172.21.15.6:0/1368571444 >> v2:172.21.15.31:3300/0 conn(0x7f849015e370 0x7f84900ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f8496adb640 1 -- 172.21.15.6:0/1368571444 >> v2:172.21.15.31:3300/0 conn(0x7f849015e370 msgr2=0x7f84900ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f8496adb640 1 --2- 172.21.15.6:0/1368571444 >> v2:172.21.15.31:3300/0 conn(0x7f849015e370 0x7f84900ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f8496adb640 1 -- 172.21.15.6:0/1368571444 >> v1:172.21.15.31:6789/0 conn(0x7f849015e750 legacy=0x7f84900cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.227+0000 7f8496adb640 1 -- 172.21.15.6:0/1368571444 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900cd940 con 0x7f84900cbf40 2023-11-28T21:08:56.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f8496adb640 1 --2- 172.21.15.6:0/1368571444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84900cbf40 0x7f849015a7e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f849006c9d0 tx=0x7f848801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e452a2aa4949f52 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:56.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f84952d8640 1 -- 172.21.15.6:0/1368571444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880a5780 con 0x7f84900cbf40 2023-11-28T21:08:56.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f84952d8640 1 -- 172.21.15.6:0/1368571444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84880a58e0 con 0x7f84900cbf40 2023-11-28T21:08:56.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f84952d8640 1 -- 172.21.15.6:0/1368571444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880a5c70 con 0x7f84900cbf40 2023-11-28T21:08:56.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f849853e640 1 -- 172.21.15.6:0/1368571444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84900cbf40 msgr2=0x7f849015a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f849853e640 1 --2- 172.21.15.6:0/1368571444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84900cbf40 0x7f849015a7e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f849006c9d0 tx=0x7f848801c9d0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f849853e640 1 -- 172.21.15.6:0/1368571444 shutdown_connections 2023-11-28T21:08:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f849853e640 1 --2- 172.21.15.6:0/1368571444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84900cbf40 0x7f849015a7e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f849853e640 1 --2- 172.21.15.6:0/1368571444 >> v2:172.21.15.31:3300/0 conn(0x7f849015e370 0x7f84900ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f849853e640 1 -- 172.21.15.6:0/1368571444 >> 172.21.15.6:0/1368571444 conn(0x7f849006a980 msgr2=0x7f849006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f849853e640 1 -- 172.21.15.6:0/1368571444 shutdown_connections 2023-11-28T21:08:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.231+0000 7f849853e640 1 -- 172.21.15.6:0/1368571444 wait complete. 2023-11-28T21:08:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 Processor -- start 2023-11-28T21:08:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 -- start start 2023-11-28T21:08:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84900cbf40 0x7f8490147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849015e370 0x7f849013bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849015e750 0x7f849013bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849013c670 con 0x7f849015e370 2023-11-28T21:08:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849013c950 con 0x7f84900cbf40 2023-11-28T21:08:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849013cc30 con 0x7f849015e750 2023-11-28T21:08:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8495ad9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849015e370 0x7f849013bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8495ad9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849015e370 0x7f849013bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44286/0 (socket says 172.21.15.6:44286) 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8495ad9640 1 -- 172.21.15.6:0/766458266 learned_addr learned my addr 172.21.15.6:0/766458266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f84962da640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84900cbf40 0x7f8490147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8496adb640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849015e750 0x7f849013bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8495ad9640 1 -- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849015e750 msgr2=0x7f849013bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8495ad9640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849015e750 0x7f849013bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8495ad9640 1 -- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84900cbf40 msgr2=0x7f8490147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8495ad9640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84900cbf40 0x7f8490147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8495ad9640 1 -- 172.21.15.6:0/766458266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488009b30 con 0x7f849015e370 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f84962da640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84900cbf40 0x7f8490147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8496adb640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849015e750 0x7f849013bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8495ad9640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849015e370 0x7f849013bab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f848000c3c0 tx=0x7f848000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8486ffd640 1 -- 172.21.15.6:0/766458266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84800052d0 con 0x7f849015e370 2023-11-28T21:08:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8486ffd640 1 -- 172.21.15.6:0/766458266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8480005430 con 0x7f849015e370 2023-11-28T21:08:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f8486ffd640 1 -- 172.21.15.6:0/766458266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480003840 con 0x7f849015e370 2023-11-28T21:08:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8490133180 con 0x7f849015e370 2023-11-28T21:08:56.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.235+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849014f1d0 con 0x7f849015e370 2023-11-28T21:08:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.239+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849006d160 con 0x7f849015e370 2023-11-28T21:08:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.239+0000 7f8486ffd640 1 -- 172.21.15.6:0/766458266 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f84800039a0 con 0x7f849015e370 2023-11-28T21:08:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.239+0000 7f8486ffd640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8474066470 0x7f8474068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.239+0000 7f8486ffd640 1 -- 172.21.15.6:0/766458266 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8480083440 con 0x7f849015e370 2023-11-28T21:08:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.239+0000 7f84962da640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8474066470 0x7f8474068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.239+0000 7f84962da640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8474066470 0x7f8474068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f848c009ae0 tx=0x7f848c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.243+0000 7f8486ffd640 1 -- 172.21.15.6:0/766458266 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8480050830 con 0x7f849015e370 2023-11-28T21:08:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.399+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8490072b90 con 0x7f849015e370 2023-11-28T21:08:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.399+0000 7f8486ffd640 1 -- 172.21.15.6:0/766458266 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8480053e50 con 0x7f849015e370 2023-11-28T21:08:56.406 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8474066470 msgr2=0x7f8474068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8474066470 0x7f8474068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f848c009ae0 tx=0x7f848c008040 comp rx=0 tx=0).stop 2023-11-28T21:08:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849015e370 msgr2=0x7f849013bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849015e370 0x7f849013bab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f848000c3c0 tx=0x7f848000c880 comp rx=0 tx=0).stop 2023-11-28T21:08:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 shutdown_connections 2023-11-28T21:08:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f8474066470 0x7f8474068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f849015e750 0x7f849013bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f849015e370 0x7f849013bab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 --2- 172.21.15.6:0/766458266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84900cbf40 0x7f8490147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 >> 172.21.15.6:0/766458266 conn(0x7f849006a980 msgr2=0x7f849006ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 shutdown_connections 2023-11-28T21:08:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.403+0000 7f849853e640 1 -- 172.21.15.6:0/766458266 wait complete. 2023-11-28T21:08:56.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T21:08:56.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a8b66b640 1 Processor -- start 2023-11-28T21:08:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a8b66b640 1 -- start start 2023-11-28T21:08:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a8b66b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a840cc3f0 0x7f3a8415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a8b66b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a8415c270 0x7f3a8415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a8b66b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a840cc8a0 con 0x7f3a8406ca00 2023-11-28T21:08:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a8b66b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a840cd400 con 0x7f3a8415c270 2023-11-28T21:08:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a8b66b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8415c700 con 0x7f3a840cc3f0 2023-11-28T21:08:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a89407640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3a8406ca00 0x7f3a8406cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34758/0 (socket says 172.21.15.6:34758) 2023-11-28T21:08:56.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a89407640 1 -- 172.21.15.6:0/2833797280 learned_addr learned my addr 172.21.15.6:0/2833797280 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:56.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a89c08640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a8415c270 0x7f3a8415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a7bfff640 1 -- 172.21.15.6:0/2833797280 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102169006 0 0) 0x7f3a840cc8a0 con 0x7f3a8406ca00 2023-11-28T21:08:56.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a88c06640 1 --2- 172.21.15.6:0/2833797280 >> v2:172.21.15.31:3300/0 conn(0x7f3a840cc3f0 0x7f3a8415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a7bfff640 1 -- 172.21.15.6:0/2833797280 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a70003530 con 0x7f3a8406ca00 2023-11-28T21:08:56.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a89c08640 1 -- 172.21.15.6:0/2833797280 >> v2:172.21.15.31:3300/0 conn(0x7f3a840cc3f0 msgr2=0x7f3a8415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:56.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a89c08640 1 --2- 172.21.15.6:0/2833797280 >> v2:172.21.15.31:3300/0 conn(0x7f3a840cc3f0 0x7f3a8415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a89c08640 1 -- 172.21.15.6:0/2833797280 >> v1:172.21.15.6:6789/0 conn(0x7f3a8406ca00 legacy=0x7f3a8406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a89c08640 1 -- 172.21.15.6:0/2833797280 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840ccb60 con 0x7f3a8415c270 2023-11-28T21:08:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.567+0000 7f3a88c06640 1 --2- 172.21.15.6:0/2833797280 >> v2:172.21.15.31:3300/0 conn(0x7f3a840cc3f0 0x7f3a8415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a89c08640 1 --2- 172.21.15.6:0/2833797280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a8415c270 0x7f3a8415ce40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009dc0 tx=0x7f3a7c01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee00b1c6a72fbd25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a7bfff640 1 -- 172.21.15.6:0/2833797280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0a58f0 con 0x7f3a8415c270 2023-11-28T21:08:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a7bfff640 1 -- 172.21.15.6:0/2833797280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c0a5a50 con 0x7f3a8415c270 2023-11-28T21:08:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a7bfff640 1 -- 172.21.15.6:0/2833797280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0a5dc0 con 0x7f3a8415c270 2023-11-28T21:08:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2833797280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a8415c270 msgr2=0x7f3a8415ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a8b66b640 1 --2- 172.21.15.6:0/2833797280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a8415c270 0x7f3a8415ce40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009dc0 tx=0x7f3a7c01c830 comp rx=0 tx=0).stop 2023-11-28T21:08:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2833797280 shutdown_connections 2023-11-28T21:08:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a8b66b640 1 --2- 172.21.15.6:0/2833797280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a8415c270 0x7f3a8415ce40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a8b66b640 1 --2- 172.21.15.6:0/2833797280 >> v2:172.21.15.31:3300/0 conn(0x7f3a840cc3f0 0x7f3a8415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2833797280 >> 172.21.15.6:0/2833797280 conn(0x7f3a8406a980 msgr2=0x7f3a8406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:56.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2833797280 shutdown_connections 2023-11-28T21:08:56.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.571+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2833797280 wait complete. 2023-11-28T21:08:56.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a8b66b640 1 Processor -- start 2023-11-28T21:08:56.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a8b66b640 1 -- start start 2023-11-28T21:08:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a8b66b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406ca00 0x7f3a8414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a8b66b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a840cc3f0 0x7f3a8414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a8b66b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415c270 0x7f3a841538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a8b66b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84151570 con 0x7f3a840cc3f0 2023-11-28T21:08:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a8b66b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8414e310 con 0x7f3a8415c270 2023-11-28T21:08:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a8b66b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84151290 con 0x7f3a8406ca00 2023-11-28T21:08:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a88c06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a840cc3f0 0x7f3a8414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a88c06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a840cc3f0 0x7f3a8414b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44310/0 (socket says 172.21.15.6:44310) 2023-11-28T21:08:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a88c06640 1 -- 172.21.15.6:0/2601320564 learned_addr learned my addr 172.21.15.6:0/2601320564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a89407640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406ca00 0x7f3a8414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a89c08640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415c270 0x7f3a841538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a88c06640 1 -- 172.21.15.6:0/2601320564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406ca00 msgr2=0x7f3a8414d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a88c06640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406ca00 0x7f3a8414d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a88c06640 1 -- 172.21.15.6:0/2601320564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415c270 msgr2=0x7f3a841538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a88c06640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415c270 0x7f3a841538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a88c06640 1 -- 172.21.15.6:0/2601320564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c009a70 con 0x7f3a840cc3f0 2023-11-28T21:08:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a88c06640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a840cc3f0 0x7f3a8414b8d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400c7c0 tx=0x7f3a7400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a79ffb640 1 -- 172.21.15.6:0/2601320564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a74007a30 con 0x7f3a840cc3f0 2023-11-28T21:08:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a79ffb640 1 -- 172.21.15.6:0/2601320564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a74007b90 con 0x7f3a840cc3f0 2023-11-28T21:08:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a79ffb640 1 -- 172.21.15.6:0/2601320564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400ce70 con 0x7f3a840cc3f0 2023-11-28T21:08:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.575+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8414ea90 con 0x7f3a840cc3f0 2023-11-28T21:08:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.579+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8414e5b0 con 0x7f3a840cc3f0 2023-11-28T21:08:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.579+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8414ecd0 con 0x7f3a840cc3f0 2023-11-28T21:08:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.579+0000 7f3a79ffb640 1 -- 172.21.15.6:0/2601320564 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a740113f0 con 0x7f3a840cc3f0 2023-11-28T21:08:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.579+0000 7f3a79ffb640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3a68066470 0x7f3a68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.579+0000 7f3a79ffb640 1 -- 172.21.15.6:0/2601320564 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3a740842e0 con 0x7f3a840cc3f0 2023-11-28T21:08:56.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.579+0000 7f3a89407640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3a68066470 0x7f3a68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.579+0000 7f3a89407640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3a68066470 0x7f3a68068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3a80007fd0 tx=0x7f3a80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:56.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.583+0000 7f3a79ffb640 1 -- 172.21.15.6:0/2601320564 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a8414ecd0 con 0x7f3a840cc3f0 2023-11-28T21:08:56.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.755+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3a8414ecd0 con 0x7f3a840cc3f0 2023-11-28T21:08:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.755+0000 7f3a79ffb640 1 -- 172.21.15.6:0/2601320564 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3a8414ecd0 con 0x7f3a840cc3f0 2023-11-28T21:08:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-11-28T21:08:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3a68066470 msgr2=0x7f3a68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3a68066470 0x7f3a68068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3a80007fd0 tx=0x7f3a80009040 comp rx=0 tx=0).stop 2023-11-28T21:08:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a840cc3f0 msgr2=0x7f3a8414b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a840cc3f0 0x7f3a8414b8d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400c7c0 tx=0x7f3a7400cc80 comp rx=0 tx=0).stop 2023-11-28T21:08:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 shutdown_connections 2023-11-28T21:08:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3a68066470 0x7f3a68068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a8415c270 0x7f3a841538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a840cc3f0 0x7f3a8414b8d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 --2- 172.21.15.6:0/2601320564 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a8406ca00 0x7f3a8414d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 >> 172.21.15.6:0/2601320564 conn(0x7f3a8406a980 msgr2=0x7f3a840aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 shutdown_connections 2023-11-28T21:08:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.759+0000 7f3a8b66b640 1 -- 172.21.15.6:0/2601320564 wait complete. 2023-11-28T21:08:56.782 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-28T21:08:56.783 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T21:08:56.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f227c9f8640 1 Processor -- start 2023-11-28T21:08:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f227c9f8640 1 -- start start 2023-11-28T21:08:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f227c9f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22780b2000 0x7f22780b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f227c9f8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22780afa60 con 0x7f227815d400 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f227c9f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22780b0930 con 0x7f22780abfe0 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f227c9f8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22780b29d0 con 0x7f22780b2000 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f227659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f227815d400 0x7f22780af350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34770/0 (socket says 172.21.15.6:34770) 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f227659c640 1 -- 172.21.15.6:0/2456068361 learned_addr learned my addr 172.21.15.6:0/2456068361 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f226ffff640 1 --2- 172.21.15.6:0/2456068361 >> v2:172.21.15.31:3300/0 conn(0x7f22780b2000 0x7f22780b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f2275d9b640 1 -- 172.21.15.6:0/2456068361 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606430571 0 0) 0x7f22780afa60 con 0x7f227815d400 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.931+0000 7f2275d9b640 1 -- 172.21.15.6:0/2456068361 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2264003530 con 0x7f227815d400 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f2275d9b640 1 -- 172.21.15.6:0/2456068361 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018614884 0 0) 0x7f22780b0930 con 0x7f22780abfe0 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f2275d9b640 1 -- 172.21.15.6:0/2456068361 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22780afa60 con 0x7f22780abfe0 2023-11-28T21:08:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f226ffff640 1 -- 172.21.15.6:0/2456068361 >> v1:172.21.15.31:6789/0 conn(0x7f22780abfe0 legacy=0x7f22780ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f226ffff640 1 -- 172.21.15.6:0/2456068361 >> v1:172.21.15.6:6789/0 conn(0x7f227815d400 legacy=0x7f22780af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f2275d9b640 1 -- 172.21.15.6:0/2456068361 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 995586135 0 0) 0x7f2264003530 con 0x7f227815d400 2023-11-28T21:08:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f226ffff640 1 -- 172.21.15.6:0/2456068361 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780b0c10 con 0x7f22780b2000 2023-11-28T21:08:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f226ffff640 1 --2- 172.21.15.6:0/2456068361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22780b2000 0x7f22780b2490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f22600097c0 tx=0x7f226001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=341fb542caec6722 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f2275d9b640 1 -- 172.21.15.6:0/2456068361 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600a4ea0 con 0x7f22780b2000 2023-11-28T21:08:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f2275d9b640 1 -- 172.21.15.6:0/2456068361 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600a7050 con 0x7f22780b2000 2023-11-28T21:08:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f2275d9b640 1 -- 172.21.15.6:0/2456068361 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268001680 con 0x7f22780b2000 2023-11-28T21:08:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f227c9f8640 1 -- 172.21.15.6:0/2456068361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22780b2000 msgr2=0x7f22780b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.935+0000 7f227c9f8640 1 --2- 172.21.15.6:0/2456068361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22780b2000 0x7f22780b2490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f22600097c0 tx=0x7f226001c3a0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 -- 172.21.15.6:0/2456068361 shutdown_connections 2023-11-28T21:08:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 --2- 172.21.15.6:0/2456068361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22780b2000 0x7f22780b2490 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 -- 172.21.15.6:0/2456068361 >> 172.21.15.6:0/2456068361 conn(0x7f22780b4520 msgr2=0x7f22780b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 -- 172.21.15.6:0/2456068361 shutdown_connections 2023-11-28T21:08:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 -- 172.21.15.6:0/2456068361 wait complete. 2023-11-28T21:08:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 Processor -- start 2023-11-28T21:08:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 -- start start 2023-11-28T21:08:56.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22780abfe0 0x7f22780cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22780b2000 0x7f227814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f227814b960 0x7f2278156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780c89d0 con 0x7f22780b2000 2023-11-28T21:08:56.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780ce630 con 0x7f22780abfe0 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227c9f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780ce910 con 0x7f227814b960 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f226ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22780b2000 0x7f227814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f226ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22780b2000 0x7f227814abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44322/0 (socket says 172.21.15.6:44322) 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f226ffff640 1 -- 172.21.15.6:0/2103709807 learned_addr learned my addr 172.21.15.6:0/2103709807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f227659c640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22780abfe0 0x7f22780cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f2276d9d640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f227814b960 0x7f2278156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f226ffff640 1 -- 172.21.15.6:0/2103709807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f227814b960 msgr2=0x7f2278156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f226ffff640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f227814b960 0x7f2278156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f226ffff640 1 -- 172.21.15.6:0/2103709807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22780abfe0 msgr2=0x7f22780cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f226ffff640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22780abfe0 0x7f22780cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:56.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f226ffff640 1 -- 172.21.15.6:0/2103709807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2260009420 con 0x7f22780b2000 2023-11-28T21:08:56.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f2276d9d640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f227814b960 0x7f2278156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:08:56.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.939+0000 7f226ffff640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22780b2000 0x7f227814abe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f22600097c0 tx=0x7f2260019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:56.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f226effd640 1 -- 172.21.15.6:0/2103709807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260006e20 con 0x7f22780b2000 2023-11-28T21:08:56.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f226effd640 1 -- 172.21.15.6:0/2103709807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2260004020 con 0x7f22780b2000 2023-11-28T21:08:56.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22780c8380 con 0x7f22780b2000 2023-11-28T21:08:56.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f226effd640 1 -- 172.21.15.6:0/2103709807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600043d0 con 0x7f22780b2000 2023-11-28T21:08:56.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227815d860 con 0x7f22780b2000 2023-11-28T21:08:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22780c8b40 con 0x7f22780b2000 2023-11-28T21:08:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f226effd640 1 -- 172.21.15.6:0/2103709807 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22600b2040 con 0x7f22780b2000 2023-11-28T21:08:56.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f226effd640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2258066470 0x7f2258068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f226effd640 1 -- 172.21.15.6:0/2103709807 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f226011ce70 con 0x7f22780b2000 2023-11-28T21:08:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f227659c640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2258066470 0x7f2258068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:56.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.943+0000 7f227659c640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2258066470 0x7f2258068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f22680011f0 tx=0x7f2268009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:56.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:56.947+0000 7f226effd640 1 -- 172.21.15.6:0/2103709807 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22600ea1d0 con 0x7f22780b2000 2023-11-28T21:08:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.103+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22780674d0 con 0x7f22780b2000 2023-11-28T21:08:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f226effd640 1 -- 172.21.15.6:0/2103709807 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16590 (secure 0 0 0) 0x7f22600ed7f0 con 0x7f22780b2000 2023-11-28T21:08:57.112 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:57.112 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:52.362503+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:57.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2258066470 msgr2=0x7f2258068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2258066470 0x7f2258068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f22680011f0 tx=0x7f2268009040 comp rx=0 tx=0).stop 2023-11-28T21:08:57.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22780b2000 msgr2=0x7f227814abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22780b2000 0x7f227814abe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f22600097c0 tx=0x7f2260019140 comp rx=0 tx=0).stop 2023-11-28T21:08:57.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 shutdown_connections 2023-11-28T21:08:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2258066470 0x7f2258068930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f227814b960 0x7f2278156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22780b2000 0x7f227814abe0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 --2- 172.21.15.6:0/2103709807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22780abfe0 0x7f22780cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 >> 172.21.15.6:0/2103709807 conn(0x7f22780b4520 msgr2=0x7f22781556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 shutdown_connections 2023-11-28T21:08:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.107+0000 7f227c9f8640 1 -- 172.21.15.6:0/2103709807 wait complete. 2023-11-28T21:08:57.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:57.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.275+0000 7f34230c8640 1 Processor -- start 2023-11-28T21:08:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.275+0000 7f34230c8640 1 -- start start 2023-11-28T21:08:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34230c8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f341c0caf50 0x7f341c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34230c8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c15ad40 0x7f341c0ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34230c8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341c0cf690 con 0x7f341c0cf240 2023-11-28T21:08:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34230c8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c0715d0 con 0x7f341c0caf50 2023-11-28T21:08:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34230c8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0718b0 con 0x7f341c15ad40 2023-11-28T21:08:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34220c6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f341c0caf50 0x7f341c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34228c7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f341c0cf240 0x7f341c15d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34782/0 (socket says 172.21.15.6:34782) 2023-11-28T21:08:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34228c7640 1 -- 172.21.15.6:0/657202161 learned_addr learned my addr 172.21.15.6:0/657202161 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34218c5640 1 --2- 172.21.15.6:0/657202161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c15ad40 0x7f341c0ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34220c6640 1 -- 172.21.15.6:0/657202161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c15ad40 msgr2=0x7f341c0ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34220c6640 1 --2- 172.21.15.6:0/657202161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c15ad40 0x7f341c0ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34220c6640 1 -- 172.21.15.6:0/657202161 >> v1:172.21.15.6:6789/0 conn(0x7f341c0cf240 legacy=0x7f341c15d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34220c6640 1 -- 172.21.15.6:0/657202161 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0b1a60 con 0x7f341c0caf50 2023-11-28T21:08:57.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.279+0000 7f34210c4640 1 -- 172.21.15.6:0/657202161 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071358216 0 0) 0x7f34140014a0 con 0x7f341c0cf240 2023-11-28T21:08:57.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34220c6640 1 --2- 172.21.15.6:0/657202161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c0caf50 0x7f341c070f80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f34180097c0 tx=0x7f341801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb126c3020b336aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:57.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34210c4640 1 -- 172.21.15.6:0/657202161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34180ab670 con 0x7f341c0caf50 2023-11-28T21:08:57.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34210c4640 1 -- 172.21.15.6:0/657202161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34180ab7d0 con 0x7f341c0caf50 2023-11-28T21:08:57.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34210c4640 1 -- 172.21.15.6:0/657202161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34180abb60 con 0x7f341c0caf50 2023-11-28T21:08:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 -- 172.21.15.6:0/657202161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c0caf50 msgr2=0x7f341c070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 --2- 172.21.15.6:0/657202161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c0caf50 0x7f341c070f80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f34180097c0 tx=0x7f341801c450 comp rx=0 tx=0).stop 2023-11-28T21:08:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 -- 172.21.15.6:0/657202161 shutdown_connections 2023-11-28T21:08:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 --2- 172.21.15.6:0/657202161 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c15ad40 0x7f341c0ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 --2- 172.21.15.6:0/657202161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c0caf50 0x7f341c070f80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 -- 172.21.15.6:0/657202161 >> 172.21.15.6:0/657202161 conn(0x7f341c06a750 msgr2=0x7f341c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:57.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 -- 172.21.15.6:0/657202161 shutdown_connections 2023-11-28T21:08:57.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 -- 172.21.15.6:0/657202161 wait complete. 2023-11-28T21:08:57.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 Processor -- start 2023-11-28T21:08:57.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 -- start start 2023-11-28T21:08:57.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c0caf50 0x7f341c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f341c0cf240 0x7f341c150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c15ad40 0x7f341c0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0aef80 con 0x7f341c15ad40 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0af260 con 0x7f341c0cf240 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.283+0000 7f34230c8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0af540 con 0x7f341c0caf50 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34228c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c15ad40 0x7f341c0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34228c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c15ad40 0x7f341c0ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44332/0 (socket says 172.21.15.6:44332) 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34228c7640 1 -- 172.21.15.6:0/67007064 learned_addr learned my addr 172.21.15.6:0/67007064 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34220c6640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c0caf50 0x7f341c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34218c5640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f341c0cf240 0x7f341c150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34228c7640 1 -- 172.21.15.6:0/67007064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c0caf50 msgr2=0x7f341c0b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34228c7640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c0caf50 0x7f341c0b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34228c7640 1 -- 172.21.15.6:0/67007064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f341c0cf240 msgr2=0x7f341c150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34228c7640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f341c0cf240 0x7f341c150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34228c7640 1 -- 172.21.15.6:0/67007064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3418009420 con 0x7f341c15ad40 2023-11-28T21:08:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34228c7640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c15ad40 0x7f341c0ae530 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f341400c7a0 tx=0x7f341400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f3412ffd640 1 -- 172.21.15.6:0/67007064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400a640 con 0x7f341c15ad40 2023-11-28T21:08:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f3412ffd640 1 -- 172.21.15.6:0/67007064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400a7a0 con 0x7f341c15ad40 2023-11-28T21:08:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f3412ffd640 1 -- 172.21.15.6:0/67007064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400ab50 con 0x7f341c15ad40 2023-11-28T21:08:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c0af820 con 0x7f341c15ad40 2023-11-28T21:08:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c1515a0 con 0x7f341c15ad40 2023-11-28T21:08:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341c070df0 con 0x7f341c15ad40 2023-11-28T21:08:57.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.287+0000 7f3412ffd640 1 -- 172.21.15.6:0/67007064 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f341400acb0 con 0x7f341c15ad40 2023-11-28T21:08:57.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.291+0000 7f3412ffd640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3400066470 0x7f3400068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.291+0000 7f3412ffd640 1 -- 172.21.15.6:0/67007064 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3414083260 con 0x7f341c15ad40 2023-11-28T21:08:57.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.291+0000 7f34220c6640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3400066470 0x7f3400068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.291+0000 7f34220c6640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3400066470 0x7f3400068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f34180af000 tx=0x7f34180a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:57.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.295+0000 7f3412ffd640 1 -- 172.21.15.6:0/67007064 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3414050710 con 0x7f341c15ad40 2023-11-28T21:08:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.455+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f341c0cf690 con 0x7f341c15ad40 2023-11-28T21:08:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.455+0000 7f3412ffd640 1 -- 172.21.15.6:0/67007064 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f341c0cf690 con 0x7f341c15ad40 2023-11-28T21:08:57.462 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3400066470 msgr2=0x7f3400068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3400066470 0x7f3400068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f34180af000 tx=0x7f34180a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c15ad40 msgr2=0x7f341c0ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c15ad40 0x7f341c0ae530 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f341400c7a0 tx=0x7f341400cc60 comp rx=0 tx=0).stop 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 shutdown_connections 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3400066470 0x7f3400068930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f341c15ad40 0x7f341c0ae530 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f341c0cf240 0x7f341c150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 --2- 172.21.15.6:0/67007064 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f341c0caf50 0x7f341c0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 >> 172.21.15.6:0/67007064 conn(0x7f341c06a750 msgr2=0x7f341c1597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 shutdown_connections 2023-11-28T21:08:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.459+0000 7f34230c8640 1 -- 172.21.15.6:0/67007064 wait complete. 2023-11-28T21:08:57.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fd52d6640 1 Processor -- start 2023-11-28T21:08:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fd52d6640 1 -- start start 2023-11-28T21:08:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fd52d6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5fd015fcf0 0x7f5fd00d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fd52d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b31c0 0x7f5fd01600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fd52d6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd00cea30 con 0x7f5fd00ceec0 2023-11-28T21:08:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fd52d6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd00d3ef0 con 0x7f5fd015fcf0 2023-11-28T21:08:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fd52d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd00b2430 con 0x7f5fd00b31c0 2023-11-28T21:08:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fc7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5fd00ceec0 0x7f5fd00b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34784/0 (socket says 172.21.15.6:34784) 2023-11-28T21:08:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fc7fff640 1 -- 172.21.15.6:0/916007407 learned_addr learned my addr 172.21.15.6:0/916007407 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fceffd640 1 --2- 172.21.15.6:0/916007407 >> v2:172.21.15.31:3300/0 conn(0x7f5fd015fcf0 0x7f5fd00d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fcf7fe640 1 --2- 172.21.15.6:0/916007407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b31c0 0x7f5fd01600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fce7fc640 1 -- 172.21.15.6:0/916007407 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705068342 0 0) 0x7f5fd00cea30 con 0x7f5fd00ceec0 2023-11-28T21:08:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fce7fc640 1 -- 172.21.15.6:0/916007407 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fbc003530 con 0x7f5fd00ceec0 2023-11-28T21:08:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fcf7fe640 1 -- 172.21.15.6:0/916007407 >> v2:172.21.15.31:3300/0 conn(0x7f5fd015fcf0 msgr2=0x7f5fd00d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:57.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fcf7fe640 1 --2- 172.21.15.6:0/916007407 >> v2:172.21.15.31:3300/0 conn(0x7f5fd015fcf0 0x7f5fd00d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fcf7fe640 1 -- 172.21.15.6:0/916007407 >> v1:172.21.15.6:6789/0 conn(0x7f5fd00ceec0 legacy=0x7f5fd00b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.623+0000 7f5fcf7fe640 1 -- 172.21.15.6:0/916007407 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00d1c00 con 0x7f5fd00b31c0 2023-11-28T21:08:57.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fcf7fe640 1 --2- 172.21.15.6:0/916007407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b31c0 0x7f5fd01600d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009d90 tx=0x7f5fc801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59cf2854f7868a4a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fce7fc640 1 -- 172.21.15.6:0/916007407 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80a5930 con 0x7f5fd00b31c0 2023-11-28T21:08:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fce7fc640 1 -- 172.21.15.6:0/916007407 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc80a5a90 con 0x7f5fd00b31c0 2023-11-28T21:08:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fce7fc640 1 -- 172.21.15.6:0/916007407 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80a5e00 con 0x7f5fd00b31c0 2023-11-28T21:08:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fd52d6640 1 -- 172.21.15.6:0/916007407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b31c0 msgr2=0x7f5fd01600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fd52d6640 1 --2- 172.21.15.6:0/916007407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b31c0 0x7f5fd01600d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009d90 tx=0x7f5fc801c890 comp rx=0 tx=0).stop 2023-11-28T21:08:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fd52d6640 1 -- 172.21.15.6:0/916007407 shutdown_connections 2023-11-28T21:08:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fd52d6640 1 --2- 172.21.15.6:0/916007407 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00b31c0 0x7f5fd01600d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fd52d6640 1 --2- 172.21.15.6:0/916007407 >> v2:172.21.15.31:3300/0 conn(0x7f5fd015fcf0 0x7f5fd00d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fd52d6640 1 -- 172.21.15.6:0/916007407 >> 172.21.15.6:0/916007407 conn(0x7f5fd009c480 msgr2=0x7f5fd00d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.627+0000 7f5fd52d6640 1 -- 172.21.15.6:0/916007407 shutdown_connections 2023-11-28T21:08:57.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 -- 172.21.15.6:0/916007407 wait complete. 2023-11-28T21:08:57.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 Processor -- start 2023-11-28T21:08:57.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 -- start start 2023-11-28T21:08:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd00b31c0 0x7f5fd0157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00ceec0 0x7f5fd0154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd015fcf0 0x7f5fd01539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd00c6d20 con 0x7f5fd00b31c0 2023-11-28T21:08:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd01558a0 con 0x7f5fd015fcf0 2023-11-28T21:08:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0155000 con 0x7f5fd00ceec0 2023-11-28T21:08:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd00b31c0 0x7f5fd0157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd00b31c0 0x7f5fd0157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44338/0 (socket says 172.21.15.6:44338) 2023-11-28T21:08:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fceffd640 1 -- 172.21.15.6:0/737056579 learned_addr learned my addr 172.21.15.6:0/737056579 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fcf7fe640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd015fcf0 0x7f5fd01539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fc7fff640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00ceec0 0x7f5fd0154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fceffd640 1 -- 172.21.15.6:0/737056579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00ceec0 msgr2=0x7f5fd0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fceffd640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00ceec0 0x7f5fd0154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fceffd640 1 -- 172.21.15.6:0/737056579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd015fcf0 msgr2=0x7f5fd01539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fceffd640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd015fcf0 0x7f5fd01539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fceffd640 1 -- 172.21.15.6:0/737056579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8009a70 con 0x7f5fd00b31c0 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fceffd640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd00b31c0 0x7f5fd0157e80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000e870 tx=0x7f5fc000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fc77fe640 1 -- 172.21.15.6:0/737056579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0009510 con 0x7f5fd00b31c0 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fc77fe640 1 -- 172.21.15.6:0/737056579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc000eec0 con 0x7f5fd00b31c0 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fc77fe640 1 -- 172.21.15.6:0/737056579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc000cb40 con 0x7f5fd00b31c0 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.631+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd01552e0 con 0x7f5fd00b31c0 2023-11-28T21:08:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.635+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd0155d00 con 0x7f5fd00b31c0 2023-11-28T21:08:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.635+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd00c6e90 con 0x7f5fd00b31c0 2023-11-28T21:08:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.635+0000 7f5fc77fe640 1 -- 172.21.15.6:0/737056579 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5fc000ccc0 con 0x7f5fd00b31c0 2023-11-28T21:08:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.635+0000 7f5fc77fe640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5fb0066470 0x7f5fb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.635+0000 7f5fc77fe640 1 -- 172.21.15.6:0/737056579 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5fc0084070 con 0x7f5fd00b31c0 2023-11-28T21:08:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.635+0000 7f5fc7fff640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5fb0066470 0x7f5fb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.635+0000 7f5fc7fff640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5fb0066470 0x7f5fb0068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00b8490 tx=0x7f5fb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.639+0000 7f5fc77fe640 1 -- 172.21.15.6:0/737056579 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5fc00b5280 con 0x7f5fd00b31c0 2023-11-28T21:08:57.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fd004e930 con 0x7f5fd00b31c0 2023-11-28T21:08:57.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fc77fe640 1 -- 172.21.15.6:0/737056579 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fd00c6e90 con 0x7f5fd00b31c0 2023-11-28T21:08:57.804 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:57.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5fb0066470 msgr2=0x7f5fb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5fb0066470 0x7f5fb0068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00b8490 tx=0x7f5fb8009040 comp rx=0 tx=0).stop 2023-11-28T21:08:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd00b31c0 msgr2=0x7f5fd0157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd00b31c0 0x7f5fd0157e80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000e870 tx=0x7f5fc000ec70 comp rx=0 tx=0).stop 2023-11-28T21:08:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 shutdown_connections 2023-11-28T21:08:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5fb0066470 0x7f5fb0068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fd015fcf0 0x7f5fd01539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5fd00ceec0 0x7f5fd0154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 --2- 172.21.15.6:0/737056579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd00b31c0 0x7f5fd0157e80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 >> 172.21.15.6:0/737056579 conn(0x7f5fd009c480 msgr2=0x7f5fd00b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 shutdown_connections 2023-11-28T21:08:57.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.799+0000 7f5fd52d6640 1 -- 172.21.15.6:0/737056579 wait complete. 2023-11-28T21:08:57.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:08:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab27f80640 1 Processor -- start 2023-11-28T21:08:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab27f80640 1 -- start start 2023-11-28T21:08:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab27f80640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 0x7fab2015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab27f80640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2015b510 con 0x7fab200cbf40 2023-11-28T21:08:57.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab27f80640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200cd940 con 0x7fab2015e370 2023-11-28T21:08:57.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab27f80640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab200cd730 con 0x7fab2015e750 2023-11-28T21:08:57.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab2551b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fab200cbf40 0x7fab2015a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34792/0 (socket says 172.21.15.6:34792) 2023-11-28T21:08:57.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab2551b640 1 -- 172.21.15.6:0/2549148969 learned_addr learned my addr 172.21.15.6:0/2549148969 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab2651d640 1 --2- 172.21.15.6:0/2549148969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 0x7fab2015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab24d1a640 1 -- 172.21.15.6:0/2549148969 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268976583 0 0) 0x7fab2015b510 con 0x7fab200cbf40 2023-11-28T21:08:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab24d1a640 1 -- 172.21.15.6:0/2549148969 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab0c003530 con 0x7fab200cbf40 2023-11-28T21:08:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab24d1a640 1 -- 172.21.15.6:0/2549148969 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384169766 0 0) 0x7fab200cd940 con 0x7fab2015e370 2023-11-28T21:08:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab2651d640 1 -- 172.21.15.6:0/2549148969 >> v1:172.21.15.31:6789/0 conn(0x7fab2015e370 legacy=0x7fab200cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab2651d640 1 -- 172.21.15.6:0/2549148969 >> v1:172.21.15.6:6789/0 conn(0x7fab200cbf40 legacy=0x7fab2015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.967+0000 7fab2651d640 1 -- 172.21.15.6:0/2549148969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200cdc20 con 0x7fab2015e750 2023-11-28T21:08:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab2651d640 1 --2- 172.21.15.6:0/2549148969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 0x7fab2015aef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fab18009dc0 tx=0x7fab1801c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b72e81c53fdc5cae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab24d1a640 1 -- 172.21.15.6:0/2549148969 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10001680 con 0x7fab2015e750 2023-11-28T21:08:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab24d1a640 1 -- 172.21.15.6:0/2549148969 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180a5520 con 0x7fab2015e750 2023-11-28T21:08:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab24d1a640 1 -- 172.21.15.6:0/2549148969 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5890 con 0x7fab2015e750 2023-11-28T21:08:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab27f80640 1 -- 172.21.15.6:0/2549148969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 msgr2=0x7fab2015aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab27f80640 1 --2- 172.21.15.6:0/2549148969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 0x7fab2015aef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fab18009dc0 tx=0x7fab1801c7b0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab27f80640 1 -- 172.21.15.6:0/2549148969 shutdown_connections 2023-11-28T21:08:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab27f80640 1 --2- 172.21.15.6:0/2549148969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 0x7fab2015aef0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab27f80640 1 -- 172.21.15.6:0/2549148969 >> 172.21.15.6:0/2549148969 conn(0x7fab2006a980 msgr2=0x7fab2006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab27f80640 1 -- 172.21.15.6:0/2549148969 shutdown_connections 2023-11-28T21:08:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.971+0000 7fab27f80640 1 -- 172.21.15.6:0/2549148969 wait complete. 2023-11-28T21:08:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 Processor -- start 2023-11-28T21:08:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 -- start start 2023-11-28T21:08:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab200cbf40 0x7fab2013c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab2015e370 0x7fab200a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 0x7fab200a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20152d90 con 0x7fab2015e370 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20151550 con 0x7fab200cbf40 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab20151830 con 0x7fab2015e750 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2551b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab2015e370 0x7fab200a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2551b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab2015e370 0x7fab200a83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44352/0 (socket says 172.21.15.6:44352) 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2551b640 1 -- 172.21.15.6:0/1793450460 learned_addr learned my addr 172.21.15.6:0/1793450460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab25d1c640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab200cbf40 0x7fab2013c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2651d640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 0x7fab200a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2551b640 1 -- 172.21.15.6:0/1793450460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 msgr2=0x7fab200a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2551b640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 0x7fab200a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2551b640 1 -- 172.21.15.6:0/1793450460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab200cbf40 msgr2=0x7fab2013c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2551b640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab200cbf40 0x7fab2013c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2551b640 1 -- 172.21.15.6:0/1793450460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009a70 con 0x7fab2015e370 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab2551b640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab2015e370 0x7fab200a83e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c700 tx=0x7fab1000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab167fc640 1 -- 172.21.15.6:0/1793450460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100074e0 con 0x7fab2015e370 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab167fc640 1 -- 172.21.15.6:0/1793450460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10007660 con 0x7fab2015e370 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab20151b10 con 0x7fab2015e370 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab167fc640 1 -- 172.21.15.6:0/1793450460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10004a30 con 0x7fab2015e370 2023-11-28T21:08:57.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab201520d0 con 0x7fab2015e370 2023-11-28T21:08:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.975+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab201522f0 con 0x7fab2015e370 2023-11-28T21:08:57.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.979+0000 7fab167fc640 1 -- 172.21.15.6:0/1793450460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab10004c50 con 0x7fab2015e370 2023-11-28T21:08:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.979+0000 7fab167fc640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab04066470 0x7fab04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.979+0000 7fab167fc640 1 -- 172.21.15.6:0/1793450460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fab10083760 con 0x7fab2015e370 2023-11-28T21:08:57.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.979+0000 7fab25d1c640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab04066470 0x7fab04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:57.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.979+0000 7fab25d1c640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab04066470 0x7fab04068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fab1c000f70 tx=0x7fab1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:57.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:57.983+0000 7fab167fc640 1 -- 172.21.15.6:0/1793450460 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab10050b70 con 0x7fab2015e370 2023-11-28T21:08:58.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.139+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab20072b90 con 0x7fab2015e370 2023-11-28T21:08:58.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab167fc640 1 -- 172.21.15.6:0/1793450460 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab10054190 con 0x7fab2015e370 2023-11-28T21:08:58.147 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:08:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab04066470 msgr2=0x7fab04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab04066470 0x7fab04068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fab1c000f70 tx=0x7fab1c009040 comp rx=0 tx=0).stop 2023-11-28T21:08:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab2015e370 msgr2=0x7fab200a83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab2015e370 0x7fab200a83e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c700 tx=0x7fab1000cbc0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 shutdown_connections 2023-11-28T21:08:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab04066470 0x7fab04068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fab2015e750 0x7fab200a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab2015e370 0x7fab200a83e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 --2- 172.21.15.6:0/1793450460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab200cbf40 0x7fab2013c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 >> 172.21.15.6:0/1793450460 conn(0x7fab2006a980 msgr2=0x7fab2014ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 shutdown_connections 2023-11-28T21:08:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.143+0000 7fab27f80640 1 -- 172.21.15.6:0/1793450460 wait complete. 2023-11-28T21:08:58.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T21:08:58.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.307+0000 7fac47dd1640 1 Processor -- start 2023-11-28T21:08:58.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac47dd1640 1 -- start start 2023-11-28T21:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac47dd1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac400cbf40 0x7fac400ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac47dd1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4015b510 con 0x7fac4015e370 2023-11-28T21:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac47dd1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac400cd940 con 0x7fac4015e750 2023-11-28T21:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac47dd1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac400cd730 con 0x7fac400cbf40 2023-11-28T21:08:58.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac45b6d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fac4015e370 0x7fac400cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34794/0 (socket says 172.21.15.6:34794) 2023-11-28T21:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac45b6d640 1 -- 172.21.15.6:0/3144452427 learned_addr learned my addr 172.21.15.6:0/3144452427 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac4536c640 1 --2- 172.21.15.6:0/3144452427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac400cbf40 0x7fac400ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac44b6b640 1 -- 172.21.15.6:0/3144452427 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993338088 0 0) 0x7fac4015b510 con 0x7fac4015e370 2023-11-28T21:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac44b6b640 1 -- 172.21.15.6:0/3144452427 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2c003530 con 0x7fac4015e370 2023-11-28T21:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac44b6b640 1 -- 172.21.15.6:0/3144452427 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424590333 0 0) 0x7fac400cd940 con 0x7fac4015e750 2023-11-28T21:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac44b6b640 1 -- 172.21.15.6:0/3144452427 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac4015b510 con 0x7fac4015e750 2023-11-28T21:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac4536c640 1 -- 172.21.15.6:0/3144452427 >> v1:172.21.15.31:6789/0 conn(0x7fac4015e750 legacy=0x7fac4015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac4536c640 1 -- 172.21.15.6:0/3144452427 >> v1:172.21.15.6:6789/0 conn(0x7fac4015e370 legacy=0x7fac400cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.311+0000 7fac4536c640 1 -- 172.21.15.6:0/3144452427 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac400cdc20 con 0x7fac400cbf40 2023-11-28T21:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac4536c640 1 --2- 172.21.15.6:0/3144452427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac400cbf40 0x7fac400ce700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac300097f0 tx=0x7fac3001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d4879c88d5f555 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac44b6b640 1 -- 172.21.15.6:0/3144452427 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300ab600 con 0x7fac400cbf40 2023-11-28T21:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac44b6b640 1 -- 172.21.15.6:0/3144452427 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac300a7050 con 0x7fac400cbf40 2023-11-28T21:08:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac44b6b640 1 -- 172.21.15.6:0/3144452427 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300ab980 con 0x7fac400cbf40 2023-11-28T21:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac47dd1640 1 -- 172.21.15.6:0/3144452427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac400cbf40 msgr2=0x7fac400ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac47dd1640 1 --2- 172.21.15.6:0/3144452427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac400cbf40 0x7fac400ce700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac300097f0 tx=0x7fac3001c4c0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac47dd1640 1 -- 172.21.15.6:0/3144452427 shutdown_connections 2023-11-28T21:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac47dd1640 1 --2- 172.21.15.6:0/3144452427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac400cbf40 0x7fac400ce700 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac47dd1640 1 -- 172.21.15.6:0/3144452427 >> 172.21.15.6:0/3144452427 conn(0x7fac4006a980 msgr2=0x7fac4006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac47dd1640 1 -- 172.21.15.6:0/3144452427 shutdown_connections 2023-11-28T21:08:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.315+0000 7fac47dd1640 1 -- 172.21.15.6:0/3144452427 wait complete. 2023-11-28T21:08:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 Processor -- start 2023-11-28T21:08:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 -- start start 2023-11-28T21:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac400cbf40 0x7fac40159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4015e370 0x7fac40152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac4015e750 0x7fac4014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac40153b40 con 0x7fac400cbf40 2023-11-28T21:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac40153860 con 0x7fac4015e370 2023-11-28T21:08:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4015b880 con 0x7fac4015e750 2023-11-28T21:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac45b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac400cbf40 0x7fac40159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac45b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac400cbf40 0x7fac40159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44364/0 (socket says 172.21.15.6:44364) 2023-11-28T21:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac45b6d640 1 -- 172.21.15.6:0/1496060088 learned_addr learned my addr 172.21.15.6:0/1496060088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac4536c640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4015e370 0x7fac40152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac4636e640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac4015e750 0x7fac4014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac45b6d640 1 -- 172.21.15.6:0/1496060088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac4015e750 msgr2=0x7fac4014c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac45b6d640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac4015e750 0x7fac4014c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac45b6d640 1 -- 172.21.15.6:0/1496060088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4015e370 msgr2=0x7fac40152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac45b6d640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4015e370 0x7fac40152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac45b6d640 1 -- 172.21.15.6:0/1496060088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30009420 con 0x7fac400cbf40 2023-11-28T21:08:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac45b6d640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac400cbf40 0x7fac40159270 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00c420 tx=0x7fac3c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac367fc640 1 -- 172.21.15.6:0/1496060088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c005cf0 con 0x7fac400cbf40 2023-11-28T21:08:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac367fc640 1 -- 172.21.15.6:0/1496060088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c005e50 con 0x7fac400cbf40 2023-11-28T21:08:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4015bb60 con 0x7fac400cbf40 2023-11-28T21:08:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac367fc640 1 -- 172.21.15.6:0/1496060088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c007310 con 0x7fac400cbf40 2023-11-28T21:08:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac401597b0 con 0x7fac400cbf40 2023-11-28T21:08:58.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.319+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4015b6e0 con 0x7fac400cbf40 2023-11-28T21:08:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.323+0000 7fac367fc640 1 -- 172.21.15.6:0/1496060088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fac3c007470 con 0x7fac400cbf40 2023-11-28T21:08:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.323+0000 7fac367fc640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fac24066470 0x7fac24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.323+0000 7fac367fc640 1 -- 172.21.15.6:0/1496060088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fac3c083520 con 0x7fac400cbf40 2023-11-28T21:08:58.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.323+0000 7fac4536c640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fac24066470 0x7fac24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.323+0000 7fac4536c640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fac24066470 0x7fac24068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fac300ad000 tx=0x7fac30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:58.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.327+0000 7fac367fc640 1 -- 172.21.15.6:0/1496060088 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fac4015b6e0 con 0x7fac400cbf40 2023-11-28T21:08:58.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.495+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fac40159a00 con 0x7fac400cbf40 2023-11-28T21:08:58.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.495+0000 7fac367fc640 1 -- 172.21.15.6:0/1496060088 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fac40159a00 con 0x7fac400cbf40 2023-11-28T21:08:58.502 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fac24066470 msgr2=0x7fac24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fac24066470 0x7fac24068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fac300ad000 tx=0x7fac30008040 comp rx=0 tx=0).stop 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac400cbf40 msgr2=0x7fac40159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac400cbf40 0x7fac40159270 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00c420 tx=0x7fac3c00c8e0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 shutdown_connections 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fac24066470 0x7fac24068930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fac4015e750 0x7fac4014c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac4015e370 0x7fac40152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 --2- 172.21.15.6:0/1496060088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac400cbf40 0x7fac40159270 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 >> 172.21.15.6:0/1496060088 conn(0x7fac4006a980 msgr2=0x7fac4015a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:58.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 shutdown_connections 2023-11-28T21:08:58.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.499+0000 7fac47dd1640 1 -- 172.21.15.6:0/1496060088 wait complete. 2023-11-28T21:08:58.526 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2023-11-28T21:08:58.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:58.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-28T21:08:58.551 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:08:58.551 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-28T21:08:58.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:08:58.551 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T21:08:58.605 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T21:08:58.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:08:58.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2b006b640 1 Processor -- start 2023-11-28T21:08:58.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2b006b640 1 -- start start 2023-11-28T21:08:58.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2b006b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb2a8162890 0x7fb2a80705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2b006b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2a8070b20 0x7fb2a806c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2b006b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a8070f70 con 0x7fb2a815f230 2023-11-28T21:08:58.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2b006b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a80b32c0 con 0x7fb2a8070b20 2023-11-28T21:08:58.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2b006b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a815f610 con 0x7fb2a8162890 2023-11-28T21:08:58.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2ae608640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2a8070b20 0x7fb2a806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2ae608640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2a8070b20 0x7fb2a806c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42556/0 (socket says 172.21.15.6:42556) 2023-11-28T21:08:58.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.743+0000 7fb2ae608640 1 -- 172.21.15.6:0/3863655282 learned_addr learned my addr 172.21.15.6:0/3863655282 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:58.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2ad606640 1 --2- 172.21.15.6:0/3863655282 >> v2:172.21.15.31:3300/0 conn(0x7fb2a8162890 0x7fb2a80705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2ae608640 1 -- 172.21.15.6:0/3863655282 >> v2:172.21.15.31:3300/0 conn(0x7fb2a8162890 msgr2=0x7fb2a80705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:58.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2ae608640 1 --2- 172.21.15.6:0/3863655282 >> v2:172.21.15.31:3300/0 conn(0x7fb2a8162890 0x7fb2a80705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2ae608640 1 -- 172.21.15.6:0/3863655282 >> v1:172.21.15.31:6789/0 conn(0x7fb2a815f230 legacy=0x7fb2a80b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2ae608640 1 -- 172.21.15.6:0/3863655282 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a80b26f0 con 0x7fb2a8070b20 2023-11-28T21:08:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2ae608640 1 --2- 172.21.15.6:0/3863655282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8070b20 0x7fb2a806c570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8072ac0 tx=0x7fb2a001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe6b508e755aaa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2ace05640 1 -- 172.21.15.6:0/3863655282 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00a57a0 con 0x7fb2a8070b20 2023-11-28T21:08:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2ace05640 1 -- 172.21.15.6:0/3863655282 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a00a5900 con 0x7fb2a8070b20 2023-11-28T21:08:58.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2ace05640 1 -- 172.21.15.6:0/3863655282 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00a5c90 con 0x7fb2a8070b20 2023-11-28T21:08:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2b006b640 1 -- 172.21.15.6:0/3863655282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8070b20 msgr2=0x7fb2a806c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.747+0000 7fb2b006b640 1 --2- 172.21.15.6:0/3863655282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8070b20 0x7fb2a806c570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8072ac0 tx=0x7fb2a001c9d0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 -- 172.21.15.6:0/3863655282 shutdown_connections 2023-11-28T21:08:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 --2- 172.21.15.6:0/3863655282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8070b20 0x7fb2a806c570 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 --2- 172.21.15.6:0/3863655282 >> v2:172.21.15.31:3300/0 conn(0x7fb2a8162890 0x7fb2a80705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 -- 172.21.15.6:0/3863655282 >> 172.21.15.6:0/3863655282 conn(0x7fb2a806ab80 msgr2=0x7fb2a80b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:58.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 -- 172.21.15.6:0/3863655282 shutdown_connections 2023-11-28T21:08:58.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 -- 172.21.15.6:0/3863655282 wait complete. 2023-11-28T21:08:58.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 Processor -- start 2023-11-28T21:08:58.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 -- start start 2023-11-28T21:08:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2a8070b20 0x7fb2a8157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a815f230 0x7fb2a815fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8162890 0x7fb2a81596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a81587c0 con 0x7fb2a8162890 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a81582b0 con 0x7fb2a815f230 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2b006b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a815a290 con 0x7fb2a8070b20 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ae608640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8162890 0x7fb2a81596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ae608640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8162890 0x7fb2a81596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42562/0 (socket says 172.21.15.6:42562) 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ae608640 1 -- 172.21.15.6:0/2542042267 learned_addr learned my addr 172.21.15.6:0/2542042267 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ade07640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2a8070b20 0x7fb2a8157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ad606640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a815f230 0x7fb2a815fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ae608640 1 -- 172.21.15.6:0/2542042267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2a8070b20 msgr2=0x7fb2a8157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ae608640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2a8070b20 0x7fb2a8157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ae608640 1 -- 172.21.15.6:0/2542042267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a815f230 msgr2=0x7fb2a815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ae608640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a815f230 0x7fb2a815fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ae608640 1 -- 172.21.15.6:0/2542042267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0009b30 con 0x7fb2a8162890 2023-11-28T21:08:58.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.751+0000 7fb2ae608640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8162890 0x7fb2a81596d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00195e0 tx=0x7fb2a0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:58.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb29e7fc640 1 -- 172.21.15.6:0/2542042267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00b8670 con 0x7fb2a8162890 2023-11-28T21:08:58.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb29e7fc640 1 -- 172.21.15.6:0/2542042267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a00b87d0 con 0x7fb2a8162890 2023-11-28T21:08:58.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb29e7fc640 1 -- 172.21.15.6:0/2542042267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00b8b80 con 0x7fb2a8162890 2023-11-28T21:08:58.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a8156fb0 con 0x7fb2a8162890 2023-11-28T21:08:58.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a8157570 con 0x7fb2a8162890 2023-11-28T21:08:58.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a80674d0 con 0x7fb2a8162890 2023-11-28T21:08:58.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb29e7fc640 1 -- 172.21.15.6:0/2542042267 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2a00b8ce0 con 0x7fb2a8162890 2023-11-28T21:08:58.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb29e7fc640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb28c066470 0x7fb28c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:58.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb29e7fc640 1 -- 172.21.15.6:0/2542042267 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb2a011f2e0 con 0x7fb2a8162890 2023-11-28T21:08:58.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb2ade07640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb28c066470 0x7fb28c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:58.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.755+0000 7fb2ade07640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb28c066470 0x7fb28c068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8158970 tx=0x7fb2a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:58.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.759+0000 7fb29e7fc640 1 -- 172.21.15.6:0/2542042267 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2a00ec770 con 0x7fb2a8162890 2023-11-28T21:08:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.947+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2a8163c10 con 0x7fb2a8162890 2023-11-28T21:08:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb29e7fc640 1 -- 172.21.15.6:0/2542042267 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7fb2a00efd90 con 0x7fb2a8162890 2023-11-28T21:08:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:58.955 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2017265312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2017265312},{"type":"v1","addr":"172.21.15.6:6837","nonce":2017265312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2658515931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2658515931},{"type":"v1","addr":"172.21.15.31:6834","nonce":2658515931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3368809777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3368809777},{"type":"v1","addr":"172.21.15.31:6835","nonce":3368809777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:08:09.785431+0000","modified":"2023-11-28T21:08:12.826904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:08:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-11-28T21:08:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb28c066470 msgr2=0x7fb28c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb28c066470 0x7fb28c068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8158970 tx=0x7fb2a4009040 comp rx=0 tx=0).stop 2023-11-28T21:08:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8162890 msgr2=0x7fb2a81596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8162890 0x7fb2a81596d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00195e0 tx=0x7fb2a0019770 comp rx=0 tx=0).stop 2023-11-28T21:08:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 shutdown_connections 2023-11-28T21:08:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb28c066470 0x7fb28c068930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a8162890 0x7fb2a81596d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a815f230 0x7fb2a815fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 --2- 172.21.15.6:0/2542042267 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2a8070b20 0x7fb2a8157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 >> 172.21.15.6:0/2542042267 conn(0x7fb2a806ab80 msgr2=0x7fb2a8163500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 shutdown_connections 2023-11-28T21:08:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:58.951+0000 7fb2b006b640 1 -- 172.21.15.6:0/2542042267 wait complete. 2023-11-28T21:08:58.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:08:59.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc9cf5640 1 Processor -- start 2023-11-28T21:08:59.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc9cf5640 1 -- start start 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc9cf5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fc415d380 0x7f4fc40d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc9cf5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fc40d1b10 0x7f4fc40ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc9cf5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40cec50 con 0x7f4fc415d760 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc9cf5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc40afd10 con 0x7f4fc415d380 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc9cf5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc40cee80 con 0x7f4fc40d1b10 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4fc415d760 0x7f4fc40d1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35782/0 (socket says 172.21.15.6:35782) 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc3fff640 1 -- 172.21.15.6:0/4050271683 learned_addr learned my addr 172.21.15.6:0/4050271683 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc8cf3640 1 --2- 172.21.15.6:0/4050271683 >> v2:172.21.15.6:3300/0 conn(0x7f4fc415d380 0x7f4fc40d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc94f4640 1 --2- 172.21.15.6:0/4050271683 >> v2:172.21.15.31:3300/0 conn(0x7f4fc40d1b10 0x7f4fc40ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc8cf3640 1 -- 172.21.15.6:0/4050271683 >> v2:172.21.15.31:3300/0 conn(0x7f4fc40d1b10 msgr2=0x7f4fc40ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc8cf3640 1 --2- 172.21.15.6:0/4050271683 >> v2:172.21.15.31:3300/0 conn(0x7f4fc40d1b10 0x7f4fc40ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc8cf3640 1 -- 172.21.15.6:0/4050271683 >> v1:172.21.15.6:6789/0 conn(0x7f4fc415d760 legacy=0x7f4fc40d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc8cf3640 1 -- 172.21.15.6:0/4050271683 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40aff60 con 0x7f4fc415d380 2023-11-28T21:08:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.115+0000 7f4fc37fe640 1 -- 172.21.15.6:0/4050271683 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70080300 0 0) 0x7f4fc40cec50 con 0x7f4fc415d760 2023-11-28T21:08:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc8cf3640 1 --2- 172.21.15.6:0/4050271683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d380 0x7f4fc40d3a30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40d2ac0 tx=0x7f4fb801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42eb91bbe3ac5df0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc37fe640 1 -- 172.21.15.6:0/4050271683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80ac600 con 0x7f4fc415d380 2023-11-28T21:08:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc37fe640 1 -- 172.21.15.6:0/4050271683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb80a8050 con 0x7f4fc415d380 2023-11-28T21:08:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc37fe640 1 -- 172.21.15.6:0/4050271683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80ac980 con 0x7f4fc415d380 2023-11-28T21:08:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4050271683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d380 msgr2=0x7f4fc40d3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 --2- 172.21.15.6:0/4050271683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d380 0x7f4fc40d3a30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40d2ac0 tx=0x7f4fb801c3a0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4050271683 shutdown_connections 2023-11-28T21:08:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 --2- 172.21.15.6:0/4050271683 >> v2:172.21.15.31:3300/0 conn(0x7f4fc40d1b10 0x7f4fc40ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 --2- 172.21.15.6:0/4050271683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d380 0x7f4fc40d3a30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4050271683 >> 172.21.15.6:0/4050271683 conn(0x7f4fc409c420 msgr2=0x7f4fc40d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4050271683 shutdown_connections 2023-11-28T21:08:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4050271683 wait complete. 2023-11-28T21:08:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 Processor -- start 2023-11-28T21:08:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.119+0000 7f4fc9cf5640 1 -- start start 2023-11-28T21:08:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc9cf5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fc40d1b10 0x7f4fc414e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc9cf5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc415d380 0x7f4fc414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc9cf5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d760 0x7f4fc4158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc9cf5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4154eb0 con 0x7f4fc415d760 2023-11-28T21:08:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc9cf5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4155190 con 0x7f4fc415d380 2023-11-28T21:08:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc9cf5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4155470 con 0x7f4fc40d1b10 2023-11-28T21:08:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc94f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d760 0x7f4fc4158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc94f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d760 0x7f4fc4158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42576/0 (socket says 172.21.15.6:42576) 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc94f4640 1 -- 172.21.15.6:0/4125207272 learned_addr learned my addr 172.21.15.6:0/4125207272 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc8cf3640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fc40d1b10 0x7f4fc414e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc3fff640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc415d380 0x7f4fc414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc94f4640 1 -- 172.21.15.6:0/4125207272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fc40d1b10 msgr2=0x7f4fc414e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc94f4640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fc40d1b10 0x7f4fc414e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc94f4640 1 -- 172.21.15.6:0/4125207272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc415d380 msgr2=0x7f4fc414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc94f4640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc415d380 0x7f4fc414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc94f4640 1 -- 172.21.15.6:0/4125207272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8009420 con 0x7f4fc415d760 2023-11-28T21:08:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc94f4640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d760 0x7f4fc4158060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc007e30 tx=0x7f4fbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc17fa640 1 -- 172.21.15.6:0/4125207272 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc014620 con 0x7f4fc415d760 2023-11-28T21:08:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc17fa640 1 -- 172.21.15.6:0/4125207272 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc00ee90 con 0x7f4fc415d760 2023-11-28T21:08:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc17fa640 1 -- 172.21.15.6:0/4125207272 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0149c0 con 0x7f4fc415d760 2023-11-28T21:08:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc4155750 con 0x7f4fc415d760 2023-11-28T21:08:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc4150410 con 0x7f4fc415d760 2023-11-28T21:08:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.123+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc4150690 con 0x7f4fc415d760 2023-11-28T21:08:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.127+0000 7f4fc17fa640 1 -- 172.21.15.6:0/4125207272 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fbc014b20 con 0x7f4fc415d760 2023-11-28T21:08:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.127+0000 7f4fc17fa640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa8066470 0x7f4fa8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.127+0000 7f4fc17fa640 1 -- 172.21.15.6:0/4125207272 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4fbc0847d0 con 0x7f4fc415d760 2023-11-28T21:08:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.127+0000 7f4fc8cf3640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa8066470 0x7f4fa8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.127+0000 7f4fc8cf3640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa8066470 0x7f4fa8068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80ae000 tx=0x7f4fb80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.131+0000 7f4fc17fa640 1 -- 172.21.15.6:0/4125207272 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fbc051be0 con 0x7f4fc415d760 2023-11-28T21:08:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.287+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fc40a1090 con 0x7f4fc415d760 2023-11-28T21:08:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc17fa640 1 -- 172.21.15.6:0/4125207272 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16590 (secure 0 0 0) 0x7f4fbc055200 con 0x7f4fc415d760 2023-11-28T21:08:59.296 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:08:59.296 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:52.362503+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:08:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa8066470 msgr2=0x7f4fa8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa8066470 0x7f4fa8068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80ae000 tx=0x7f4fb80a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d760 msgr2=0x7f4fc4158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d760 0x7f4fc4158060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc007e30 tx=0x7f4fbc00e4b0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 shutdown_connections 2023-11-28T21:08:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa8066470 0x7f4fa8068930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415d760 0x7f4fc4158060 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc415d380 0x7f4fc414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 --2- 172.21.15.6:0/4125207272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fc40d1b10 0x7f4fc414e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 >> 172.21.15.6:0/4125207272 conn(0x7f4fc409c420 msgr2=0x7f4fc40b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 shutdown_connections 2023-11-28T21:08:59.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.291+0000 7f4fc9cf5640 1 -- 172.21.15.6:0/4125207272 wait complete. 2023-11-28T21:08:59.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:08:07.681991+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:08:08.779920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:08:59.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:08:59.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.459+0000 7f86126ad640 1 Processor -- start 2023-11-28T21:08:59.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.459+0000 7f86126ad640 1 -- start start 2023-11-28T21:08:59.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.459+0000 7f86126ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f860c0d3b80 0x7f860c0d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.459+0000 7f86126ad640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c0cdca0 con 0x7f860c0d3700 2023-11-28T21:08:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.459+0000 7f86126ad640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c0cdf80 con 0x7f860c0cf9d0 2023-11-28T21:08:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.459+0000 7f86126ad640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c0ce260 con 0x7f860c0d3b80 2023-11-28T21:08:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.459+0000 7f8610eaa640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f860c0d3700 0x7f860c0d0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35798/0 (socket says 172.21.15.6:35798) 2023-11-28T21:08:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.459+0000 7f8610eaa640 1 -- 172.21.15.6:0/1212337679 learned_addr learned my addr 172.21.15.6:0/1212337679 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8611eac640 1 --2- 172.21.15.6:0/1212337679 >> v2:172.21.15.6:3300/0 conn(0x7f860c0d3b80 0x7f860c0d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8603fff640 1 -- 172.21.15.6:0/1212337679 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759263822 0 0) 0x7f860c0cdca0 con 0x7f860c0d3700 2023-11-28T21:08:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8603fff640 1 -- 172.21.15.6:0/1212337679 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f8003530 con 0x7f860c0d3700 2023-11-28T21:08:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8603fff640 1 -- 172.21.15.6:0/1212337679 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363992434 0 0) 0x7f860c0cdf80 con 0x7f860c0cf9d0 2023-11-28T21:08:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8611eac640 1 -- 172.21.15.6:0/1212337679 >> v1:172.21.15.31:6789/0 conn(0x7f860c0cf9d0 legacy=0x7f860c0cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8611eac640 1 -- 172.21.15.6:0/1212337679 >> v1:172.21.15.6:6789/0 conn(0x7f860c0d3700 legacy=0x7f860c0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8611eac640 1 -- 172.21.15.6:0/1212337679 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0ce540 con 0x7f860c0d3b80 2023-11-28T21:08:59.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8611eac640 1 --2- 172.21.15.6:0/1212337679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 0x7f860c0d12d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8604009d90 tx=0x7f860401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747de48798572567 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:59.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8603fff640 1 -- 172.21.15.6:0/1212337679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86040a58f0 con 0x7f860c0d3b80 2023-11-28T21:08:59.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8603fff640 1 -- 172.21.15.6:0/1212337679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86040a5a50 con 0x7f860c0d3b80 2023-11-28T21:08:59.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.463+0000 7f8603fff640 1 -- 172.21.15.6:0/1212337679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86040a5dc0 con 0x7f860c0d3b80 2023-11-28T21:08:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 -- 172.21.15.6:0/1212337679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 msgr2=0x7f860c0d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 --2- 172.21.15.6:0/1212337679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 0x7f860c0d12d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8604009d90 tx=0x7f860401c920 comp rx=0 tx=0).stop 2023-11-28T21:08:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 -- 172.21.15.6:0/1212337679 shutdown_connections 2023-11-28T21:08:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 --2- 172.21.15.6:0/1212337679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 0x7f860c0d12d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 -- 172.21.15.6:0/1212337679 >> 172.21.15.6:0/1212337679 conn(0x7f860c09c300 msgr2=0x7f860c0d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 -- 172.21.15.6:0/1212337679 shutdown_connections 2023-11-28T21:08:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 -- 172.21.15.6:0/1212337679 wait complete. 2023-11-28T21:08:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 Processor -- start 2023-11-28T21:08:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 -- start start 2023-11-28T21:08:59.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f860c0cf9d0 0x7f860c14b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f860c0d3700 0x7f860c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 0x7f860c14fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c150800 con 0x7f860c0d3b80 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c150ae0 con 0x7f860c0d3700 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86126ad640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c150dc0 con 0x7f860c0cf9d0 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8611eac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 0x7f860c14fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8611eac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 0x7f860c14fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42590/0 (socket says 172.21.15.6:42590) 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8611eac640 1 -- 172.21.15.6:0/4281911770 learned_addr learned my addr 172.21.15.6:0/4281911770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f86116ab640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f860c0cf9d0 0x7f860c14b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8610eaa640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f860c0d3700 0x7f860c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8611eac640 1 -- 172.21.15.6:0/4281911770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f860c0cf9d0 msgr2=0x7f860c14b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8611eac640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f860c0cf9d0 0x7f860c14b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8611eac640 1 -- 172.21.15.6:0/4281911770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f860c0d3700 msgr2=0x7f860c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8611eac640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f860c0d3700 0x7f860c153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8611eac640 1 -- 172.21.15.6:0/4281911770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604009a70 con 0x7f860c0d3b80 2023-11-28T21:08:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8610eaa640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f860c0d3700 0x7f860c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.467+0000 7f8611eac640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 0x7f860c14fe90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8604009d90 tx=0x7f86040196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f8601ffb640 1 -- 172.21.15.6:0/4281911770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86040ad850 con 0x7f860c0d3b80 2023-11-28T21:08:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f8601ffb640 1 -- 172.21.15.6:0/4281911770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86040ad9b0 con 0x7f860c0d3b80 2023-11-28T21:08:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f8601ffb640 1 -- 172.21.15.6:0/4281911770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86040add60 con 0x7f860c0d3b80 2023-11-28T21:08:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c0b3c70 con 0x7f860c0d3b80 2023-11-28T21:08:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c1503d0 con 0x7f860c0d3b80 2023-11-28T21:08:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c1505c0 con 0x7f860c0d3b80 2023-11-28T21:08:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f8601ffb640 1 -- 172.21.15.6:0/4281911770 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f86040b4070 con 0x7f860c0d3b80 2023-11-28T21:08:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f8601ffb640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f85f0066470 0x7f85f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f8601ffb640 1 -- 172.21.15.6:0/4281911770 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f860411eb70 con 0x7f860c0d3b80 2023-11-28T21:08:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f86116ab640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f85f0066470 0x7f85f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.471+0000 7f86116ab640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f85f0066470 0x7f85f0068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f860c155540 tx=0x7f8608009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:59.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.475+0000 7f8601ffb640 1 -- 172.21.15.6:0/4281911770 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f860c1505c0 con 0x7f860c0d3b80 2023-11-28T21:08:59.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.635+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f860c1505c0 con 0x7f860c0d3b80 2023-11-28T21:08:59.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.635+0000 7f8601ffb640 1 -- 172.21.15.6:0/4281911770 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f860c1505c0 con 0x7f860c0d3b80 2023-11-28T21:08:59.642 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:08:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f85f0066470 msgr2=0x7f85f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f85f0066470 0x7f85f0068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f860c155540 tx=0x7f8608009040 comp rx=0 tx=0).stop 2023-11-28T21:08:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 msgr2=0x7f860c14fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 0x7f860c14fe90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8604009d90 tx=0x7f86040196c0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 shutdown_connections 2023-11-28T21:08:59.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f85f0066470 0x7f85f0068930 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f860c0d3b80 0x7f860c14fe90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f860c0d3700 0x7f860c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 --2- 172.21.15.6:0/4281911770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f860c0cf9d0 0x7f860c14b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 >> 172.21.15.6:0/4281911770 conn(0x7f860c09c300 msgr2=0x7f860c156490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 shutdown_connections 2023-11-28T21:08:59.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.639+0000 7f86126ad640 1 -- 172.21.15.6:0/4281911770 wait complete. 2023-11-28T21:08:59.663 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T21:08:59.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414f39d640 1 Processor -- start 2023-11-28T21:08:59.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414f39d640 1 -- start start 2023-11-28T21:08:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414f39d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41480cc3f0 0x7f414815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414f39d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 0x7f414815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414f39d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41480cc8a0 con 0x7f414806ca00 2023-11-28T21:08:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414f39d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41480cd400 con 0x7f41480cc3f0 2023-11-28T21:08:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414f39d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414815c700 con 0x7f414815c270 2023-11-28T21:08:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414d139640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f414806ca00 0x7f414806cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35808/0 (socket says 172.21.15.6:35808) 2023-11-28T21:08:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414d139640 1 -- 172.21.15.6:0/1425512279 learned_addr learned my addr 172.21.15.6:0/1425512279 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:08:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.803+0000 7f414c938640 1 --2- 172.21.15.6:0/1425512279 >> v2:172.21.15.6:3300/0 conn(0x7f41480cc3f0 0x7f414815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414d93a640 1 --2- 172.21.15.6:0/1425512279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 0x7f414815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414c938640 1 -- 172.21.15.6:0/1425512279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 msgr2=0x7f414815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:08:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414c938640 1 --2- 172.21.15.6:0/1425512279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 0x7f414815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414c938640 1 -- 172.21.15.6:0/1425512279 >> v1:172.21.15.6:6789/0 conn(0x7f414806ca00 legacy=0x7f414806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414c938640 1 -- 172.21.15.6:0/1425512279 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480ccb60 con 0x7f41480cc3f0 2023-11-28T21:08:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f413ffff640 1 -- 172.21.15.6:0/1425512279 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082207862 0 0) 0x7f41480cc8a0 con 0x7f414806ca00 2023-11-28T21:08:59.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414c938640 1 --2- 172.21.15.6:0/1425512279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41480cc3f0 0x7f414815bd30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4138009820 tx=0x7f413801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8363fe7a2681f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f413ffff640 1 -- 172.21.15.6:0/1425512279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380ac600 con 0x7f41480cc3f0 2023-11-28T21:08:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f413ffff640 1 -- 172.21.15.6:0/1425512279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41380a8050 con 0x7f41480cc3f0 2023-11-28T21:08:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f413ffff640 1 -- 172.21.15.6:0/1425512279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380ac980 con 0x7f41480cc3f0 2023-11-28T21:08:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414f39d640 1 -- 172.21.15.6:0/1425512279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41480cc3f0 msgr2=0x7f414815bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414f39d640 1 --2- 172.21.15.6:0/1425512279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41480cc3f0 0x7f414815bd30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4138009820 tx=0x7f413801c3a0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414f39d640 1 -- 172.21.15.6:0/1425512279 shutdown_connections 2023-11-28T21:08:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414f39d640 1 --2- 172.21.15.6:0/1425512279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 0x7f414815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414f39d640 1 --2- 172.21.15.6:0/1425512279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41480cc3f0 0x7f414815bd30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.807+0000 7f414f39d640 1 -- 172.21.15.6:0/1425512279 >> 172.21.15.6:0/1425512279 conn(0x7f414806a980 msgr2=0x7f414806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:59.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 -- 172.21.15.6:0/1425512279 shutdown_connections 2023-11-28T21:08:59.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 -- 172.21.15.6:0/1425512279 wait complete. 2023-11-28T21:08:59.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 Processor -- start 2023-11-28T21:08:59.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 -- start start 2023-11-28T21:08:59.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414806ca00 0x7f41481654a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41480cc3f0 0x7f4148156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 0x7f4148141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41481f61a0 con 0x7f414806ca00 2023-11-28T21:08:59.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41481659e0 con 0x7f41480cc3f0 2023-11-28T21:08:59.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414f39d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41480719a0 con 0x7f414815c270 2023-11-28T21:08:59.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d139640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414806ca00 0x7f41481654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d139640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414806ca00 0x7f41481654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42598/0 (socket says 172.21.15.6:42598) 2023-11-28T21:08:59.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d139640 1 -- 172.21.15.6:0/3291429443 learned_addr learned my addr 172.21.15.6:0/3291429443 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:08:59.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414c938640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41480cc3f0 0x7f4148156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d93a640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 0x7f4148141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d139640 1 -- 172.21.15.6:0/3291429443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 msgr2=0x7f4148141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d139640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 0x7f4148141010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d139640 1 -- 172.21.15.6:0/3291429443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41480cc3f0 msgr2=0x7f4148156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d139640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41480cc3f0 0x7f4148156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d139640 1 -- 172.21.15.6:0/3291429443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009420 con 0x7f414806ca00 2023-11-28T21:08:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d93a640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 0x7f4148141010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:08:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.811+0000 7f414d139640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414806ca00 0x7f41481654a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f41440011f0 tx=0x7f414400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f413dffb640 1 -- 172.21.15.6:0/3291429443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440074e0 con 0x7f414806ca00 2023-11-28T21:08:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f413dffb640 1 -- 172.21.15.6:0/3291429443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4144007640 con 0x7f414806ca00 2023-11-28T21:08:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4148071c80 con 0x7f414806ca00 2023-11-28T21:08:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f413dffb640 1 -- 172.21.15.6:0/3291429443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144004a10 con 0x7f414806ca00 2023-11-28T21:08:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4148072240 con 0x7f414806ca00 2023-11-28T21:08:59.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4148072b90 con 0x7f414806ca00 2023-11-28T21:08:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f413dffb640 1 -- 172.21.15.6:0/3291429443 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4144004b70 con 0x7f414806ca00 2023-11-28T21:08:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f413dffb640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f412c066470 0x7f412c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:08:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f413dffb640 1 -- 172.21.15.6:0/3291429443 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4144083280 con 0x7f414806ca00 2023-11-28T21:08:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f414c938640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f412c066470 0x7f412c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:08:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.815+0000 7f414c938640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f412c066470 0x7f412c068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f41380ae000 tx=0x7f41380a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:08:59.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.819+0000 7f413dffb640 1 -- 172.21.15.6:0/3291429443 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4144050600 con 0x7f414806ca00 2023-11-28T21:08:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.975+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f414804e930 con 0x7f414806ca00 2023-11-28T21:08:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f413dffb640 1 -- 172.21.15.6:0/3291429443 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41440180a0 con 0x7f414806ca00 2023-11-28T21:08:59.983 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-28T21:08:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f412c066470 msgr2=0x7f412c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f412c066470 0x7f412c068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f41380ae000 tx=0x7f41380a7000 comp rx=0 tx=0).stop 2023-11-28T21:08:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414806ca00 msgr2=0x7f41481654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:08:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414806ca00 0x7f41481654a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f41440011f0 tx=0x7f414400c9b0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 shutdown_connections 2023-11-28T21:08:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f412c066470 0x7f412c068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f414815c270 0x7f4148141010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41480cc3f0 0x7f4148156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 --2- 172.21.15.6:0/3291429443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f414806ca00 0x7f41481654a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:08:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 >> 172.21.15.6:0/3291429443 conn(0x7f414806a980 msgr2=0x7f4148154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:08:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 shutdown_connections 2023-11-28T21:08:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:08:59.979+0000 7f414f39d640 1 -- 172.21.15.6:0/3291429443 wait complete. 2023-11-28T21:09:00.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T21:09:00.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.143+0000 7f3cfb2d6640 1 Processor -- start 2023-11-28T21:09:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.143+0000 7f3cfb2d6640 1 -- start start 2023-11-28T21:09:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cfb2d6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cf4160a70 0x7f3cf40cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cfb2d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf40d1500 0x7f3cf40d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cfb2d6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf40d2260 con 0x7f3cf40b3160 2023-11-28T21:09:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cfb2d6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf40d19c0 con 0x7f3cf4160a70 2023-11-28T21:09:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cfb2d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40d1ca0 con 0x7f3cf40d1500 2023-11-28T21:09:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf8871640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf40d1500 0x7f3cf40d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf9072640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cf4160a70 0x7f3cf40cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf8871640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf40d1500 0x7f3cf40d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:42944/0 (socket says 172.21.15.6:42944) 2023-11-28T21:09:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf9873640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3cf40b3160 0x7f3cf40b35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:52444/0 (socket says 172.21.15.6:52444) 2023-11-28T21:09:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf8871640 1 -- 172.21.15.6:0/44341052 learned_addr learned my addr 172.21.15.6:0/44341052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf9072640 1 -- 172.21.15.6:0/44341052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf40d1500 msgr2=0x7f3cf40d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf9072640 1 --2- 172.21.15.6:0/44341052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf40d1500 0x7f3cf40d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf9072640 1 -- 172.21.15.6:0/44341052 >> v1:172.21.15.31:6789/0 conn(0x7f3cf40b3160 legacy=0x7f3cf40b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf9072640 1 -- 172.21.15.6:0/44341052 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf40d1f80 con 0x7f3cf4160a70 2023-11-28T21:09:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.147+0000 7f3cf8871640 1 --2- 172.21.15.6:0/44341052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf40d1500 0x7f3cf40d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:09:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cf9072640 1 --2- 172.21.15.6:0/44341052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf4160a70 0x7f3cf40cfb70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00097c0 tx=0x7f3cf001c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=750383029f4efd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cebfff640 1 -- 172.21.15.6:0/44341052 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0004230 con 0x7f3cf4160a70 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cebfff640 1 -- 172.21.15.6:0/44341052 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf00a7050 con 0x7f3cf4160a70 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cebfff640 1 -- 172.21.15.6:0/44341052 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0003620 con 0x7f3cf4160a70 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/44341052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf4160a70 msgr2=0x7f3cf40cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 --2- 172.21.15.6:0/44341052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf4160a70 0x7f3cf40cfb70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00097c0 tx=0x7f3cf001c440 comp rx=0 tx=0).stop 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/44341052 shutdown_connections 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 --2- 172.21.15.6:0/44341052 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf40d1500 0x7f3cf40d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 --2- 172.21.15.6:0/44341052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf4160a70 0x7f3cf40cfb70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/44341052 >> 172.21.15.6:0/44341052 conn(0x7f3cf409c490 msgr2=0x7f3cf40d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/44341052 shutdown_connections 2023-11-28T21:09:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/44341052 wait complete. 2023-11-28T21:09:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 Processor -- start 2023-11-28T21:09:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.151+0000 7f3cfb2d6640 1 -- start start 2023-11-28T21:09:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cfb2d6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf40b3160 0x7f3cf40c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cfb2d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf40d1500 0x7f3cf41553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cfb2d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf4160a70 0x7f3cf4155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cfb2d6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf41412d0 con 0x7f3cf40b3160 2023-11-28T21:09:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cfb2d6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40b7ce0 con 0x7f3cf40d1500 2023-11-28T21:09:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cfb2d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf40b7fc0 con 0x7f3cf4160a70 2023-11-28T21:09:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9072640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf40b3160 0x7f3cf40c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9072640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf40b3160 0x7f3cf40c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42600/0 (socket says 172.21.15.6:42600) 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9072640 1 -- 172.21.15.6:0/3677468832 learned_addr learned my addr 172.21.15.6:0/3677468832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9873640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf4160a70 0x7f3cf4155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf8871640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf40d1500 0x7f3cf41553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9072640 1 -- 172.21.15.6:0/3677468832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf4160a70 msgr2=0x7f3cf4155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9072640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf4160a70 0x7f3cf4155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9072640 1 -- 172.21.15.6:0/3677468832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf40d1500 msgr2=0x7f3cf41553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9072640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf40d1500 0x7f3cf41553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9072640 1 -- 172.21.15.6:0/3677468832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40094d0 con 0x7f3cf40b3160 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf8871640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf40d1500 0x7f3cf41553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cf9072640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf40b3160 0x7f3cf40c9400 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3cf001a070 tx=0x7f3cf00191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3ce9ffb640 1 -- 172.21.15.6:0/3677468832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0003a30 con 0x7f3cf40b3160 2023-11-28T21:09:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3ce9ffb640 1 -- 172.21.15.6:0/3677468832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0003b90 con 0x7f3cf40b3160 2023-11-28T21:09:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf0009420 con 0x7f3cf40b3160 2023-11-28T21:09:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3ce9ffb640 1 -- 172.21.15.6:0/3677468832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00ab440 con 0x7f3cf40b3160 2023-11-28T21:09:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf40b8580 con 0x7f3cf40b3160 2023-11-28T21:09:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.155+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf40b8770 con 0x7f3cf40b3160 2023-11-28T21:09:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.159+0000 7f3ce9ffb640 1 -- 172.21.15.6:0/3677468832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3cf00b2050 con 0x7f3cf40b3160 2023-11-28T21:09:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.159+0000 7f3ce9ffb640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3cd8066470 0x7f3cd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.159+0000 7f3ce9ffb640 1 -- 172.21.15.6:0/3677468832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3cf011dff0 con 0x7f3cf40b3160 2023-11-28T21:09:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.159+0000 7f3cf8871640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3cd8066470 0x7f3cd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.159+0000 7f3cf8871640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3cd8066470 0x7f3cd8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4156d90 tx=0x7f3ce4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:00.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.163+0000 7f3ce9ffb640 1 -- 172.21.15.6:0/3677468832 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3cf40b8770 con 0x7f3cf40b3160 2023-11-28T21:09:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.319+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3cf40b8770 con 0x7f3cf40b3160 2023-11-28T21:09:00.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.319+0000 7f3ce9ffb640 1 -- 172.21.15.6:0/3677468832 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3cf40b8770 con 0x7f3cf40b3160 2023-11-28T21:09:00.326 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-28T21:09:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3cd8066470 msgr2=0x7f3cd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3cd8066470 0x7f3cd8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4156d90 tx=0x7f3ce4008040 comp rx=0 tx=0).stop 2023-11-28T21:09:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf40b3160 msgr2=0x7f3cf40c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf40b3160 0x7f3cf40c9400 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3cf001a070 tx=0x7f3cf00191e0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 shutdown_connections 2023-11-28T21:09:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3cd8066470 0x7f3cd8068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cf4160a70 0x7f3cf4155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cf40d1500 0x7f3cf41553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 --2- 172.21.15.6:0/3677468832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cf40b3160 0x7f3cf40c9400 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 >> 172.21.15.6:0/3677468832 conn(0x7f3cf409c490 msgr2=0x7f3cf40cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 shutdown_connections 2023-11-28T21:09:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.323+0000 7f3cfb2d6640 1 -- 172.21.15.6:0/3677468832 wait complete. 2023-11-28T21:09:00.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:09:00.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67ea31e640 1 Processor -- start 2023-11-28T21:09:00.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67ea31e640 1 -- start start 2023-11-28T21:09:00.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67ea31e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67e415d760 0x7f67e40d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67ea31e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f67e40d1b10 0x7f67e40ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67ea31e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e40cec50 con 0x7f67e415d380 2023-11-28T21:09:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67ea31e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e40afd10 con 0x7f67e415d760 2023-11-28T21:09:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67ea31e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e40cee80 con 0x7f67e40d1b10 2023-11-28T21:09:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67e8b1b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67e415d760 0x7f67e40d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67e8b1b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67e415d760 0x7f67e40d3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42604/0 (socket says 172.21.15.6:42604) 2023-11-28T21:09:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67e8b1b640 1 -- 172.21.15.6:0/3673137242 learned_addr learned my addr 172.21.15.6:0/3673137242 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67e9b1d640 1 --2- 172.21.15.6:0/3673137242 >> v2:172.21.15.31:3300/0 conn(0x7f67e40d1b10 0x7f67e40ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67e8b1b640 1 -- 172.21.15.6:0/3673137242 >> v2:172.21.15.31:3300/0 conn(0x7f67e40d1b10 msgr2=0x7f67e40ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:00.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67e8b1b640 1 --2- 172.21.15.6:0/3673137242 >> v2:172.21.15.31:3300/0 conn(0x7f67e40d1b10 0x7f67e40ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67e8b1b640 1 -- 172.21.15.6:0/3673137242 >> v1:172.21.15.31:6789/0 conn(0x7f67e415d380 legacy=0x7f67e40d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.487+0000 7f67e8b1b640 1 -- 172.21.15.6:0/3673137242 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e40aff60 con 0x7f67e415d760 2023-11-28T21:09:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67e8b1b640 1 --2- 172.21.15.6:0/3673137242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d760 0x7f67e40d3a30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67e40d2ac0 tx=0x7f67d401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4895f4e7bb18d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67dbfff640 1 -- 172.21.15.6:0/3673137242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40ab640 con 0x7f67e415d760 2023-11-28T21:09:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67dbfff640 1 -- 172.21.15.6:0/3673137242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d40a7070 con 0x7f67e415d760 2023-11-28T21:09:00.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67dbfff640 1 -- 172.21.15.6:0/3673137242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40ab9c0 con 0x7f67e415d760 2023-11-28T21:09:00.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67ea31e640 1 -- 172.21.15.6:0/3673137242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d760 msgr2=0x7f67e40d3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67ea31e640 1 --2- 172.21.15.6:0/3673137242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d760 0x7f67e40d3a30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67e40d2ac0 tx=0x7f67d401c440 comp rx=0 tx=0).stop 2023-11-28T21:09:00.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67ea31e640 1 -- 172.21.15.6:0/3673137242 shutdown_connections 2023-11-28T21:09:00.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67ea31e640 1 --2- 172.21.15.6:0/3673137242 >> v2:172.21.15.31:3300/0 conn(0x7f67e40d1b10 0x7f67e40ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67ea31e640 1 --2- 172.21.15.6:0/3673137242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d760 0x7f67e40d3a30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67ea31e640 1 -- 172.21.15.6:0/3673137242 >> 172.21.15.6:0/3673137242 conn(0x7f67e409c420 msgr2=0x7f67e40d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:00.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67ea31e640 1 -- 172.21.15.6:0/3673137242 shutdown_connections 2023-11-28T21:09:00.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.491+0000 7f67ea31e640 1 -- 172.21.15.6:0/3673137242 wait complete. 2023-11-28T21:09:00.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 Processor -- start 2023-11-28T21:09:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 -- start start 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67e40d1b10 0x7f67e415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d380 0x7f67e415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67e415d760 0x7f67e414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e414f030 con 0x7f67e415d380 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4153720 con 0x7f67e415d760 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4153fc0 con 0x7f67e40d1b10 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e8b1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d380 0x7f67e415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e8b1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d380 0x7f67e415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42616/0 (socket says 172.21.15.6:42616) 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e8b1b640 1 -- 172.21.15.6:0/2849117681 learned_addr learned my addr 172.21.15.6:0/2849117681 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e9b1d640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67e415d760 0x7f67e414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e931c640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67e40d1b10 0x7f67e415ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e8b1b640 1 -- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67e40d1b10 msgr2=0x7f67e415ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e8b1b640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67e40d1b10 0x7f67e415ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e8b1b640 1 -- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67e415d760 msgr2=0x7f67e414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e8b1b640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67e415d760 0x7f67e414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e8b1b640 1 -- 172.21.15.6:0/2849117681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d40094d0 con 0x7f67e415d380 2023-11-28T21:09:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e9b1d640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67e415d760 0x7f67e414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e931c640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67e40d1b10 0x7f67e415ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67e8b1b640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d380 0x7f67e415a650 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f67d4019050 tx=0x7f67d401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:00.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67d9ffb640 1 -- 172.21.15.6:0/2849117681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40be3f0 con 0x7f67e415d380 2023-11-28T21:09:00.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67d9ffb640 1 -- 172.21.15.6:0/2849117681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d40be550 con 0x7f67e415d380 2023-11-28T21:09:00.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67d9ffb640 1 -- 172.21.15.6:0/2849117681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40be900 con 0x7f67e415d380 2023-11-28T21:09:00.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e414f260 con 0x7f67e415d380 2023-11-28T21:09:00.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.495+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e4153c50 con 0x7f67e415d380 2023-11-28T21:09:00.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.499+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e40a1090 con 0x7f67e415d380 2023-11-28T21:09:00.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.499+0000 7f67d9ffb640 1 -- 172.21.15.6:0/2849117681 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f67d40b43f0 con 0x7f67e415d380 2023-11-28T21:09:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.499+0000 7f67d9ffb640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67c80664a0 0x7f67c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.499+0000 7f67d9ffb640 1 -- 172.21.15.6:0/2849117681 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f67d411e310 con 0x7f67e415d380 2023-11-28T21:09:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.499+0000 7f67e931c640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67c80664a0 0x7f67c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.499+0000 7f67e931c640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67c80664a0 0x7f67c8068960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f67e0000f70 tx=0x7f67e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:00.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.503+0000 7f67d9ffb640 1 -- 172.21.15.6:0/2849117681 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67d40eb720 con 0x7f67e415d380 2023-11-28T21:09:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67e4154100 con 0x7f67e415d380 2023-11-28T21:09:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67d9ffb640 1 -- 172.21.15.6:0/2849117681 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f67d40eed40 con 0x7f67e415d380 2023-11-28T21:09:00.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:00.700 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2017265312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2017265312},{"type":"v1","addr":"172.21.15.6:6837","nonce":2017265312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2658515931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2658515931},{"type":"v1","addr":"172.21.15.31:6834","nonce":2658515931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3368809777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3368809777},{"type":"v1","addr":"172.21.15.31:6835","nonce":3368809777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:08:09.785431+0000","modified":"2023-11-28T21:08:12.826904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:09:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-11-28T21:09:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67c80664a0 msgr2=0x7f67c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67c80664a0 0x7f67c8068960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f67e0000f70 tx=0x7f67e0009040 comp rx=0 tx=0).stop 2023-11-28T21:09:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d380 msgr2=0x7f67e415a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d380 0x7f67e415a650 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f67d4019050 tx=0x7f67d401ac80 comp rx=0 tx=0).stop 2023-11-28T21:09:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 shutdown_connections 2023-11-28T21:09:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f67c80664a0 0x7f67c8068960 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67e415d760 0x7f67e414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67e415d380 0x7f67e415a650 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 --2- 172.21.15.6:0/2849117681 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67e40d1b10 0x7f67e415ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 >> 172.21.15.6:0/2849117681 conn(0x7f67e409c420 msgr2=0x7f67e40b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 shutdown_connections 2023-11-28T21:09:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.695+0000 7f67ea31e640 1 -- 172.21.15.6:0/2849117681 wait complete. 2023-11-28T21:09:00.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:09:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24edf5640 1 Processor -- start 2023-11-28T21:09:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24edf5640 1 -- start start 2023-11-28T21:09:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24edf5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff24815d570 0x7ff24806b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24edf5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff24806c7b0 0x7ff2480cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24edf5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24806bde0 con 0x7ff2480b3530 2023-11-28T21:09:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24edf5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2480d05b0 con 0x7ff24806c7b0 2023-11-28T21:09:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24edf5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2480cfd10 con 0x7ff24815d570 2023-11-28T21:09:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff247fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff2480b3530 0x7ff24806c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35814/0 (socket says 172.21.15.6:35814) 2023-11-28T21:09:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24d392640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff24806c7b0 0x7ff2480cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff247fff640 1 -- 172.21.15.6:0/2355505833 learned_addr learned my addr 172.21.15.6:0/2355505833 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24cb91640 1 --2- 172.21.15.6:0/2355505833 >> v2:172.21.15.31:3300/0 conn(0x7ff24815d570 0x7ff24806b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24d392640 1 -- 172.21.15.6:0/2355505833 >> v2:172.21.15.31:3300/0 conn(0x7ff24815d570 msgr2=0x7ff24806b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24d392640 1 --2- 172.21.15.6:0/2355505833 >> v2:172.21.15.31:3300/0 conn(0x7ff24815d570 0x7ff24806b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24d392640 1 -- 172.21.15.6:0/2355505833 >> v1:172.21.15.6:6789/0 conn(0x7ff2480b3530 legacy=0x7ff24806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24d392640 1 -- 172.21.15.6:0/2355505833 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2480cfff0 con 0x7ff24806c7b0 2023-11-28T21:09:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff24cb91640 1 --2- 172.21.15.6:0/2355505833 >> v2:172.21.15.31:3300/0 conn(0x7ff24815d570 0x7ff24806b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.859+0000 7ff2477fe640 1 -- 172.21.15.6:0/2355505833 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662596640 0 0) 0x7ff24806bde0 con 0x7ff2480b3530 2023-11-28T21:09:00.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff24d392640 1 --2- 172.21.15.6:0/2355505833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 0x7ff2480cbbc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff248070de0 tx=0x7ff24001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f674b200f8a0e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff2477fe640 1 -- 172.21.15.6:0/2355505833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2400a58b0 con 0x7ff24806c7b0 2023-11-28T21:09:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff2477fe640 1 -- 172.21.15.6:0/2355505833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2400a5a10 con 0x7ff24806c7b0 2023-11-28T21:09:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff2477fe640 1 -- 172.21.15.6:0/2355505833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2400a5da0 con 0x7ff24806c7b0 2023-11-28T21:09:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff24edf5640 1 -- 172.21.15.6:0/2355505833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 msgr2=0x7ff2480cbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff24edf5640 1 --2- 172.21.15.6:0/2355505833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 0x7ff2480cbbc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff248070de0 tx=0x7ff24001c7f0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff24edf5640 1 -- 172.21.15.6:0/2355505833 shutdown_connections 2023-11-28T21:09:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff24edf5640 1 --2- 172.21.15.6:0/2355505833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 0x7ff2480cbbc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff24edf5640 1 --2- 172.21.15.6:0/2355505833 >> v2:172.21.15.31:3300/0 conn(0x7ff24815d570 0x7ff24806b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff24edf5640 1 -- 172.21.15.6:0/2355505833 >> 172.21.15.6:0/2355505833 conn(0x7ff2480b2a10 msgr2=0x7ff2480b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff24edf5640 1 -- 172.21.15.6:0/2355505833 shutdown_connections 2023-11-28T21:09:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.863+0000 7ff24edf5640 1 -- 172.21.15.6:0/2355505833 wait complete. 2023-11-28T21:09:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 Processor -- start 2023-11-28T21:09:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 -- start start 2023-11-28T21:09:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 0x7ff24813af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2480b3530 0x7ff24813cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff24815d570 0x7ff248151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24813b5c0 con 0x7ff24806c7b0 2023-11-28T21:09:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24813d8e0 con 0x7ff2480b3530 2023-11-28T21:09:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24813dbc0 con 0x7ff24815d570 2023-11-28T21:09:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24cb91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 0x7ff24813af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24cb91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 0x7ff24813af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42634/0 (socket says 172.21.15.6:42634) 2023-11-28T21:09:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24cb91640 1 -- 172.21.15.6:0/1308739177 learned_addr learned my addr 172.21.15.6:0/1308739177 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff247fff640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2480b3530 0x7ff24813cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24d392640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff24815d570 0x7ff248151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24cb91640 1 -- 172.21.15.6:0/1308739177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff24815d570 msgr2=0x7ff248151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24cb91640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff24815d570 0x7ff248151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24cb91640 1 -- 172.21.15.6:0/1308739177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2480b3530 msgr2=0x7ff24813cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24cb91640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2480b3530 0x7ff24813cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24cb91640 1 -- 172.21.15.6:0/1308739177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240009a70 con 0x7ff24806c7b0 2023-11-28T21:09:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff247fff640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2480b3530 0x7ff24813cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24cb91640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 0x7ff24813af50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00d800 tx=0x7ff23c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff2457fa640 1 -- 172.21.15.6:0/1308739177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c00b6c0 con 0x7ff24806c7b0 2023-11-28T21:09:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff2457fa640 1 -- 172.21.15.6:0/1308739177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c00b820 con 0x7ff24806c7b0 2023-11-28T21:09:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24813dea0 con 0x7ff24806c7b0 2023-11-28T21:09:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff2457fa640 1 -- 172.21.15.6:0/1308739177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c00bbd0 con 0x7ff24806c7b0 2023-11-28T21:09:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.867+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24814f3e0 con 0x7ff24806c7b0 2023-11-28T21:09:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.871+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24814f570 con 0x7ff24806c7b0 2023-11-28T21:09:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.871+0000 7ff2457fa640 1 -- 172.21.15.6:0/1308739177 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff23c00bd30 con 0x7ff24806c7b0 2023-11-28T21:09:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.871+0000 7ff2457fa640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff22c066470 0x7ff22c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.871+0000 7ff2457fa640 1 -- 172.21.15.6:0/1308739177 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff23c084410 con 0x7ff24806c7b0 2023-11-28T21:09:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.871+0000 7ff247fff640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff22c066470 0x7ff22c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.871+0000 7ff247fff640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff22c066470 0x7ff22c068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff248159a40 tx=0x7ff234007cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:00.875+0000 7ff2457fa640 1 -- 172.21.15.6:0/1308739177 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff23c051800 con 0x7ff24806c7b0 2023-11-28T21:09:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.035+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2480674d0 con 0x7ff24806c7b0 2023-11-28T21:09:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.035+0000 7ff2457fa640 1 -- 172.21.15.6:0/1308739177 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16590 (secure 0 0 0) 0x7ff23c054e20 con 0x7ff24806c7b0 2023-11-28T21:09:01.043 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:01.043 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:52.362503+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:09:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff22c066470 msgr2=0x7ff22c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff22c066470 0x7ff22c068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff248159a40 tx=0x7ff234007cb0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 msgr2=0x7ff24813af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 0x7ff24813af50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00d800 tx=0x7ff23c00dcc0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 shutdown_connections 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff22c066470 0x7ff22c068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff24815d570 0x7ff248151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2480b3530 0x7ff24813cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 --2- 172.21.15.6:0/1308739177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff24806c7b0 0x7ff24813af50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 >> 172.21.15.6:0/1308739177 conn(0x7ff2480b2a10 msgr2=0x7ff24806c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 shutdown_connections 2023-11-28T21:09:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.039+0000 7ff24edf5640 1 -- 172.21.15.6:0/1308739177 wait complete. 2023-11-28T21:09:01.064 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T21:09:01.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:09:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b9a79640 1 Processor -- start 2023-11-28T21:09:01.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b9a79640 1 -- start start 2023-11-28T21:09:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b9a79640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f81b40ad700 0x7f81b4160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b9a79640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81b40b32c0 0x7f81b4161280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b9a79640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b4157c80 con 0x7f81b41617c0 2023-11-28T21:09:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b9a79640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b4161c10 con 0x7f81b40b32c0 2023-11-28T21:09:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b9a79640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b406b590 con 0x7f81b40ad700 2023-11-28T21:09:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81b40b32c0 0x7f81b4161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f81b41617c0 0x7f81b415d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35824/0 (socket says 172.21.15.6:35824) 2023-11-28T21:09:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b3fff640 1 -- 172.21.15.6:0/4243733553 learned_addr learned my addr 172.21.15.6:0/4243733553 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b37fe640 1 --2- 172.21.15.6:0/4243733553 >> v2:172.21.15.31:3300/0 conn(0x7f81b40ad700 0x7f81b4160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b2ffd640 1 -- 172.21.15.6:0/4243733553 >> v2:172.21.15.31:3300/0 conn(0x7f81b40ad700 msgr2=0x7f81b4160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:01.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b2ffd640 1 --2- 172.21.15.6:0/4243733553 >> v2:172.21.15.31:3300/0 conn(0x7f81b40ad700 0x7f81b4160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b2ffd640 1 -- 172.21.15.6:0/4243733553 >> v1:172.21.15.6:6789/0 conn(0x7f81b41617c0 legacy=0x7f81b415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b2ffd640 1 -- 172.21.15.6:0/4243733553 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b40adae0 con 0x7f81b40b32c0 2023-11-28T21:09:01.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.203+0000 7f81b27fc640 1 -- 172.21.15.6:0/4243733553 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411882169 0 0) 0x7f81b4157c80 con 0x7f81b41617c0 2023-11-28T21:09:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b2ffd640 1 --2- 172.21.15.6:0/4243733553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b40b32c0 0x7f81b4161280 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f81b40b22e0 tx=0x7f81a801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933def18c1434ace server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b27fc640 1 -- 172.21.15.6:0/4243733553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a80a7070 con 0x7f81b40b32c0 2023-11-28T21:09:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b27fc640 1 -- 172.21.15.6:0/4243733553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a80ab430 con 0x7f81b40b32c0 2023-11-28T21:09:01.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b27fc640 1 -- 172.21.15.6:0/4243733553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b415e670 con 0x7f81b40b32c0 2023-11-28T21:09:01.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b9a79640 1 -- 172.21.15.6:0/4243733553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b40b32c0 msgr2=0x7f81b4161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b9a79640 1 --2- 172.21.15.6:0/4243733553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b40b32c0 0x7f81b4161280 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f81b40b22e0 tx=0x7f81a801c430 comp rx=0 tx=0).stop 2023-11-28T21:09:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b9a79640 1 -- 172.21.15.6:0/4243733553 shutdown_connections 2023-11-28T21:09:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b9a79640 1 --2- 172.21.15.6:0/4243733553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b40b32c0 0x7f81b4161280 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b9a79640 1 --2- 172.21.15.6:0/4243733553 >> v2:172.21.15.31:3300/0 conn(0x7f81b40ad700 0x7f81b4160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b9a79640 1 -- 172.21.15.6:0/4243733553 >> 172.21.15.6:0/4243733553 conn(0x7f81b40cf7b0 msgr2=0x7f81b40cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:01.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b9a79640 1 -- 172.21.15.6:0/4243733553 shutdown_connections 2023-11-28T21:09:01.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.207+0000 7f81b9a79640 1 -- 172.21.15.6:0/4243733553 wait complete. 2023-11-28T21:09:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 Processor -- start 2023-11-28T21:09:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 -- start start 2023-11-28T21:09:01.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81b40ad700 0x7f81b413e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81b40b32c0 0x7f81b4158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b41617c0 0x7f81b415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b413ea40 con 0x7f81b41617c0 2023-11-28T21:09:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b413e7b0 con 0x7f81b40ad700 2023-11-28T21:09:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b4158f00 con 0x7f81b40b32c0 2023-11-28T21:09:01.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b41617c0 0x7f81b415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b41617c0 0x7f81b415c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42652/0 (socket says 172.21.15.6:42652) 2023-11-28T21:09:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b3fff640 1 -- 172.21.15.6:0/623539676 learned_addr learned my addr 172.21.15.6:0/623539676 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b2ffd640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81b40b32c0 0x7f81b4158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b37fe640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81b40ad700 0x7f81b413e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b3fff640 1 -- 172.21.15.6:0/623539676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81b40b32c0 msgr2=0x7f81b4158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b3fff640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81b40b32c0 0x7f81b4158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b3fff640 1 -- 172.21.15.6:0/623539676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81b40ad700 msgr2=0x7f81b413e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b3fff640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81b40ad700 0x7f81b413e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b3fff640 1 -- 172.21.15.6:0/623539676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8009420 con 0x7f81b41617c0 2023-11-28T21:09:01.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b3fff640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b41617c0 0x7f81b415c130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00c780 tx=0x7f81ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:01.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f819bfff640 1 -- 172.21.15.6:0/623539676 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00ce90 con 0x7f81b41617c0 2023-11-28T21:09:01.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f819bfff640 1 -- 172.21.15.6:0/623539676 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00a640 con 0x7f81b41617c0 2023-11-28T21:09:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f819bfff640 1 -- 172.21.15.6:0/623539676 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00a9d0 con 0x7f81b41617c0 2023-11-28T21:09:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b41591e0 con 0x7f81b41617c0 2023-11-28T21:09:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.211+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b413ef30 con 0x7f81b41617c0 2023-11-28T21:09:01.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.215+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b406f630 con 0x7f81b41617c0 2023-11-28T21:09:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.215+0000 7f819bfff640 1 -- 172.21.15.6:0/623539676 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81ac00ab30 con 0x7f81b41617c0 2023-11-28T21:09:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.215+0000 7f819bfff640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f81a00664a0 0x7f81a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.215+0000 7f819bfff640 1 -- 172.21.15.6:0/623539676 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f81ac083330 con 0x7f81b41617c0 2023-11-28T21:09:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.215+0000 7f81b37fe640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f81a00664a0 0x7f81a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.215+0000 7f81b37fe640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f81a00664a0 0x7f81a0068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f81b4162930 tx=0x7f81a4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:01.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.219+0000 7f819bfff640 1 -- 172.21.15.6:0/623539676 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81ac050740 con 0x7f81b41617c0 2023-11-28T21:09:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81b41593d0 con 0x7f81b41617c0 2023-11-28T21:09:01.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f819bfff640 1 -- 172.21.15.6:0/623539676 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f81ac053d60 con 0x7f81b41617c0 2023-11-28T21:09:01.416 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:01.416 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2017265312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2017265312},{"type":"v1","addr":"172.21.15.6:6837","nonce":2017265312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2658515931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2658515931},{"type":"v1","addr":"172.21.15.31:6834","nonce":2658515931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3368809777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3368809777},{"type":"v1","addr":"172.21.15.31:6835","nonce":3368809777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:08:09.785431+0000","modified":"2023-11-28T21:08:12.826904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:09:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-11-28T21:09:01.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f81a00664a0 msgr2=0x7f81a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f81a00664a0 0x7f81a0068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f81b4162930 tx=0x7f81a4009190 comp rx=0 tx=0).stop 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b41617c0 msgr2=0x7f81b415c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b41617c0 0x7f81b415c130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00c780 tx=0x7f81ac00cc40 comp rx=0 tx=0).stop 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 shutdown_connections 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f81a00664a0 0x7f81a0068960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81b41617c0 0x7f81b415c130 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f81b40b32c0 0x7f81b4158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 --2- 172.21.15.6:0/623539676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81b40ad700 0x7f81b413e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 >> 172.21.15.6:0/623539676 conn(0x7f81b40cf7b0 msgr2=0x7f81b4160cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 shutdown_connections 2023-11-28T21:09:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.411+0000 7f81b9a79640 1 -- 172.21.15.6:0/623539676 wait complete. 2023-11-28T21:09:01.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:09:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.575+0000 7f9d0605a640 1 Processor -- start 2023-11-28T21:09:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.575+0000 7f9d0605a640 1 -- start start 2023-11-28T21:09:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9d0605a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d00142da0 0x7f9d00071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9d0605a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0015e340 con 0x7f9d0015e7d0 2023-11-28T21:09:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9d0605a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d000b39b0 con 0x7f9d0006dd90 2023-11-28T21:09:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9d0605a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0015dae0 con 0x7f9d00142da0 2023-11-28T21:09:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9cfeffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9d0015e7d0 0x7f9d0006d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35834/0 (socket says 172.21.15.6:35834) 2023-11-28T21:09:01.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9cfeffd640 1 -- 172.21.15.6:0/1454952723 learned_addr learned my addr 172.21.15.6:0/1454952723 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9cff7fe640 1 --2- 172.21.15.6:0/1454952723 >> v2:172.21.15.31:3300/0 conn(0x7f9d00142da0 0x7f9d00071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9cfe7fc640 1 -- 172.21.15.6:0/1454952723 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003813479 0 0) 0x7f9d0015e340 con 0x7f9d0015e7d0 2023-11-28T21:09:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9cfe7fc640 1 -- 172.21.15.6:0/1454952723 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce8003530 con 0x7f9d0015e7d0 2023-11-28T21:09:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9cfe7fc640 1 -- 172.21.15.6:0/1454952723 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187881329 0 0) 0x7f9ce8003530 con 0x7f9d0015e7d0 2023-11-28T21:09:01.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9cff7fe640 1 -- 172.21.15.6:0/1454952723 >> v1:172.21.15.31:6789/0 conn(0x7f9d0006dd90 legacy=0x7f9d000b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9cff7fe640 1 -- 172.21.15.6:0/1454952723 >> v1:172.21.15.6:6789/0 conn(0x7f9d0015e7d0 legacy=0x7f9d0006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.579+0000 7f9cff7fe640 1 -- 172.21.15.6:0/1454952723 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d00143440 con 0x7f9d00142da0 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9cff7fe640 1 --2- 172.21.15.6:0/1454952723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d00142da0 0x7f9d00071fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00097c0 tx=0x7f9cf001c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5854066a87cdf1b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9cfe7fc640 1 -- 172.21.15.6:0/1454952723 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4001680 con 0x7f9d00142da0 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9cfe7fc640 1 -- 172.21.15.6:0/1454952723 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf00a7050 con 0x7f9d00142da0 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9cfe7fc640 1 -- 172.21.15.6:0/1454952723 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf00ab620 con 0x7f9d00142da0 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9d0605a640 1 -- 172.21.15.6:0/1454952723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d00142da0 msgr2=0x7f9d00071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9d0605a640 1 --2- 172.21.15.6:0/1454952723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d00142da0 0x7f9d00071fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00097c0 tx=0x7f9cf001c250 comp rx=0 tx=0).stop 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9d0605a640 1 -- 172.21.15.6:0/1454952723 shutdown_connections 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9d0605a640 1 --2- 172.21.15.6:0/1454952723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d00142da0 0x7f9d00071fb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9d0605a640 1 -- 172.21.15.6:0/1454952723 >> 172.21.15.6:0/1454952723 conn(0x7f9d0006ab80 msgr2=0x7f9d000b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9d0605a640 1 -- 172.21.15.6:0/1454952723 shutdown_connections 2023-11-28T21:09:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9d0605a640 1 -- 172.21.15.6:0/1454952723 wait complete. 2023-11-28T21:09:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.583+0000 7f9d0605a640 1 Processor -- start 2023-11-28T21:09:01.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 -- start start 2023-11-28T21:09:01.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0006dd90 0x7f9d0013dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d00142da0 0x7f9d000a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d0015e7d0 0x7f9d00158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000a8970 con 0x7f9d00142da0 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000a8bc0 con 0x7f9d0006dd90 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000a8ea0 con 0x7f9d0015e7d0 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d00142da0 0x7f9d000a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d00142da0 0x7f9d000a9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42662/0 (socket says 172.21.15.6:42662) 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfeffd640 1 -- 172.21.15.6:0/2760269424 learned_addr learned my addr 172.21.15.6:0/2760269424 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfffff640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d0015e7d0 0x7f9d00158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cff7fe640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0006dd90 0x7f9d0013dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfeffd640 1 -- 172.21.15.6:0/2760269424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d0015e7d0 msgr2=0x7f9d00158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfeffd640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d0015e7d0 0x7f9d00158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfeffd640 1 -- 172.21.15.6:0/2760269424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0006dd90 msgr2=0x7f9d0013dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfeffd640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0006dd90 0x7f9d0013dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfeffd640 1 -- 172.21.15.6:0/2760269424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0009420 con 0x7f9d00142da0 2023-11-28T21:09:01.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9cfeffd640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d00142da0 0x7f9d000a9980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400c520 tx=0x7f9cf400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9ce7fff640 1 -- 172.21.15.6:0/2760269424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40074e0 con 0x7f9d00142da0 2023-11-28T21:09:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9ce7fff640 1 -- 172.21.15.6:0/2760269424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf4007640 con 0x7f9d00142da0 2023-11-28T21:09:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d000a91e0 con 0x7f9d00142da0 2023-11-28T21:09:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9ce7fff640 1 -- 172.21.15.6:0/2760269424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4004a10 con 0x7f9d00142da0 2023-11-28T21:09:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d000a9ec0 con 0x7f9d00142da0 2023-11-28T21:09:01.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.587+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d000674d0 con 0x7f9d00142da0 2023-11-28T21:09:01.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.591+0000 7f9ce7fff640 1 -- 172.21.15.6:0/2760269424 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9cf4004b70 con 0x7f9d00142da0 2023-11-28T21:09:01.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.591+0000 7f9ce7fff640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9cec066470 0x7f9cec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.591+0000 7f9ce7fff640 1 -- 172.21.15.6:0/2760269424 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9cf4083510 con 0x7f9d00142da0 2023-11-28T21:09:01.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.591+0000 7f9cff7fe640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9cec066470 0x7f9cec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.591+0000 7f9cff7fe640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9cec066470 0x7f9cec068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00ad000 tx=0x7f9cf00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:01.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.595+0000 7f9ce7fff640 1 -- 172.21.15.6:0/2760269424 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9cf4050900 con 0x7f9d00142da0 2023-11-28T21:09:01.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d000b3010 con 0x7f9d00142da0 2023-11-28T21:09:01.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9ce7fff640 1 -- 172.21.15.6:0/2760269424 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f9cf4053f20 con 0x7f9d00142da0 2023-11-28T21:09:01.792 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:01.792 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2017265312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6835","nonce":2017265312},{"type":"v1","addr":"172.21.15.6:6837","nonce":2017265312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2658515931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2658515931},{"type":"v1","addr":"172.21.15.31:6834","nonce":2658515931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4249,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3368809777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3368809777},{"type":"v1","addr":"172.21.15.31:6835","nonce":3368809777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:08:09.785431+0000","modified":"2023-11-28T21:08:12.826904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6836/3867201250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3867201250},{"type":"v1","addr":"172.21.15.6:6836","nonce":3867201250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T21:09:01.792 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-11-28T21:09:01.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9cec066470 msgr2=0x7f9cec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9cec066470 0x7f9cec068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00ad000 tx=0x7f9cf00a6000 comp rx=0 tx=0).stop 2023-11-28T21:09:01.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d00142da0 msgr2=0x7f9d000a9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d00142da0 0x7f9d000a9980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400c520 tx=0x7f9cf400c9e0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 shutdown_connections 2023-11-28T21:09:01.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9cec066470 0x7f9cec068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d0015e7d0 0x7f9d00158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d00142da0 0x7f9d000a9980 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 --2- 172.21.15.6:0/2760269424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0006dd90 0x7f9d0013dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 >> 172.21.15.6:0/2760269424 conn(0x7f9d0006ab80 msgr2=0x7f9d000704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:01.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 shutdown_connections 2023-11-28T21:09:01.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.787+0000 7f9d0605a640 1 -- 172.21.15.6:0/2760269424 wait complete. 2023-11-28T21:09:01.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:09:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb446c91640 1 Processor -- start 2023-11-28T21:09:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb446c91640 1 -- start start 2023-11-28T21:09:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb446c91640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400d1880 0x7fb4401605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb446c91640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4400b1d30 0x7fb440160b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb446c91640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4400aff60 con 0x7fb4400b2550 2023-11-28T21:09:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb446c91640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4400b0240 con 0x7fb4400b1d30 2023-11-28T21:09:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb446c91640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400b0520 con 0x7fb4400d1880 2023-11-28T21:09:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb43ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb4400b2550 0x7fb4400b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35840/0 (socket says 172.21.15.6:35840) 2023-11-28T21:09:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb44522e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4400b1d30 0x7fb440160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb43ffff640 1 -- 172.21.15.6:0/3892411485 learned_addr learned my addr 172.21.15.6:0/3892411485 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb444a2d640 1 --2- 172.21.15.6:0/3892411485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400d1880 0x7fb4401605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb44522e640 1 -- 172.21.15.6:0/3892411485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400d1880 msgr2=0x7fb4401605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb44522e640 1 --2- 172.21.15.6:0/3892411485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400d1880 0x7fb4401605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb44522e640 1 -- 172.21.15.6:0/3892411485 >> v1:172.21.15.6:6789/0 conn(0x7fb4400b2550 legacy=0x7fb4400b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb44522e640 1 -- 172.21.15.6:0/3892411485 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400b0800 con 0x7fb4400b1d30 2023-11-28T21:09:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.951+0000 7fb444a2d640 1 --2- 172.21.15.6:0/3892411485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400d1880 0x7fb4401605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb44522e640 1 --2- 172.21.15.6:0/3892411485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400b1d30 0x7fb440160b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb438009d90 tx=0x7fb43801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d788198cf2879c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb43f7fe640 1 -- 172.21.15.6:0/3892411485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380a5a30 con 0x7fb4400b1d30 2023-11-28T21:09:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb43f7fe640 1 -- 172.21.15.6:0/3892411485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380a5b90 con 0x7fb4400b1d30 2023-11-28T21:09:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb43f7fe640 1 -- 172.21.15.6:0/3892411485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380ad440 con 0x7fb4400b1d30 2023-11-28T21:09:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb446c91640 1 -- 172.21.15.6:0/3892411485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400b1d30 msgr2=0x7fb440160b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb446c91640 1 --2- 172.21.15.6:0/3892411485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400b1d30 0x7fb440160b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb438009d90 tx=0x7fb43801c950 comp rx=0 tx=0).stop 2023-11-28T21:09:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb446c91640 1 -- 172.21.15.6:0/3892411485 shutdown_connections 2023-11-28T21:09:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb446c91640 1 --2- 172.21.15.6:0/3892411485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400b1d30 0x7fb440160b00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb446c91640 1 --2- 172.21.15.6:0/3892411485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400d1880 0x7fb4401605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb446c91640 1 -- 172.21.15.6:0/3892411485 >> 172.21.15.6:0/3892411485 conn(0x7fb44009c460 msgr2=0x7fb4400d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb446c91640 1 -- 172.21.15.6:0/3892411485 shutdown_connections 2023-11-28T21:09:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.955+0000 7fb446c91640 1 -- 172.21.15.6:0/3892411485 wait complete. 2023-11-28T21:09:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 Processor -- start 2023-11-28T21:09:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 -- start start 2023-11-28T21:09:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400b1d30 0x7fb44015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4400b2550 0x7fb44015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400d1880 0x7fb44015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44009e940 con 0x7fb4400d1880 2023-11-28T21:09:01.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400c8550 con 0x7fb4400b2550 2023-11-28T21:09:01.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44009e2f0 con 0x7fb4400b1d30 2023-11-28T21:09:01.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb44522e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400d1880 0x7fb44015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb44522e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400d1880 0x7fb44015c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42684/0 (socket says 172.21.15.6:42684) 2023-11-28T21:09:01.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb44522e640 1 -- 172.21.15.6:0/4025263846 learned_addr learned my addr 172.21.15.6:0/4025263846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:01.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb444a2d640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400b1d30 0x7fb44015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb43ffff640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4400b2550 0x7fb44015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb44522e640 1 -- 172.21.15.6:0/4025263846 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400b1d30 msgr2=0x7fb44015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb44522e640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400b1d30 0x7fb44015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb44522e640 1 -- 172.21.15.6:0/4025263846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4400b2550 msgr2=0x7fb44015bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb44522e640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4400b2550 0x7fb44015bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb44522e640 1 -- 172.21.15.6:0/4025263846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438009a70 con 0x7fb4400d1880 2023-11-28T21:09:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb44522e640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400d1880 0x7fb44015c450 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb4380b0040 tx=0x7fb4380196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb43d7fa640 1 -- 172.21.15.6:0/4025263846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380b9650 con 0x7fb4400d1880 2023-11-28T21:09:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb43d7fa640 1 -- 172.21.15.6:0/4025263846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380b97b0 con 0x7fb4400d1880 2023-11-28T21:09:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44009e5d0 con 0x7fb4400d1880 2023-11-28T21:09:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb43d7fa640 1 -- 172.21.15.6:0/4025263846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380b9b60 con 0x7fb4400d1880 2023-11-28T21:09:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.959+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44015c990 con 0x7fb4400d1880 2023-11-28T21:09:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.963+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44015cbe0 con 0x7fb4400d1880 2023-11-28T21:09:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.963+0000 7fb43d7fa640 1 -- 172.21.15.6:0/4025263846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4400d3c60 con 0x7fb4400d1880 2023-11-28T21:09:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.963+0000 7fb43d7fa640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb424066470 0x7fb424068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.963+0000 7fb43d7fa640 1 -- 172.21.15.6:0/4025263846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb43811f670 con 0x7fb4400d1880 2023-11-28T21:09:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.963+0000 7fb444a2d640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb424066470 0x7fb424068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.963+0000 7fb444a2d640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb424066470 0x7fb424068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb4340045f0 tx=0x7fb434008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:01.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:01.967+0000 7fb43d7fa640 1 -- 172.21.15.6:0/4025263846 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb4380eca80 con 0x7fb4400d1880 2023-11-28T21:09:02.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4400674d0 con 0x7fb4400d1880 2023-11-28T21:09:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb43d7fa640 1 -- 172.21.15.6:0/4025263846 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16590 (secure 0 0 0) 0x7fb438009450 con 0x7fb4400d1880 2023-11-28T21:09:02.136 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:02.137 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:08:52.362503+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:08:07.681991+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T21:08:08.779920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:09:02.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb424066470 msgr2=0x7fb424068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb424066470 0x7fb424068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb4340045f0 tx=0x7fb434008040 comp rx=0 tx=0).stop 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400d1880 msgr2=0x7fb44015c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400d1880 0x7fb44015c450 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb4380b0040 tx=0x7fb4380196f0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 shutdown_connections 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb424066470 0x7fb424068930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4400d1880 0x7fb44015c450 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4400b2550 0x7fb44015bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 --2- 172.21.15.6:0/4025263846 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb4400b1d30 0x7fb44015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 >> 172.21.15.6:0/4025263846 conn(0x7fb44009c460 msgr2=0x7fb44006b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 shutdown_connections 2023-11-28T21:09:02.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.131+0000 7fb446c91640 1 -- 172.21.15.6:0/4025263846 wait complete. 2023-11-28T21:09:02.159 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T21:09:02.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.295+0000 7f17700d6640 1 Processor -- start 2023-11-28T21:09:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.295+0000 7f17700d6640 1 -- start start 2023-11-28T21:09:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f17700d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f17680b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f17700d6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17680b1e70 0x7f176806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f17700d6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680b3e30 con 0x7f17680b22d0 2023-11-28T21:09:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f17700d6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176814b4c0 con 0x7f17680b1e70 2023-11-28T21:09:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f17700d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17680b2850 con 0x7f176814b0e0 2023-11-28T21:09:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f176d671640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17680b1e70 0x7f176806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f176de72640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f17680b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f176de72640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f17680b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43020/0 (socket says 172.21.15.6:43020) 2023-11-28T21:09:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f176de72640 1 -- 172.21.15.6:0/151758863 learned_addr learned my addr 172.21.15.6:0/151758863 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f176d671640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17680b1e70 0x7f176806c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:56090/0 (socket says 172.21.15.6:56090) 2023-11-28T21:09:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f176de72640 1 -- 172.21.15.6:0/151758863 >> v2:172.21.15.31:3300/0 conn(0x7f17680b1e70 msgr2=0x7f176806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f176de72640 1 --2- 172.21.15.6:0/151758863 >> v2:172.21.15.31:3300/0 conn(0x7f17680b1e70 0x7f176806c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f176de72640 1 -- 172.21.15.6:0/151758863 >> v1:172.21.15.31:6789/0 conn(0x7f17680b22d0 legacy=0x7f17680cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.299+0000 7f176de72640 1 -- 172.21.15.6:0/151758863 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680b2b30 con 0x7f176814b0e0 2023-11-28T21:09:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f176de72640 1 --2- 172.21.15.6:0/151758863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f17680b38f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1764009870 tx=0x7f176401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6f447574344402 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f176ce70640 1 -- 172.21.15.6:0/151758863 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640ab600 con 0x7f176814b0e0 2023-11-28T21:09:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f176ce70640 1 -- 172.21.15.6:0/151758863 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17640ab760 con 0x7f176814b0e0 2023-11-28T21:09:02.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f176ce70640 1 -- 172.21.15.6:0/151758863 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640abaf0 con 0x7f176814b0e0 2023-11-28T21:09:02.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 -- 172.21.15.6:0/151758863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 msgr2=0x7f17680b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 --2- 172.21.15.6:0/151758863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f17680b38f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1764009870 tx=0x7f176401c510 comp rx=0 tx=0).stop 2023-11-28T21:09:02.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 -- 172.21.15.6:0/151758863 shutdown_connections 2023-11-28T21:09:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 --2- 172.21.15.6:0/151758863 >> v2:172.21.15.31:3300/0 conn(0x7f17680b1e70 0x7f176806c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 --2- 172.21.15.6:0/151758863 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f17680b38f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 -- 172.21.15.6:0/151758863 >> 172.21.15.6:0/151758863 conn(0x7f176806a980 msgr2=0x7f176806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 -- 172.21.15.6:0/151758863 shutdown_connections 2023-11-28T21:09:02.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 -- 172.21.15.6:0/151758863 wait complete. 2023-11-28T21:09:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 Processor -- start 2023-11-28T21:09:02.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.303+0000 7f17700d6640 1 -- start start 2023-11-28T21:09:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f17700d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17680b1e70 0x7f1768140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f17700d6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17680b22d0 0x7f176815d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f17700d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f1768141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f17700d6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1768140810 con 0x7f17680b22d0 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f17700d6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1768140af0 con 0x7f17680b1e70 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f17700d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1768140dd0 con 0x7f176814b0e0 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176d671640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17680b22d0 0x7f176815d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176d671640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17680b22d0 0x7f176815d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42696/0 (socket says 172.21.15.6:42696) 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176d671640 1 -- 172.21.15.6:0/2135870908 learned_addr learned my addr 172.21.15.6:0/2135870908 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176e673640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f1768141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176de72640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17680b1e70 0x7f1768140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176d671640 1 -- 172.21.15.6:0/2135870908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 msgr2=0x7f1768141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176d671640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f1768141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176d671640 1 -- 172.21.15.6:0/2135870908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17680b1e70 msgr2=0x7f1768140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176d671640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17680b1e70 0x7f1768140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176d671640 1 -- 172.21.15.6:0/2135870908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640094d0 con 0x7f17680b22d0 2023-11-28T21:09:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f176d671640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17680b22d0 0x7f176815d100 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f175800e870 tx=0x7f175800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f175e7fc640 1 -- 172.21.15.6:0/2135870908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758009510 con 0x7f17680b22d0 2023-11-28T21:09:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f175e7fc640 1 -- 172.21.15.6:0/2135870908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800eec0 con 0x7f17680b22d0 2023-11-28T21:09:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17681410b0 con 0x7f17680b22d0 2023-11-28T21:09:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f175e7fc640 1 -- 172.21.15.6:0/2135870908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800cb40 con 0x7f17680b22d0 2023-11-28T21:09:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176815d640 con 0x7f17680b22d0 2023-11-28T21:09:02.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1768072b90 con 0x7f17680b22d0 2023-11-28T21:09:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.307+0000 7f175e7fc640 1 -- 172.21.15.6:0/2135870908 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f175800cca0 con 0x7f17680b22d0 2023-11-28T21:09:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.311+0000 7f175e7fc640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f174c066470 0x7f174c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.311+0000 7f175e7fc640 1 -- 172.21.15.6:0/2135870908 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1758083f90 con 0x7f17680b22d0 2023-11-28T21:09:02.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.311+0000 7f176de72640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f174c066470 0x7f174c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.311+0000 7f176de72640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f174c066470 0x7f174c068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17640af000 tx=0x7f17640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:02.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.315+0000 7f175e7fc640 1 -- 172.21.15.6:0/2135870908 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1758051430 con 0x7f17680b22d0 2023-11-28T21:09:02.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.503+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f176804e930 con 0x7f17680b22d0 2023-11-28T21:09:02.510 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-11-28T21:09:02.503+0000 7f373394c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T21:09:02.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.507+0000 7f175e7fc640 1 -- 172.21.15.6:0/2135870908 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1758054a50 con 0x7f17680b22d0 2023-11-28T21:09:02.513 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T21:09:02.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.507+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f174c066470 msgr2=0x7f174c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.507+0000 7f17700d6640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f174c066470 0x7f174c068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17640af000 tx=0x7f17640a7000 comp rx=0 tx=0).stop 2023-11-28T21:09:02.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.507+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17680b22d0 msgr2=0x7f176815d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.507+0000 7f17700d6640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17680b22d0 0x7f176815d100 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f175800e870 tx=0x7f175800ec70 comp rx=0 tx=0).stop 2023-11-28T21:09:02.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.511+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 shutdown_connections 2023-11-28T21:09:02.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.511+0000 7f17700d6640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f174c066470 0x7f174c068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.511+0000 7f17700d6640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f176814b0e0 0x7f1768141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.511+0000 7f17700d6640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17680b22d0 0x7f176815d100 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.511+0000 7f17700d6640 1 --2- 172.21.15.6:0/2135870908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17680b1e70 0x7f1768140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.511+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 >> 172.21.15.6:0/2135870908 conn(0x7f176806a980 msgr2=0x7f1768164510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:02.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.511+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 shutdown_connections 2023-11-28T21:09:02.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.511+0000 7f17700d6640 1 -- 172.21.15.6:0/2135870908 wait complete. 2023-11-28T21:09:02.522 INFO:tasks.ceph.mds.a.smithi006.stderr: -3032> 2023-11-28T21:08:12.935+0000 7f0bf37b0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T21:09:02.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T21:09:02.570 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-11-28T21:09:02.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.675+0000 7f378a9f8640 1 Processor -- start 2023-11-28T21:09:02.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.675+0000 7f378a9f8640 1 -- start start 2023-11-28T21:09:02.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f378a9f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 0x7f37840cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f378a9f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f378415c440 0x7f378415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f378a9f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37840cc930 con 0x7f378406cde0 2023-11-28T21:09:02.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f378a9f8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840cd400 con 0x7f378415c440 2023-11-28T21:09:02.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f378a9f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840ccb60 con 0x7f378406ca00 2023-11-28T21:09:02.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f3783fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 0x7f37840cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f3788f95640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f378415c440 0x7f378415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f3783fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 0x7f37840cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43052/0 (socket says 172.21.15.6:43052) 2023-11-28T21:09:02.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f3783fff640 1 -- 172.21.15.6:0/3415566606 learned_addr learned my addr 172.21.15.6:0/3415566606 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:02.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f37837fe640 1 --1- 172.21.15.6:0/3415566606 >> v1:172.21.15.31:6789/0 conn(0x7f378406cde0 0x7f378415bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:52490/0 (socket says 172.21.15.6:52490) 2023-11-28T21:09:02.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f3788f95640 1 -- 172.21.15.6:0/3415566606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 msgr2=0x7f37840cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:02.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f3788f95640 1 --2- 172.21.15.6:0/3415566606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 0x7f37840cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f3788f95640 1 -- 172.21.15.6:0/3415566606 >> v1:172.21.15.31:6789/0 conn(0x7f378406cde0 legacy=0x7f378415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.679+0000 7f3788f95640 1 -- 172.21.15.6:0/3415566606 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840cce40 con 0x7f378415c440 2023-11-28T21:09:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f3788f95640 1 --2- 172.21.15.6:0/3415566606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f378415c440 0x7f378415ce40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f377c009d90 tx=0x7f377c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db25bebd29878c8f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:02.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f3782ffd640 1 -- 172.21.15.6:0/3415566606 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0a5950 con 0x7f378415c440 2023-11-28T21:09:02.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f3782ffd640 1 -- 172.21.15.6:0/3415566606 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c0a5ab0 con 0x7f378415c440 2023-11-28T21:09:02.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f3782ffd640 1 -- 172.21.15.6:0/3415566606 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0a5e40 con 0x7f378415c440 2023-11-28T21:09:02.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f378a9f8640 1 -- 172.21.15.6:0/3415566606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f378415c440 msgr2=0x7f378415ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f378a9f8640 1 --2- 172.21.15.6:0/3415566606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f378415c440 0x7f378415ce40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f377c009d90 tx=0x7f377c01c890 comp rx=0 tx=0).stop 2023-11-28T21:09:02.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f378a9f8640 1 -- 172.21.15.6:0/3415566606 shutdown_connections 2023-11-28T21:09:02.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f378a9f8640 1 --2- 172.21.15.6:0/3415566606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f378415c440 0x7f378415ce40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f378a9f8640 1 --2- 172.21.15.6:0/3415566606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 0x7f37840cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f378a9f8640 1 -- 172.21.15.6:0/3415566606 >> 172.21.15.6:0/3415566606 conn(0x7f378406a980 msgr2=0x7f378406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:02.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f378a9f8640 1 -- 172.21.15.6:0/3415566606 shutdown_connections 2023-11-28T21:09:02.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.683+0000 7f378a9f8640 1 -- 172.21.15.6:0/3415566606 wait complete. 2023-11-28T21:09:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 Processor -- start 2023-11-28T21:09:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 -- start start 2023-11-28T21:09:02.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 0x7f3784154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378406cde0 0x7f37840a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f378415c440 0x7f37840a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3784155800 con 0x7f378406cde0 2023-11-28T21:09:02.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3784155ae0 con 0x7f378415c440 2023-11-28T21:09:02.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3784155dc0 con 0x7f378406ca00 2023-11-28T21:09:02.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f37837fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378406cde0 0x7f37840a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f37837fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378406cde0 0x7f37840a83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42718/0 (socket says 172.21.15.6:42718) 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f37837fe640 1 -- 172.21.15.6:0/2730727706 learned_addr learned my addr 172.21.15.6:0/2730727706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f3783fff640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 0x7f3784154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f3788f95640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f378415c440 0x7f37840a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f37837fe640 1 -- 172.21.15.6:0/2730727706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 msgr2=0x7f3784154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f37837fe640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 0x7f3784154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f37837fe640 1 -- 172.21.15.6:0/2730727706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f378415c440 msgr2=0x7f37840a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f37837fe640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f378415c440 0x7f37840a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f37837fe640 1 -- 172.21.15.6:0/2730727706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c009a70 con 0x7f378406cde0 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f37837fe640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378406cde0 0x7f37840a83e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f377800c490 tx=0x7f377800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:02.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f3780ff9640 1 -- 172.21.15.6:0/2730727706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778007480 con 0x7f378406cde0 2023-11-28T21:09:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f3780ff9640 1 -- 172.21.15.6:0/2730727706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37780075e0 con 0x7f378406cde0 2023-11-28T21:09:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3784156120 con 0x7f378406cde0 2023-11-28T21:09:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f3780ff9640 1 -- 172.21.15.6:0/2730727706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778004a10 con 0x7f378406cde0 2023-11-28T21:09:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.687+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37841554f0 con 0x7f378406cde0 2023-11-28T21:09:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.691+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3784072b90 con 0x7f378406cde0 2023-11-28T21:09:02.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.691+0000 7f3780ff9640 1 -- 172.21.15.6:0/2730727706 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3778004b70 con 0x7f378406cde0 2023-11-28T21:09:02.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.691+0000 7f3780ff9640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3770066470 0x7f3770068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:02.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.691+0000 7f3780ff9640 1 -- 172.21.15.6:0/2730727706 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f3778083000 con 0x7f378406cde0 2023-11-28T21:09:02.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.691+0000 7f3783fff640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3770066470 0x7f3770068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:02.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.691+0000 7f3783fff640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3770066470 0x7f3770068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f378415b500 tx=0x7f3774009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:02.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.695+0000 7f3780ff9640 1 -- 172.21.15.6:0/2730727706 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37780504f0 con 0x7f378406cde0 2023-11-28T21:09:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:02.887+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f37841565d0 con 0x7f378406cde0 2023-11-28T21:09:03.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.511+0000 7f3780ff9640 1 -- 172.21.15.6:0/2730727706 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3778053b10 con 0x7f378406cde0 2023-11-28T21:09:03.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3770066470 msgr2=0x7f3770068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:03.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3770066470 0x7f3770068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f378415b500 tx=0x7f3774009240 comp rx=0 tx=0).stop 2023-11-28T21:09:03.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378406cde0 msgr2=0x7f37840a83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378406cde0 0x7f37840a83e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f377800c490 tx=0x7f377800c950 comp rx=0 tx=0).stop 2023-11-28T21:09:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 shutdown_connections 2023-11-28T21:09:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3770066470 0x7f3770068930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f378415c440 0x7f37840a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378406cde0 0x7f37840a83e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 --2- 172.21.15.6:0/2730727706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f378406ca00 0x7f3784154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 >> 172.21.15.6:0/2730727706 conn(0x7f378406a980 msgr2=0x7f37840ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 shutdown_connections 2023-11-28T21:09:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.515+0000 7f378a9f8640 1 -- 172.21.15.6:0/2730727706 wait complete. 2023-11-28T21:09:03.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T21:09:03.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.783+0000 7f37427f8640 1 Processor -- start 2023-11-28T21:09:03.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.783+0000 7f37427f8640 1 -- start start 2023-11-28T21:09:03.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f37427f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f373c071cc0 0x7f373c06c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:03.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f37427f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c1433b0 0x7f373c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:03.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f37427f8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c143100 con 0x7f373c142d20 2023-11-28T21:09:03.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f37427f8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373c15e9c0 con 0x7f373c071cc0 2023-11-28T21:09:03.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f37427f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c06e150 con 0x7f373c1433b0 2023-11-28T21:09:03.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f373b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f373c071cc0 0x7f373c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:03.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f3740d95640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c1433b0 0x7f373c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:03.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f373b7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f373c071cc0 0x7f373c06c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:56152/0 (socket says 172.21.15.6:56152) 2023-11-28T21:09:03.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f373b7fe640 1 -- 172.21.15.6:0/2671174023 learned_addr learned my addr 172.21.15.6:0/2671174023 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:03.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f373b7fe640 1 -- 172.21.15.6:0/2671174023 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c1433b0 msgr2=0x7f373c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:03.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f373b7fe640 1 --2- 172.21.15.6:0/2671174023 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c1433b0 0x7f373c0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:03.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f373b7fe640 1 -- 172.21.15.6:0/2671174023 >> v1:172.21.15.31:6789/0 conn(0x7f373c142d20 legacy=0x7f373c0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:03.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.787+0000 7f373b7fe640 1 -- 172.21.15.6:0/2671174023 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c06e430 con 0x7f373c071cc0 2023-11-28T21:09:03.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f373b7fe640 1 --2- 172.21.15.6:0/2671174023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f373c071cc0 0x7f373c06c610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3730009870 tx=0x7f373001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=918ac11d12f00a37 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:03.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f373affd640 1 -- 172.21.15.6:0/2671174023 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300aa640 con 0x7f373c071cc0 2023-11-28T21:09:03.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f373affd640 1 -- 172.21.15.6:0/2671174023 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37300aa7a0 con 0x7f373c071cc0 2023-11-28T21:09:03.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f373affd640 1 -- 172.21.15.6:0/2671174023 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300aab30 con 0x7f373c071cc0 2023-11-28T21:09:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 -- 172.21.15.6:0/2671174023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f373c071cc0 msgr2=0x7f373c06c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 --2- 172.21.15.6:0/2671174023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f373c071cc0 0x7f373c06c610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3730009870 tx=0x7f373001c540 comp rx=0 tx=0).stop 2023-11-28T21:09:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 -- 172.21.15.6:0/2671174023 shutdown_connections 2023-11-28T21:09:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 --2- 172.21.15.6:0/2671174023 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c1433b0 0x7f373c0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 --2- 172.21.15.6:0/2671174023 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f373c071cc0 0x7f373c06c610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 -- 172.21.15.6:0/2671174023 >> 172.21.15.6:0/2671174023 conn(0x7f373c0b0b00 msgr2=0x7f373c0b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 -- 172.21.15.6:0/2671174023 shutdown_connections 2023-11-28T21:09:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 -- 172.21.15.6:0/2671174023 wait complete. 2023-11-28T21:09:03.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 Processor -- start 2023-11-28T21:09:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.791+0000 7f37427f8640 1 -- start start 2023-11-28T21:09:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f37427f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f373c071cc0 0x7f373c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f37427f8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c142d20 0x7f373c159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f37427f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f373c1433b0 0x7f373c1304f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:03.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f37427f8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c15be90 con 0x7f373c071cc0 2023-11-28T21:09:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f37427f8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c131c90 con 0x7f373c1433b0 2023-11-28T21:09:03.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f37427f8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0b3030 con 0x7f373c142d20 2023-11-28T21:09:03.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f373c071cc0 0x7f373c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:03.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f373c071cc0 0x7f373c15b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42728/0 (socket says 172.21.15.6:42728) 2023-11-28T21:09:03.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373bfff640 1 -- 172.21.15.6:0/3476179608 learned_addr learned my addr 172.21.15.6:0/3476179608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:03.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373b7fe640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c142d20 0x7f373c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:03.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f3740d95640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f373c1433b0 0x7f373c1304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373bfff640 1 -- 172.21.15.6:0/3476179608 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c142d20 msgr2=0x7f373c159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373bfff640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c142d20 0x7f373c159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373bfff640 1 -- 172.21.15.6:0/3476179608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f373c1433b0 msgr2=0x7f373c1304f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373bfff640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f373c1433b0 0x7f373c1304f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373bfff640 1 -- 172.21.15.6:0/3476179608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37300094d0 con 0x7f373c071cc0 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f373bfff640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f373c071cc0 0x7f373c15b950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c450 tx=0x7f372c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f3738ff9640 1 -- 172.21.15.6:0/3476179608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0052d0 con 0x7f373c071cc0 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f3738ff9640 1 -- 172.21.15.6:0/3476179608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c005450 con 0x7f373c071cc0 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c0b32f0 con 0x7f373c071cc0 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f3738ff9640 1 -- 172.21.15.6:0/3476179608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c012870 con 0x7f373c071cc0 2023-11-28T21:09:03.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c0b38b0 con 0x7f373c071cc0 2023-11-28T21:09:03.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c0674d0 con 0x7f373c071cc0 2023-11-28T21:09:03.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.795+0000 7f3738ff9640 1 -- 172.21.15.6:0/3476179608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f372c0129d0 con 0x7f373c071cc0 2023-11-28T21:09:03.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.799+0000 7f3738ff9640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f37280664a0 0x7f3728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.799+0000 7f3738ff9640 1 -- 172.21.15.6:0/3476179608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f372c0838e0 con 0x7f373c071cc0 2023-11-28T21:09:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.799+0000 7f373b7fe640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f37280664a0 0x7f3728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:03.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.799+0000 7f373b7fe640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f37280664a0 0x7f3728068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f37300ae000 tx=0x7f37300b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:03.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.803+0000 7f3738ff9640 1 -- 172.21.15.6:0/3476179608 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f372c050d30 con 0x7f373c071cc0 2023-11-28T21:09:03.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:03.959+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f373c143b30 con 0x7f373c071cc0 2023-11-28T21:09:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.515+0000 7f3738ff9640 1 -- 172.21.15.6:0/3476179608 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f372c054350 con 0x7f373c071cc0 2023-11-28T21:09:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-11-28T21:09:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f37280664a0 msgr2=0x7f3728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f37280664a0 0x7f3728068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f37300ae000 tx=0x7f37300b5040 comp rx=0 tx=0).stop 2023-11-28T21:09:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f373c071cc0 msgr2=0x7f373c15b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f373c071cc0 0x7f373c15b950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c450 tx=0x7f372c00c910 comp rx=0 tx=0).stop 2023-11-28T21:09:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 shutdown_connections 2023-11-28T21:09:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f37280664a0 0x7f3728068960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f373c1433b0 0x7f373c1304f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f373c142d20 0x7f373c159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 --2- 172.21.15.6:0/3476179608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f373c071cc0 0x7f373c15b950 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 >> 172.21.15.6:0/3476179608 conn(0x7f373c0b0b00 msgr2=0x7f373c163e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 shutdown_connections 2023-11-28T21:09:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.519+0000 7f37427f8640 1 -- 172.21.15.6:0/3476179608 wait complete. 2023-11-28T21:09:04.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T21:09:04.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.691+0000 7f224e8bb640 1 Processor -- start 2023-11-28T21:09:04.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.691+0000 7f224e8bb640 1 -- start start 2023-11-28T21:09:04.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f224e8bb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22480b2510 0x7f224806c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:04.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f224e8bb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22480b40e0 con 0x7f2248141970 2023-11-28T21:09:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f224e8bb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224806cbf0 con 0x7f22480b3c90 2023-11-28T21:09:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f224e8bb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224806ced0 con 0x7f22480b2510 2023-11-28T21:09:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f2247fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2248141970 0x7f22480b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35856/0 (socket says 172.21.15.6:35856) 2023-11-28T21:09:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f2247fff640 1 -- 172.21.15.6:0/1780965509 learned_addr learned my addr 172.21.15.6:0/1780965509 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f22477fe640 1 --2- 172.21.15.6:0/1780965509 >> v2:172.21.15.31:3300/0 conn(0x7f22480b2510 0x7f224806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:04.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f2246ffd640 1 -- 172.21.15.6:0/1780965509 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566800516 0 0) 0x7f2238001120 con 0x7f2248141970 2023-11-28T21:09:04.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f2246ffd640 1 -- 172.21.15.6:0/1780965509 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2230003530 con 0x7f2248141970 2023-11-28T21:09:04.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f2246ffd640 1 -- 172.21.15.6:0/1780965509 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1050879566 0 0) 0x7f2230003530 con 0x7f2248141970 2023-11-28T21:09:04.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f22477fe640 1 -- 172.21.15.6:0/1780965509 >> v1:172.21.15.31:6789/0 conn(0x7f22480b3c90 legacy=0x7f22480ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:04.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f22477fe640 1 -- 172.21.15.6:0/1780965509 >> v1:172.21.15.6:6789/0 conn(0x7f2248141970 legacy=0x7f22480b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:04.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.695+0000 7f22477fe640 1 -- 172.21.15.6:0/1780965509 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224806d1b0 con 0x7f22480b2510 2023-11-28T21:09:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f22477fe640 1 --2- 172.21.15.6:0/1780965509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 0x7f224806c610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f223c0097c0 tx=0x7f223c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3444bc5848760c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f2246ffd640 1 -- 172.21.15.6:0/1780965509 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0a4ea0 con 0x7f22480b2510 2023-11-28T21:09:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f2246ffd640 1 -- 172.21.15.6:0/1780965509 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c0a7050 con 0x7f22480b2510 2023-11-28T21:09:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f2246ffd640 1 -- 172.21.15.6:0/1780965509 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238001810 con 0x7f22480b2510 2023-11-28T21:09:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f224e8bb640 1 -- 172.21.15.6:0/1780965509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 msgr2=0x7f224806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f224e8bb640 1 --2- 172.21.15.6:0/1780965509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 0x7f224806c610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f223c0097c0 tx=0x7f223c01c3a0 comp rx=0 tx=0).stop 2023-11-28T21:09:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f224e8bb640 1 -- 172.21.15.6:0/1780965509 shutdown_connections 2023-11-28T21:09:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f224e8bb640 1 --2- 172.21.15.6:0/1780965509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 0x7f224806c610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f224e8bb640 1 -- 172.21.15.6:0/1780965509 >> 172.21.15.6:0/1780965509 conn(0x7f22480b0b00 msgr2=0x7f22480b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f224e8bb640 1 -- 172.21.15.6:0/1780965509 shutdown_connections 2023-11-28T21:09:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f224e8bb640 1 -- 172.21.15.6:0/1780965509 wait complete. 2023-11-28T21:09:04.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f224e8bb640 1 Processor -- start 2023-11-28T21:09:04.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.699+0000 7f224e8bb640 1 -- start start 2023-11-28T21:09:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224e8bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 0x7f224813b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224e8bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f22480b3c90 0x7f22480c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224e8bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2248141970 0x7f2248156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224e8bb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224813c4a0 con 0x7f2248141970 2023-11-28T21:09:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224e8bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224813c150 con 0x7f22480b2510 2023-11-28T21:09:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224e8bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224813ddf0 con 0x7f22480b3c90 2023-11-28T21:09:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224ce58640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2248141970 0x7f2248156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224ce58640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2248141970 0x7f2248156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42730/0 (socket says 172.21.15.6:42730) 2023-11-28T21:09:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224ce58640 1 -- 172.21.15.6:0/3725831960 learned_addr learned my addr 172.21.15.6:0/3725831960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f22477fe640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f22480b3c90 0x7f22480c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f2247fff640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 0x7f224813b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224ce58640 1 -- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f22480b3c90 msgr2=0x7f22480c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:04.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224ce58640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f22480b3c90 0x7f22480c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:04.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224ce58640 1 -- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 msgr2=0x7f224813b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:04.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224ce58640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 0x7f224813b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:04.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224ce58640 1 -- 172.21.15.6:0/3725831960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009420 con 0x7f2248141970 2023-11-28T21:09:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f22477fe640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f22480b3c90 0x7f22480c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f2247fff640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 0x7f224813b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224ce58640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2248141970 0x7f2248156660 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f224000c6c0 tx=0x7f224000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f2244ff9640 1 -- 172.21.15.6:0/3725831960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240003b80 con 0x7f2248141970 2023-11-28T21:09:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f2244ff9640 1 -- 172.21.15.6:0/3725831960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240003ce0 con 0x7f2248141970 2023-11-28T21:09:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f2244ff9640 1 -- 172.21.15.6:0/3725831960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400052f0 con 0x7f2248141970 2023-11-28T21:09:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224813e0d0 con 0x7f2248141970 2023-11-28T21:09:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22480c5d30 con 0x7f2248141970 2023-11-28T21:09:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.703+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22480c5f20 con 0x7f2248141970 2023-11-28T21:09:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.707+0000 7f2244ff9640 1 -- 172.21.15.6:0/3725831960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2240005450 con 0x7f2248141970 2023-11-28T21:09:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.707+0000 7f2244ff9640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f22340664a0 0x7f2234068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.707+0000 7f2244ff9640 1 -- 172.21.15.6:0/3725831960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f2240083a60 con 0x7f2248141970 2023-11-28T21:09:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.707+0000 7f2247fff640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f22340664a0 0x7f2234068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.707+0000 7f2247fff640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f22340664a0 0x7f2234068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2238001380 tx=0x7f2238009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.711+0000 7f2244ff9640 1 -- 172.21.15.6:0/3725831960 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22480c5f20 con 0x7f2248141970 2023-11-28T21:09:04.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:04.867+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f224813c5e0 con 0x7f2248141970 2023-11-28T21:09:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f2244ff9640 1 -- 172.21.15.6:0/3725831960 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f224813c5e0 con 0x7f2248141970 2023-11-28T21:09:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-11-28T21:09:05.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f22340664a0 msgr2=0x7f2234068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:05.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f22340664a0 0x7f2234068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2238001380 tx=0x7f2238009040 comp rx=0 tx=0).stop 2023-11-28T21:09:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2248141970 msgr2=0x7f2248156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2248141970 0x7f2248156660 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f224000c6c0 tx=0x7f224000cb80 comp rx=0 tx=0).stop 2023-11-28T21:09:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 shutdown_connections 2023-11-28T21:09:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f22340664a0 0x7f2234068960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2248141970 0x7f2248156660 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f22480b3c90 0x7f22480c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 --2- 172.21.15.6:0/3725831960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22480b2510 0x7f224813b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 >> 172.21.15.6:0/3725831960 conn(0x7f22480b0b00 msgr2=0x7f224815b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 shutdown_connections 2023-11-28T21:09:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.527+0000 7f224e8bb640 1 -- 172.21.15.6:0/3725831960 wait complete. 2023-11-28T21:09:05.567 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T21:09:05.567 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T21:09:05.567 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T21:09:05.567 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:09:05.568 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T21:09:05.568 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T21:09:05.568 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T21:09:05.568 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:09:05.568 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T21:09:05.568 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T21:09:05.568 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T21:09:05.569 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:09:05.569 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T21:09:05.569 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T21:09:05.569 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T21:09:05.569 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T21:09:05.583 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T21:09:05.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T21:09:05.584 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T21:09:05.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T21:09:05.586 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T21:09:05.586 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T21:09:05.589 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T21:09:05.589 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T21:09:05.633 INFO:tasks.ceph.mds.b:Started 2023-11-28T21:09:05.634 DEBUG:teuthology.parallel:result is None 2023-11-28T21:09:05.634 INFO:tasks.ceph.mds.c:Started 2023-11-28T21:09:05.634 DEBUG:teuthology.parallel:result is None 2023-11-28T21:09:05.636 INFO:tasks.ceph.mds.d:Started 2023-11-28T21:09:05.636 DEBUG:teuthology.parallel:result is None 2023-11-28T21:09:05.637 INFO:tasks.ceph.mds.a:Started 2023-11-28T21:09:05.637 DEBUG:teuthology.parallel:result is None 2023-11-28T21:09:05.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T21:09:05.739 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2023-11-28T21:09:05.739 INFO:tasks.ceph.mds.d.smithi031.stdout:starting mds.d at 2023-11-28T21:09:05.746 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-11-28T21:09:05.750 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-11-28T21:09:05.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cfd5aa640 1 Processor -- start 2023-11-28T21:09:05.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cfd5aa640 1 -- start start 2023-11-28T21:09:05.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cfd5aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e370 0x7f7cf80ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:05.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cfd5aa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7cf80cbf40 0x7f7cf815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:05.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cfd5aa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf815b510 con 0x7f7cf815e750 2023-11-28T21:09:05.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cfd5aa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf80cd730 con 0x7f7cf80cbf40 2023-11-28T21:09:05.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cfd5aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf813d450 con 0x7f7cf815e370 2023-11-28T21:09:05.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cf6ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e370 0x7f7cf80ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:05.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cf77fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7cf80cbf40 0x7f7cf815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:05.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cf6ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e370 0x7f7cf80ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43112/0 (socket says 172.21.15.6:43112) 2023-11-28T21:09:05.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cf6ffd640 1 -- 172.21.15.6:0/4046952485 learned_addr learned my addr 172.21.15.6:0/4046952485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:05.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cf77fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7cf80cbf40 0x7f7cf815a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:56220/0 (socket says 172.21.15.6:56220) 2023-11-28T21:09:05.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cf6ffd640 1 -- 172.21.15.6:0/4046952485 >> v2:172.21.15.31:3300/0 conn(0x7f7cf80cbf40 msgr2=0x7f7cf815a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:05.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cf6ffd640 1 --2- 172.21.15.6:0/4046952485 >> v2:172.21.15.31:3300/0 conn(0x7f7cf80cbf40 0x7f7cf815a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:05.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cf6ffd640 1 -- 172.21.15.6:0/4046952485 >> v1:172.21.15.31:6789/0 conn(0x7f7cf815e750 legacy=0x7f7cf80cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:05.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.811+0000 7f7cf6ffd640 1 -- 172.21.15.6:0/4046952485 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80cd940 con 0x7f7cf815e370 2023-11-28T21:09:05.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cf6ffd640 1 --2- 172.21.15.6:0/4046952485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e370 0x7f7cf80ce700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800bb10 tx=0x7f7ce801eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8657f6e458c65f40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:05.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cf67fc640 1 -- 172.21.15.6:0/4046952485 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80a7a40 con 0x7f7cf815e370 2023-11-28T21:09:05.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cf67fc640 1 -- 172.21.15.6:0/4046952485 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce80a7ba0 con 0x7f7cf815e370 2023-11-28T21:09:05.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cf67fc640 1 -- 172.21.15.6:0/4046952485 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80af440 con 0x7f7cf815e370 2023-11-28T21:09:05.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/4046952485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e370 msgr2=0x7f7cf80ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:05.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 --2- 172.21.15.6:0/4046952485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e370 0x7f7cf80ce700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800bb10 tx=0x7f7ce801eb80 comp rx=0 tx=0).stop 2023-11-28T21:09:05.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/4046952485 shutdown_connections 2023-11-28T21:09:05.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 --2- 172.21.15.6:0/4046952485 >> v2:172.21.15.31:3300/0 conn(0x7f7cf80cbf40 0x7f7cf815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:05.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 --2- 172.21.15.6:0/4046952485 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e370 0x7f7cf80ce700 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:05.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/4046952485 >> 172.21.15.6:0/4046952485 conn(0x7f7cf806a980 msgr2=0x7f7cf806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:05.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/4046952485 shutdown_connections 2023-11-28T21:09:05.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/4046952485 wait complete. 2023-11-28T21:09:05.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 Processor -- start 2023-11-28T21:09:05.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.815+0000 7f7cfd5aa640 1 -- start start 2023-11-28T21:09:05.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cfd5aa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf80cbf40 0x7f7cf81378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:05.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cfd5aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf815e370 0x7f7cf814d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:05.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cfd5aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e750 0x7f7cf81f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:05.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cfd5aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf81374b0 con 0x7f7cf815e370 2023-11-28T21:09:05.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cfd5aa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8136e30 con 0x7f7cf80cbf40 2023-11-28T21:09:05.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cfd5aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80ae9a0 con 0x7f7cf815e750 2023-11-28T21:09:05.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7ceffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf815e370 0x7f7cf814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:05.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7ceffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf815e370 0x7f7cf814d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42756/0 (socket says 172.21.15.6:42756) 2023-11-28T21:09:05.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7ceffff640 1 -- 172.21.15.6:0/674297176 learned_addr learned my addr 172.21.15.6:0/674297176 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:05.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cf6ffd640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf80cbf40 0x7f7cf81378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:05.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cf77fe640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e750 0x7f7cf81f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:05.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7ceffff640 1 -- 172.21.15.6:0/674297176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e750 msgr2=0x7f7cf81f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:05.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7ceffff640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e750 0x7f7cf81f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:05.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7ceffff640 1 -- 172.21.15.6:0/674297176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf80cbf40 msgr2=0x7f7cf81378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:05.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7ceffff640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf80cbf40 0x7f7cf81378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:05.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7ceffff640 1 -- 172.21.15.6:0/674297176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce800b770 con 0x7f7cf815e370 2023-11-28T21:09:05.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7ceffff640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf815e370 0x7f7cf814d920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c3c0 tx=0x7f7ce000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:05.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cef7fe640 1 -- 172.21.15.6:0/674297176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00052d0 con 0x7f7cf815e370 2023-11-28T21:09:05.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cef7fe640 1 -- 172.21.15.6:0/674297176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce0005430 con 0x7f7cf815e370 2023-11-28T21:09:05.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cef7fe640 1 -- 172.21.15.6:0/674297176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0003840 con 0x7f7cf815e370 2023-11-28T21:09:05.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf80aec80 con 0x7f7cf815e370 2023-11-28T21:09:05.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf80aef60 con 0x7f7cf815e370 2023-11-28T21:09:05.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.819+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf81375f0 con 0x7f7cf815e370 2023-11-28T21:09:05.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.823+0000 7f7cef7fe640 1 -- 172.21.15.6:0/674297176 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ce00039a0 con 0x7f7cf815e370 2023-11-28T21:09:05.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.823+0000 7f7cef7fe640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7cd8066470 0x7f7cd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:05.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.823+0000 7f7cef7fe640 1 -- 172.21.15.6:0/674297176 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7ce0082fe0 con 0x7f7cf815e370 2023-11-28T21:09:05.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.823+0000 7f7cf6ffd640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7cd8066470 0x7f7cd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:05.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.823+0000 7f7cf6ffd640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7cd8066470 0x7f7cd8068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80b1000 tx=0x7f7ce80a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:05.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.827+0000 7f7cef7fe640 1 -- 172.21.15.6:0/674297176 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7cf81375f0 con 0x7f7cf815e370 2023-11-28T21:09:06.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:05.999+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7cf81375f0 con 0x7f7cf815e370 2023-11-28T21:09:06.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.539+0000 7f7cef7fe640 1 -- 172.21.15.6:0/674297176 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7cf81375f0 con 0x7f7cf815e370 2023-11-28T21:09:06.545 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-11-28T21:09:06.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7cd8066470 msgr2=0x7f7cd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:06.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7cd8066470 0x7f7cd8068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80b1000 tx=0x7f7ce80a9070 comp rx=0 tx=0).stop 2023-11-28T21:09:06.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf815e370 msgr2=0x7f7cf814d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:06.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf815e370 0x7f7cf814d920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c3c0 tx=0x7f7ce000c880 comp rx=0 tx=0).stop 2023-11-28T21:09:06.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 shutdown_connections 2023-11-28T21:09:06.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7cd8066470 0x7f7cd8068930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf815e750 0x7f7cf81f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf815e370 0x7f7cf814d920 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 --2- 172.21.15.6:0/674297176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf80cbf40 0x7f7cf81378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 >> 172.21.15.6:0/674297176 conn(0x7f7cf806a980 msgr2=0x7f7cf8159010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:06.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 shutdown_connections 2023-11-28T21:09:06.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.543+0000 7f7cfd5aa640 1 -- 172.21.15.6:0/674297176 wait complete. 2023-11-28T21:09:06.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T21:09:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5fa8aa640 1 Processor -- start 2023-11-28T21:09:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5fa8aa640 1 -- start start 2023-11-28T21:09:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5fa8aa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe5f4160cd0 0x7fe5f40b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5fa8aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5f40b2550 0x7fe5f40b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5fa8aa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f40aff60 con 0x7fe5f40d1880 2023-11-28T21:09:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5fa8aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f40b0240 con 0x7fe5f40b2550 2023-11-28T21:09:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5fa8aa640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f40b0520 con 0x7fe5f4160cd0 2023-11-28T21:09:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5f8e47640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5f40b2550 0x7fe5f40b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5f8e47640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5f40b2550 0x7fe5f40b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42764/0 (socket says 172.21.15.6:42764) 2023-11-28T21:09:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5f8e47640 1 -- 172.21.15.6:0/126760124 learned_addr learned my addr 172.21.15.6:0/126760124 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5f8e47640 1 -- 172.21.15.6:0/126760124 >> v2:172.21.15.31:3300/0 conn(0x7fe5f4160cd0 msgr2=0x7fe5f40b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5f8e47640 1 --2- 172.21.15.6:0/126760124 >> v2:172.21.15.31:3300/0 conn(0x7fe5f4160cd0 0x7fe5f40b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5f8e47640 1 -- 172.21.15.6:0/126760124 >> v1:172.21.15.31:6789/0 conn(0x7fe5f40d1880 legacy=0x7fe5f41605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.711+0000 7fe5f8e47640 1 -- 172.21.15.6:0/126760124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f40b0800 con 0x7fe5f40b2550 2023-11-28T21:09:06.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5f8e47640 1 --2- 172.21.15.6:0/126760124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f40b2550 0x7fe5f40b1260 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40c6a20 tx=0x7fe5ec01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc0dc46367a2b30 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:06.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5f2ffd640 1 -- 172.21.15.6:0/126760124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0a5760 con 0x7fe5f40b2550 2023-11-28T21:09:06.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5f2ffd640 1 -- 172.21.15.6:0/126760124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec0a58c0 con 0x7fe5f40b2550 2023-11-28T21:09:06.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5f2ffd640 1 -- 172.21.15.6:0/126760124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0a5c50 con 0x7fe5f40b2550 2023-11-28T21:09:06.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/126760124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f40b2550 msgr2=0x7fe5f40b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:06.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5fa8aa640 1 --2- 172.21.15.6:0/126760124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f40b2550 0x7fe5f40b1260 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40c6a20 tx=0x7fe5ec01c990 comp rx=0 tx=0).stop 2023-11-28T21:09:06.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/126760124 shutdown_connections 2023-11-28T21:09:06.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5fa8aa640 1 --2- 172.21.15.6:0/126760124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f40b2550 0x7fe5f40b1260 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5fa8aa640 1 --2- 172.21.15.6:0/126760124 >> v2:172.21.15.31:3300/0 conn(0x7fe5f4160cd0 0x7fe5f40b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/126760124 >> 172.21.15.6:0/126760124 conn(0x7fe5f409c460 msgr2=0x7fe5f40d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:06.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/126760124 shutdown_connections 2023-11-28T21:09:06.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.715+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/126760124 wait complete. 2023-11-28T21:09:06.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 Processor -- start 2023-11-28T21:09:06.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 -- start start 2023-11-28T21:09:06.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f40b2550 0x7fe5f40b8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:06.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5f40d1880 0x7fe5f406b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:06.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f4160cd0 0x7fe5f406bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:06.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40c9b70 con 0x7fe5f4160cd0 2023-11-28T21:09:06.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40c9360 con 0x7fe5f40b2550 2023-11-28T21:09:06.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f41488c0 con 0x7fe5f40d1880 2023-11-28T21:09:06.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f8e47640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f4160cd0 0x7fe5f406bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:06.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f40b2550 0x7fe5f40b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:06.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f8e47640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f4160cd0 0x7fe5f406bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42778/0 (socket says 172.21.15.6:42778) 2023-11-28T21:09:06.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f37fe640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5f40d1880 0x7fe5f406b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:06.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f8e47640 1 -- 172.21.15.6:0/4039203258 learned_addr learned my addr 172.21.15.6:0/4039203258 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f8e47640 1 -- 172.21.15.6:0/4039203258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5f40d1880 msgr2=0x7fe5f406b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f8e47640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5f40d1880 0x7fe5f406b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f8e47640 1 -- 172.21.15.6:0/4039203258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f40b2550 msgr2=0x7fe5f40b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:06.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f8e47640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f40b2550 0x7fe5f40b8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f8e47640 1 -- 172.21.15.6:0/4039203258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec009b30 con 0x7fe5f4160cd0 2023-11-28T21:09:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f8e47640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f4160cd0 0x7fe5f406bb10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec01a5c0 tx=0x7fe5ec019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f0ff9640 1 -- 172.21.15.6:0/4039203258 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0b8670 con 0x7fe5f4160cd0 2023-11-28T21:09:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f0ff9640 1 -- 172.21.15.6:0/4039203258 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec0b87d0 con 0x7fe5f4160cd0 2023-11-28T21:09:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5f0ff9640 1 -- 172.21.15.6:0/4039203258 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0b8b60 con 0x7fe5f4160cd0 2023-11-28T21:09:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f40c95b0 con 0x7fe5f4160cd0 2023-11-28T21:09:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.719+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f40b8170 con 0x7fe5f4160cd0 2023-11-28T21:09:06.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.723+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f40b7fd0 con 0x7fe5f4160cd0 2023-11-28T21:09:06.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.723+0000 7fe5f0ff9640 1 -- 172.21.15.6:0/4039203258 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5ec0b8cc0 con 0x7fe5f4160cd0 2023-11-28T21:09:06.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.723+0000 7fe5f0ff9640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe5e0066470 0x7fe5e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:06.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.723+0000 7fe5f0ff9640 1 -- 172.21.15.6:0/4039203258 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe5ec11f120 con 0x7fe5f4160cd0 2023-11-28T21:09:06.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.723+0000 7fe5f3fff640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe5e0066470 0x7fe5e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:06.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.723+0000 7fe5f3fff640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe5e0066470 0x7fe5e0068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4007fd0 tx=0x7fe5e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:06.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.727+0000 7fe5f0ff9640 1 -- 172.21.15.6:0/4039203258 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5f40b7fd0 con 0x7fe5f4160cd0 2023-11-28T21:09:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.939+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe5f40b7fd0 con 0x7fe5f4160cd0 2023-11-28T21:09:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5f0ff9640 1 -- 172.21.15.6:0/4039203258 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe5f40b7fd0 con 0x7fe5f4160cd0 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB+VmZlVE9MHxAA37WaKjiUn6hcCiQvJbuHmQ==", 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-11-28T21:09:06.948 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB+VmZlPntALBAAMvRKbEON2AIMTwj0rKHL0Q==", 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.949 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB+VmZlQeLQJhAAjXPAqyH6lV7TCKDg//Q22Q==", 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.950 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB+VmZlcnr0MxAA2WZFTgv9mwH+yaasK6aj4A==", 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCCVmZlQs+AExAAU/55f/gJEQVjocRJcL1gew==", 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-11-28T21:09:06.951 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCFVmZlY9gYGxAAr1N6CznypGXM7zMk2EQo0g==", 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.953 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-11-28T21:09:06.953 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCIVmZl/YL1IRAAB/x/QnRfjUWQm42mJCWaRQ==", 2023-11-28T21:09:06.953 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.953 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-11-28T21:09:06.953 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-11-28T21:09:06.953 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.953 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.954 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-11-28T21:09:06.954 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCLVmZlGCIzKRAAB3GIxAXOdgqgPW4WV2DWng==", 2023-11-28T21:09:06.954 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.954 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-11-28T21:09:06.954 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCRVmZlPaLeNRAADLYJtMT2wxwEHw3x89EiZQ==", 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCVVmZlUT7LARAAG9l3wOEPonIJ3pGvqz6MHg==", 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCYVmZluk/XCBAABTTMopQEEIlciyFr26HkGw==", 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.956 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQCbVmZlmjlHEBAAN2hh+IeKkfBZdi1DiYMMoA==", 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.957 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB+VmZlxLImOBAA8izHwHkD3t81GJWncBXtsA==", 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB/VmZl5lXKBhAAYlZu0HRoIk+GZ+usj/2tIw==", 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB/VmZl/Dj8AhAAvgUKWU0j1BpqP7zKR5+4ug==", 2023-11-28T21:09:06.959 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB/VmZlDa7iDBAAyIMTn9IKSNvBxYjWJ2k10g==", 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-11-28T21:09:06.960 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-11-28T21:09:06.961 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-11-28T21:09:06.961 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-11-28T21:09:06.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.961 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-11-28T21:09:06.961 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB+VmZlq5+DAhAAEKmYEYdkGfkA8W6HkmR4GA==", 2023-11-28T21:09:06.961 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQChVmZlY0qcGBAAF+E9hBLemvuLETyDJ3C6cA==", 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQChVmZlBlScGBAA+hn8qXuZJ5bn4wFwMumAXQ==", 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQChVmZlnFycGBAAfEWag25DzKizek72Me8NUw==", 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T21:09:06.963 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQChVmZl3mScGBAAh0d2wjQz7CCZI+5fzm174A==", 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQChVmZlbW2cGBAAOykC0gYp3OFlJrbNb+yvlA==", 2023-11-28T21:09:06.964 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQChVmZlW3acGBAAQU9pO8DvhmURuFc2Ysgnag==", 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.965 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB+VmZlPObsGhAA+BppiDDh3jupibQjHG0csw==", 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQB+VmZlQwDFFhAAP2V9nSWUbZLGbTBQJysFUQ==", 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-11-28T21:09:06.966 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-11-28T21:09:06.967 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-11-28T21:09:06.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:06.968 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-11-28T21:09:06.968 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-28T21:09:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe5e0066470 msgr2=0x7fe5e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe5e0066470 0x7fe5e0068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4007fd0 tx=0x7fe5e4009040 comp rx=0 tx=0).stop 2023-11-28T21:09:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f4160cd0 msgr2=0x7fe5f406bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f4160cd0 0x7fe5f406bb10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec01a5c0 tx=0x7fe5ec019730 comp rx=0 tx=0).stop 2023-11-28T21:09:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 shutdown_connections 2023-11-28T21:09:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe5e0066470 0x7fe5e0068930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5f4160cd0 0x7fe5f406bb10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe5f40d1880 0x7fe5f406b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 --2- 172.21.15.6:0/4039203258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f40b2550 0x7fe5f40b8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 >> 172.21.15.6:0/4039203258 conn(0x7fe5f409c460 msgr2=0x7fe5f406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 shutdown_connections 2023-11-28T21:09:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:06.943+0000 7fe5fa8aa640 1 -- 172.21.15.6:0/4039203258 wait complete. 2023-11-28T21:09:06.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T21:09:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c54817640 1 Processor -- start 2023-11-28T21:09:07.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c54817640 1 -- start start 2023-11-28T21:09:07.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c54817640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c5014b0e0 0x7f6c500b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c54817640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b1e70 0x7f6c5006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c54817640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6c500b22d0 0x7f6c5006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c54817640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5014b4c0 con 0x7f6c5014b0e0 2023-11-28T21:09:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c54817640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c500b3e30 con 0x7f6c500b22d0 2023-11-28T21:09:07.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c54817640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b2850 con 0x7f6c500b1e70 2023-11-28T21:09:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c4e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c5014b0e0 0x7f6c500b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c4e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c5014b0e0 0x7f6c500b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42786/0 (socket says 172.21.15.6:42786) 2023-11-28T21:09:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c4e59c640 1 -- 172.21.15.6:0/1717951623 learned_addr learned my addr 172.21.15.6:0/1717951623 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c4ed9d640 1 --2- 172.21.15.6:0/1717951623 >> v2:172.21.15.31:3300/0 conn(0x7f6c500b22d0 0x7f6c5006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c47fff640 1 --2- 172.21.15.6:0/1717951623 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b1e70 0x7f6c5006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c4e59c640 1 -- 172.21.15.6:0/1717951623 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b1e70 msgr2=0x7f6c5006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:07.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c4e59c640 1 --2- 172.21.15.6:0/1717951623 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b1e70 0x7f6c5006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c4e59c640 1 -- 172.21.15.6:0/1717951623 >> v2:172.21.15.31:3300/0 conn(0x7f6c500b22d0 msgr2=0x7f6c5006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c4e59c640 1 --2- 172.21.15.6:0/1717951623 >> v2:172.21.15.31:3300/0 conn(0x7f6c500b22d0 0x7f6c5006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.111+0000 7f6c4e59c640 1 -- 172.21.15.6:0/1717951623 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500b2b30 con 0x7f6c5014b0e0 2023-11-28T21:09:07.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c4e59c640 1 --2- 172.21.15.6:0/1717951623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 0x7f6c500b38f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6c5006fd60 tx=0x7f6c4001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76610f1362c717cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:07.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c4dd9b640 1 -- 172.21.15.6:0/1717951623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c400aa5f0 con 0x7f6c5014b0e0 2023-11-28T21:09:07.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c4dd9b640 1 -- 172.21.15.6:0/1717951623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c400aa750 con 0x7f6c5014b0e0 2023-11-28T21:09:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c4dd9b640 1 -- 172.21.15.6:0/1717951623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c400aaae0 con 0x7f6c5014b0e0 2023-11-28T21:09:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c54817640 1 -- 172.21.15.6:0/1717951623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 msgr2=0x7f6c500b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c54817640 1 --2- 172.21.15.6:0/1717951623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 0x7f6c500b38f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6c5006fd60 tx=0x7f6c4001c4d0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c54817640 1 -- 172.21.15.6:0/1717951623 shutdown_connections 2023-11-28T21:09:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c54817640 1 --2- 172.21.15.6:0/1717951623 >> v2:172.21.15.31:3300/0 conn(0x7f6c500b22d0 0x7f6c5006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c54817640 1 --2- 172.21.15.6:0/1717951623 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b1e70 0x7f6c5006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c54817640 1 --2- 172.21.15.6:0/1717951623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 0x7f6c500b38f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c54817640 1 -- 172.21.15.6:0/1717951623 >> 172.21.15.6:0/1717951623 conn(0x7f6c5006a980 msgr2=0x7f6c5006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c54817640 1 -- 172.21.15.6:0/1717951623 shutdown_connections 2023-11-28T21:09:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.115+0000 7f6c54817640 1 -- 172.21.15.6:0/1717951623 wait complete. 2023-11-28T21:09:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 Processor -- start 2023-11-28T21:09:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 -- start start 2023-11-28T21:09:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c500b1e70 0x7f6c5013fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b22d0 0x7f6c50160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 0x7f6c5015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c50160c00 con 0x7f6c5014b0e0 2023-11-28T21:09:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c50160e50 con 0x7f6c500b1e70 2023-11-28T21:09:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c50161130 con 0x7f6c500b22d0 2023-11-28T21:09:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 0x7f6c5015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 0x7f6c5015f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42794/0 (socket says 172.21.15.6:42794) 2023-11-28T21:09:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4ed9d640 1 -- 172.21.15.6:0/597677820 learned_addr learned my addr 172.21.15.6:0/597677820 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c47fff640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b22d0 0x7f6c50160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4e59c640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c500b1e70 0x7f6c5013fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4ed9d640 1 -- 172.21.15.6:0/597677820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b22d0 msgr2=0x7f6c50160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4ed9d640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b22d0 0x7f6c50160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4ed9d640 1 -- 172.21.15.6:0/597677820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c500b1e70 msgr2=0x7f6c5013fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4ed9d640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c500b1e70 0x7f6c5013fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4ed9d640 1 -- 172.21.15.6:0/597677820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c400094d0 con 0x7f6c5014b0e0 2023-11-28T21:09:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c4ed9d640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 0x7f6c5015f190 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6c48007e40 tx=0x7f6c4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c46ffd640 1 -- 172.21.15.6:0/597677820 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48014620 con 0x7f6c5014b0e0 2023-11-28T21:09:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c46ffd640 1 -- 172.21.15.6:0/597677820 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800ee90 con 0x7f6c5014b0e0 2023-11-28T21:09:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c50161410 con 0x7f6c5014b0e0 2023-11-28T21:09:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c46ffd640 1 -- 172.21.15.6:0/597677820 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480149e0 con 0x7f6c5014b0e0 2023-11-28T21:09:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.119+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c501619d0 con 0x7f6c5014b0e0 2023-11-28T21:09:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.123+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c50072b90 con 0x7f6c5014b0e0 2023-11-28T21:09:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.123+0000 7f6c46ffd640 1 -- 172.21.15.6:0/597677820 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c48014b40 con 0x7f6c5014b0e0 2023-11-28T21:09:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.123+0000 7f6c46ffd640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6c30066470 0x7f6c30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.123+0000 7f6c46ffd640 1 -- 172.21.15.6:0/597677820 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6c480844a0 con 0x7f6c5014b0e0 2023-11-28T21:09:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.123+0000 7f6c4e59c640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6c30066470 0x7f6c30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.123+0000 7f6c4e59c640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6c30066470 0x7f6c30068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c400ae000 tx=0x7f6c400b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:07.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.127+0000 7f6c46ffd640 1 -- 172.21.15.6:0/597677820 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c48051bf0 con 0x7f6c5014b0e0 2023-11-28T21:09:07.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.343+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f6c5004e930 con 0x7f6c5014b0e0 2023-11-28T21:09:07.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.343+0000 7f6c46ffd640 1 -- 172.21.15.6:0/597677820 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6c48055210 con 0x7f6c5014b0e0 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6c30066470 msgr2=0x7f6c30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6c30066470 0x7f6c30068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c400ae000 tx=0x7f6c400b5040 comp rx=0 tx=0).stop 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 msgr2=0x7f6c5015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 0x7f6c5015f190 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6c48007e40 tx=0x7f6c4800e4b0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 shutdown_connections 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6c30066470 0x7f6c30068930 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5014b0e0 0x7f6c5015f190 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6c500b22d0 0x7f6c50160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 --2- 172.21.15.6:0/597677820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c500b1e70 0x7f6c5013fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 >> 172.21.15.6:0/597677820 conn(0x7f6c5006a980 msgr2=0x7f6c50162160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 shutdown_connections 2023-11-28T21:09:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.347+0000 7f6c54817640 1 -- 172.21.15.6:0/597677820 wait complete. 2023-11-28T21:09:07.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T21:09:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.511+0000 7fca3d92a640 1 Processor -- start 2023-11-28T21:09:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.511+0000 7fca3d92a640 1 -- start start 2023-11-28T21:09:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.511+0000 7fca3d92a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca3815d340 0x7fca380ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.511+0000 7fca3d92a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca380b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.511+0000 7fca3d92a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca380cf0d0 con 0x7fca3815d720 2023-11-28T21:09:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.511+0000 7fca3d92a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca380b6a60 con 0x7fca3815d340 2023-11-28T21:09:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.511+0000 7fca3d92a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380b60c0 con 0x7fca380d1e30 2023-11-28T21:09:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca377fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca380b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca36ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca3815d340 0x7fca380ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca377fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca380b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43154/0 (socket says 172.21.15.6:43154) 2023-11-28T21:09:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca377fe640 1 -- 172.21.15.6:0/3390362194 learned_addr learned my addr 172.21.15.6:0/3390362194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca377fe640 1 -- 172.21.15.6:0/3390362194 >> v2:172.21.15.31:3300/0 conn(0x7fca3815d340 msgr2=0x7fca380ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca377fe640 1 --2- 172.21.15.6:0/3390362194 >> v2:172.21.15.31:3300/0 conn(0x7fca3815d340 0x7fca380ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca377fe640 1 -- 172.21.15.6:0/3390362194 >> v1:172.21.15.31:6789/0 conn(0x7fca3815d720 legacy=0x7fca380d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca377fe640 1 -- 172.21.15.6:0/3390362194 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380b63a0 con 0x7fca380d1e30 2023-11-28T21:09:07.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca377fe640 1 --2- 172.21.15.6:0/3390362194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca380b3db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca30009e50 tx=0x7fca3001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=315f8dd62b3437cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca367fc640 1 -- 172.21.15.6:0/3390362194 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300a5830 con 0x7fca380d1e30 2023-11-28T21:09:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca367fc640 1 -- 172.21.15.6:0/3390362194 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca300a5990 con 0x7fca380d1e30 2023-11-28T21:09:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.515+0000 7fca367fc640 1 -- 172.21.15.6:0/3390362194 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300a5d20 con 0x7fca380d1e30 2023-11-28T21:09:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 -- 172.21.15.6:0/3390362194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 msgr2=0x7fca380b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 --2- 172.21.15.6:0/3390362194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca380b3db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca30009e50 tx=0x7fca3001c950 comp rx=0 tx=0).stop 2023-11-28T21:09:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 -- 172.21.15.6:0/3390362194 shutdown_connections 2023-11-28T21:09:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 --2- 172.21.15.6:0/3390362194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca380b3db0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 --2- 172.21.15.6:0/3390362194 >> v2:172.21.15.31:3300/0 conn(0x7fca3815d340 0x7fca380ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 -- 172.21.15.6:0/3390362194 >> 172.21.15.6:0/3390362194 conn(0x7fca3809c480 msgr2=0x7fca380d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 -- 172.21.15.6:0/3390362194 shutdown_connections 2023-11-28T21:09:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 -- 172.21.15.6:0/3390362194 wait complete. 2023-11-28T21:09:07.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 Processor -- start 2023-11-28T21:09:07.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 -- start start 2023-11-28T21:09:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca381506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca3815d340 0x7fca38160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3815d720 0x7fca38150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38150be0 con 0x7fca3815d340 2023-11-28T21:09:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca380c7a00 con 0x7fca3815d720 2023-11-28T21:09:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca3d92a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380c6df0 con 0x7fca380d1e30 2023-11-28T21:09:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca2ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca3815d340 0x7fca38160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca2ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca3815d340 0x7fca38160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42804/0 (socket says 172.21.15.6:42804) 2023-11-28T21:09:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca2ffff640 1 -- 172.21.15.6:0/4006226518 learned_addr learned my addr 172.21.15.6:0/4006226518 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca36ffd640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca381506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.519+0000 7fca377fe640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3815d720 0x7fca38150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca2ffff640 1 -- 172.21.15.6:0/4006226518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 msgr2=0x7fca381506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca2ffff640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca381506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca2ffff640 1 -- 172.21.15.6:0/4006226518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3815d720 msgr2=0x7fca38150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca2ffff640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3815d720 0x7fca38150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca2ffff640 1 -- 172.21.15.6:0/4006226518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30009b30 con 0x7fca3815d340 2023-11-28T21:09:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca2ffff640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca3815d340 0x7fca38160330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca2000c3a0 tx=0x7fca2000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca34ff9640 1 -- 172.21.15.6:0/4006226518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200052d0 con 0x7fca3815d340 2023-11-28T21:09:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca34ff9640 1 -- 172.21.15.6:0/4006226518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca20005450 con 0x7fca3815d340 2023-11-28T21:09:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca380c70d0 con 0x7fca3815d340 2023-11-28T21:09:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca34ff9640 1 -- 172.21.15.6:0/4006226518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20003860 con 0x7fca3815d340 2023-11-28T21:09:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca380c7690 con 0x7fca3815d340 2023-11-28T21:09:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca380c7bb0 con 0x7fca3815d340 2023-11-28T21:09:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca34ff9640 1 -- 172.21.15.6:0/4006226518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca200039c0 con 0x7fca3815d340 2023-11-28T21:09:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.523+0000 7fca34ff9640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fca180664a0 0x7fca18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.527+0000 7fca34ff9640 1 -- 172.21.15.6:0/4006226518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca20082fe0 con 0x7fca3815d340 2023-11-28T21:09:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.527+0000 7fca36ffd640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fca180664a0 0x7fca18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.527+0000 7fca36ffd640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fca180664a0 0x7fca18068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca28009b60 tx=0x7fca28009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.527+0000 7fca34ff9640 1 -- 172.21.15.6:0/4006226518 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca380c7bb0 con 0x7fca3815d340 2023-11-28T21:09:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.743+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fca380b40c0 con 0x7fca3815d340 2023-11-28T21:09:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca34ff9640 1 -- 172.21.15.6:0/4006226518 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fca20050810 con 0x7fca3815d340 2023-11-28T21:09:07.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fca180664a0 msgr2=0x7fca18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fca180664a0 0x7fca18068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca28009b60 tx=0x7fca28009190 comp rx=0 tx=0).stop 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca3815d340 msgr2=0x7fca38160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca3815d340 0x7fca38160330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca2000c3a0 tx=0x7fca2000c860 comp rx=0 tx=0).stop 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 shutdown_connections 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fca180664a0 0x7fca18068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3815d720 0x7fca38150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca3815d340 0x7fca38160330 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 --2- 172.21.15.6:0/4006226518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca380d1e30 0x7fca381506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 >> 172.21.15.6:0/4006226518 conn(0x7fca3809c480 msgr2=0x7fca380d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 shutdown_connections 2023-11-28T21:09:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.747+0000 7fca3d92a640 1 -- 172.21.15.6:0/4006226518 wait complete. 2023-11-28T21:09:07.773 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T21:09:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce84f2a640 1 Processor -- start 2023-11-28T21:09:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce84f2a640 1 -- start start 2023-11-28T21:09:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce84f2a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce80143970 0x7fce8006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce84f2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce8015e1a0 0x7fce8006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce84f2a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce800b30b0 con 0x7fce800b4110 2023-11-28T21:09:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce84f2a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8015e7e0 con 0x7fce80143970 2023-11-28T21:09:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce84f2a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce800b3350 con 0x7fce8015e1a0 2023-11-28T21:09:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce7e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce80143970 0x7fce8006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce7e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce80143970 0x7fce8006c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42818/0 (socket says 172.21.15.6:42818) 2023-11-28T21:09:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.911+0000 7fce7e59c640 1 -- 172.21.15.6:0/50727587 learned_addr learned my addr 172.21.15.6:0/50727587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7ed9d640 1 --2- 172.21.15.6:0/50727587 >> v2:172.21.15.31:3300/0 conn(0x7fce8015e1a0 0x7fce8006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7e59c640 1 -- 172.21.15.6:0/50727587 >> v2:172.21.15.31:3300/0 conn(0x7fce8015e1a0 msgr2=0x7fce8006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7e59c640 1 --2- 172.21.15.6:0/50727587 >> v2:172.21.15.31:3300/0 conn(0x7fce8015e1a0 0x7fce8006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7e59c640 1 -- 172.21.15.6:0/50727587 >> v1:172.21.15.31:6789/0 conn(0x7fce800b4110 legacy=0x7fce8015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7e59c640 1 -- 172.21.15.6:0/50727587 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800b3630 con 0x7fce80143970 2023-11-28T21:09:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7ed9d640 1 --2- 172.21.15.6:0/50727587 >> v2:172.21.15.31:3300/0 conn(0x7fce8015e1a0 0x7fce8006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7e59c640 1 --2- 172.21.15.6:0/50727587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce80143970 0x7fce8006c950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fce800b2630 tx=0x7fce7001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9357398eb9ad3304 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7dd9b640 1 -- 172.21.15.6:0/50727587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700ab600 con 0x7fce80143970 2023-11-28T21:09:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7dd9b640 1 -- 172.21.15.6:0/50727587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce700a7050 con 0x7fce80143970 2023-11-28T21:09:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce7dd9b640 1 -- 172.21.15.6:0/50727587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700ab980 con 0x7fce80143970 2023-11-28T21:09:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce84f2a640 1 -- 172.21.15.6:0/50727587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce80143970 msgr2=0x7fce8006c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.915+0000 7fce84f2a640 1 --2- 172.21.15.6:0/50727587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce80143970 0x7fce8006c950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fce800b2630 tx=0x7fce7001c430 comp rx=0 tx=0).stop 2023-11-28T21:09:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 -- 172.21.15.6:0/50727587 shutdown_connections 2023-11-28T21:09:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 --2- 172.21.15.6:0/50727587 >> v2:172.21.15.31:3300/0 conn(0x7fce8015e1a0 0x7fce8006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 --2- 172.21.15.6:0/50727587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce80143970 0x7fce8006c950 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 -- 172.21.15.6:0/50727587 >> 172.21.15.6:0/50727587 conn(0x7fce8006a980 msgr2=0x7fce8006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 -- 172.21.15.6:0/50727587 shutdown_connections 2023-11-28T21:09:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 -- 172.21.15.6:0/50727587 wait complete. 2023-11-28T21:09:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 Processor -- start 2023-11-28T21:09:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 -- start start 2023-11-28T21:09:07.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce800b4110 0x7fce8013a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce80143970 0x7fce80145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce8015e1a0 0x7fce8015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800cc180 con 0x7fce800b4110 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce801460c0 con 0x7fce8015e1a0 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce84f2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce800cb850 con 0x7fce80143970 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce800b4110 0x7fce8013a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce800b4110 0x7fce8013a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42822/0 (socket says 172.21.15.6:42822) 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7e59c640 1 -- 172.21.15.6:0/2021394078 learned_addr learned my addr 172.21.15.6:0/2021394078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7ed9d640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce8015e1a0 0x7fce8015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce77fff640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce80143970 0x7fce80145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7e59c640 1 -- 172.21.15.6:0/2021394078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce80143970 msgr2=0x7fce80145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7e59c640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce80143970 0x7fce80145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7e59c640 1 -- 172.21.15.6:0/2021394078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce8015e1a0 msgr2=0x7fce8015b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7e59c640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce8015e1a0 0x7fce8015b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7e59c640 1 -- 172.21.15.6:0/2021394078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce700094d0 con 0x7fce800b4110 2023-11-28T21:09:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce77fff640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce80143970 0x7fce80145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.919+0000 7fce7e59c640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce800b4110 0x7fce8013a7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fce700ae040 tx=0x7fce7001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce76ffd640 1 -- 172.21.15.6:0/2021394078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700bc070 con 0x7fce800b4110 2023-11-28T21:09:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce76ffd640 1 -- 172.21.15.6:0/2021394078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce700b6420 con 0x7fce800b4110 2023-11-28T21:09:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce800cbb30 con 0x7fce800b4110 2023-11-28T21:09:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce76ffd640 1 -- 172.21.15.6:0/2021394078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce700b67f0 con 0x7fce800b4110 2023-11-28T21:09:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8013ad20 con 0x7fce800b4110 2023-11-28T21:09:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce80072b90 con 0x7fce800b4110 2023-11-28T21:09:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce76ffd640 1 -- 172.21.15.6:0/2021394078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce700b2040 con 0x7fce800b4110 2023-11-28T21:09:07.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce76ffd640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fce600664a0 0x7fce60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:07.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce76ffd640 1 -- 172.21.15.6:0/2021394078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce7011d4e0 con 0x7fce800b4110 2023-11-28T21:09:07.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.923+0000 7fce77fff640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fce600664a0 0x7fce60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:07.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.927+0000 7fce77fff640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fce600664a0 0x7fce60068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fce8015ea40 tx=0x7fce68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:07.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:07.927+0000 7fce76ffd640 1 -- 172.21.15.6:0/2021394078 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce700eaca0 con 0x7fce800b4110 2023-11-28T21:09:08.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:08.116 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:08.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.143+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fce8004e930 con 0x7fce800b4110 2023-11-28T21:09:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce76ffd640 1 -- 172.21.15.6:0/2021394078 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fce700ee2c0 con 0x7fce800b4110 2023-11-28T21:09:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fce600664a0 msgr2=0x7fce60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fce600664a0 0x7fce60068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fce8015ea40 tx=0x7fce68009040 comp rx=0 tx=0).stop 2023-11-28T21:09:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce800b4110 msgr2=0x7fce8013a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce800b4110 0x7fce8013a7e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fce700ae040 tx=0x7fce7001ac70 comp rx=0 tx=0).stop 2023-11-28T21:09:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 shutdown_connections 2023-11-28T21:09:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fce600664a0 0x7fce60068960 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce8015e1a0 0x7fce8015b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fce80143970 0x7fce80145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 --2- 172.21.15.6:0/2021394078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce800b4110 0x7fce8013a7e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 >> 172.21.15.6:0/2021394078 conn(0x7fce8006a980 msgr2=0x7fce801600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 shutdown_connections 2023-11-28T21:09:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.147+0000 7fce84f2a640 1 -- 172.21.15.6:0/2021394078 wait complete. 2023-11-28T21:09:08.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T21:09:08.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.355+0000 7f525bb2a640 1 Processor -- start 2023-11-28T21:09:08.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.355+0000 7f525bb2a640 1 -- start start 2023-11-28T21:09:08.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.355+0000 7f525bb2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f525406ca00 0x7f52540cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.355+0000 7f525bb2a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52540cc930 con 0x7f525415c440 2023-11-28T21:09:08.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.355+0000 7f525bb2a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52540ccb60 con 0x7f525406cde0 2023-11-28T21:09:08.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.355+0000 7f525bb2a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52540cd400 con 0x7f525406ca00 2023-11-28T21:09:08.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.355+0000 7f525a0c7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f525415c440 0x7f525415ce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37136/0 (socket says 172.21.15.6:37136) 2023-11-28T21:09:08.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f525a0c7640 1 -- 172.21.15.6:0/3622622060 learned_addr learned my addr 172.21.15.6:0/3622622060 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:08.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52598c6640 1 --2- 172.21.15.6:0/3622622060 >> v2:172.21.15.31:3300/0 conn(0x7f525406ca00 0x7f52540cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52588c4640 1 -- 172.21.15.6:0/3622622060 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141461115 0 0) 0x7f52540cc930 con 0x7f525415c440 2023-11-28T21:09:08.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52588c4640 1 -- 172.21.15.6:0/3622622060 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5240003530 con 0x7f525415c440 2023-11-28T21:09:08.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52598c6640 1 -- 172.21.15.6:0/3622622060 >> v1:172.21.15.31:6789/0 conn(0x7f525406cde0 legacy=0x7f525415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52598c6640 1 -- 172.21.15.6:0/3622622060 >> v1:172.21.15.6:6789/0 conn(0x7f525415c440 legacy=0x7f525415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52598c6640 1 -- 172.21.15.6:0/3622622060 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52540cce40 con 0x7f525406ca00 2023-11-28T21:09:08.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52598c6640 1 --2- 172.21.15.6:0/3622622060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406ca00 0x7f52540cc3f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52500097f0 tx=0x7f525001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee8be29e896a6424 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:08.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52588c4640 1 -- 172.21.15.6:0/3622622060 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52500ac620 con 0x7f525406ca00 2023-11-28T21:09:08.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52588c4640 1 -- 172.21.15.6:0/3622622060 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52500ac780 con 0x7f525406ca00 2023-11-28T21:09:08.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.359+0000 7f52588c4640 1 -- 172.21.15.6:0/3622622060 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52500acb10 con 0x7f525406ca00 2023-11-28T21:09:08.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 -- 172.21.15.6:0/3622622060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406ca00 msgr2=0x7f52540cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 --2- 172.21.15.6:0/3622622060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406ca00 0x7f52540cc3f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52500097f0 tx=0x7f525001c3c0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 -- 172.21.15.6:0/3622622060 shutdown_connections 2023-11-28T21:09:08.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 --2- 172.21.15.6:0/3622622060 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406ca00 0x7f52540cc3f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 -- 172.21.15.6:0/3622622060 >> 172.21.15.6:0/3622622060 conn(0x7f525406a980 msgr2=0x7f525406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:08.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 -- 172.21.15.6:0/3622622060 shutdown_connections 2023-11-28T21:09:08.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 -- 172.21.15.6:0/3622622060 wait complete. 2023-11-28T21:09:08.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 Processor -- start 2023-11-28T21:09:08.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 -- start start 2023-11-28T21:09:08.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f525406ca00 0x7f5254149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f525406cde0 0x7f52540adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525415c440 0x7f52541490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52540b3b10 con 0x7f525406cde0 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52540ae2e0 con 0x7f525415c440 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525bb2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525414f5f0 con 0x7f525406ca00 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52590c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f525406cde0 0x7f52540adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52590c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f525406cde0 0x7f52540adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49696/0 (socket says 172.21.15.6:49696) 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52590c5640 1 -- 172.21.15.6:0/3897068004 learned_addr learned my addr 172.21.15.6:0/3897068004 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525a0c7640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525415c440 0x7f52541490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52598c6640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f525406ca00 0x7f5254149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52590c5640 1 -- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f525406ca00 msgr2=0x7f5254149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52590c5640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f525406ca00 0x7f5254149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52590c5640 1 -- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525415c440 msgr2=0x7f52541490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52590c5640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525415c440 0x7f52541490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52590c5640 1 -- 172.21.15.6:0/3897068004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250009420 con 0x7f525406cde0 2023-11-28T21:09:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f525a0c7640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525415c440 0x7f52541490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.363+0000 7f52598c6640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f525406ca00 0x7f5254149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f52590c5640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f525406cde0 0x7f52540adda0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f524400c500 tx=0x7f524400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f524a7fc640 1 -- 172.21.15.6:0/3897068004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5244005220 con 0x7f525406cde0 2023-11-28T21:09:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f524a7fc640 1 -- 172.21.15.6:0/3897068004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5244005380 con 0x7f525406cde0 2023-11-28T21:09:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f524a7fc640 1 -- 172.21.15.6:0/3897068004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5244007270 con 0x7f525406cde0 2023-11-28T21:09:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525414f8d0 con 0x7f525406cde0 2023-11-28T21:09:08.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525414fe90 con 0x7f525406cde0 2023-11-28T21:09:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5254072b90 con 0x7f525406cde0 2023-11-28T21:09:08.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f524a7fc640 1 -- 172.21.15.6:0/3897068004 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52440073d0 con 0x7f525406cde0 2023-11-28T21:09:08.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f524a7fc640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52380664a0 0x7f5238068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f524a7fc640 1 -- 172.21.15.6:0/3897068004 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f52440834f0 con 0x7f525406cde0 2023-11-28T21:09:08.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.367+0000 7f52598c6640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52380664a0 0x7f5238068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.371+0000 7f52598c6640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52380664a0 0x7f5238068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f52500ae000 tx=0x7f5250008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:08.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.371+0000 7f524a7fc640 1 -- 172.21.15.6:0/3897068004 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5244050c30 con 0x7f525406cde0 2023-11-28T21:09:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.587+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f525415d330 con 0x7f525406cde0 2023-11-28T21:09:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.591+0000 7f524a7fc640 1 -- 172.21.15.6:0/3897068004 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5244054250 con 0x7f525406cde0 2023-11-28T21:09:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52380664a0 msgr2=0x7f5238068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52380664a0 0x7f5238068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f52500ae000 tx=0x7f5250008040 comp rx=0 tx=0).stop 2023-11-28T21:09:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f525406cde0 msgr2=0x7f52540adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f525406cde0 0x7f52540adda0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f524400c500 tx=0x7f524400c9c0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 shutdown_connections 2023-11-28T21:09:08.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f52380664a0 0x7f5238068960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525415c440 0x7f52541490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f525406cde0 0x7f52540adda0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 --2- 172.21.15.6:0/3897068004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f525406ca00 0x7f5254149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 >> 172.21.15.6:0/3897068004 conn(0x7f525406a980 msgr2=0x7f52540ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:08.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 shutdown_connections 2023-11-28T21:09:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.595+0000 7f525bb2a640 1 -- 172.21.15.6:0/3897068004 wait complete. 2023-11-28T21:09:08.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T21:09:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54aa99d640 1 Processor -- start 2023-11-28T21:09:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54aa99d640 1 -- start start 2023-11-28T21:09:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54aa99d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54a406ca00 0x7f54a40cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54aa99d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 0x7f54a415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54aa99d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a40cc930 con 0x7f54a406cde0 2023-11-28T21:09:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54aa99d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a40cd400 con 0x7f54a406ca00 2023-11-28T21:09:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54aa99d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40ccb60 con 0x7f54a415c440 2023-11-28T21:09:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54a3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54a406ca00 0x7f54a40cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54a8f3a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 0x7f54a415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54a3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54a406ca00 0x7f54a40cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:52626/0 (socket says 172.21.15.6:52626) 2023-11-28T21:09:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54a3fff640 1 -- 172.21.15.6:0/3804629181 learned_addr learned my addr 172.21.15.6:0/3804629181 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54a3fff640 1 -- 172.21.15.6:0/3804629181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 msgr2=0x7f54a415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54a3fff640 1 --2- 172.21.15.6:0/3804629181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 0x7f54a415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54a3fff640 1 -- 172.21.15.6:0/3804629181 >> v1:172.21.15.31:6789/0 conn(0x7f54a406cde0 legacy=0x7f54a415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.759+0000 7f54a3fff640 1 -- 172.21.15.6:0/3804629181 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a40cce40 con 0x7f54a406ca00 2023-11-28T21:09:08.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54a3fff640 1 --2- 172.21.15.6:0/3804629181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a406ca00 0x7f54a40cc3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f54940098a0 tx=0x7f549401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e88011c9be23015e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54a2ffd640 1 -- 172.21.15.6:0/3804629181 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54940ab660 con 0x7f54a406ca00 2023-11-28T21:09:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54a2ffd640 1 -- 172.21.15.6:0/3804629181 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54940ab7c0 con 0x7f54a406ca00 2023-11-28T21:09:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54a2ffd640 1 -- 172.21.15.6:0/3804629181 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54940abb50 con 0x7f54a406ca00 2023-11-28T21:09:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54aa99d640 1 -- 172.21.15.6:0/3804629181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a406ca00 msgr2=0x7f54a40cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54aa99d640 1 --2- 172.21.15.6:0/3804629181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a406ca00 0x7f54a40cc3f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f54940098a0 tx=0x7f549401c460 comp rx=0 tx=0).stop 2023-11-28T21:09:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54aa99d640 1 -- 172.21.15.6:0/3804629181 shutdown_connections 2023-11-28T21:09:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54aa99d640 1 --2- 172.21.15.6:0/3804629181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 0x7f54a415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54aa99d640 1 --2- 172.21.15.6:0/3804629181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a406ca00 0x7f54a40cc3f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54aa99d640 1 -- 172.21.15.6:0/3804629181 >> 172.21.15.6:0/3804629181 conn(0x7f54a406a980 msgr2=0x7f54a406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54aa99d640 1 -- 172.21.15.6:0/3804629181 shutdown_connections 2023-11-28T21:09:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.763+0000 7f54aa99d640 1 -- 172.21.15.6:0/3804629181 wait complete. 2023-11-28T21:09:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 Processor -- start 2023-11-28T21:09:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 -- start start 2023-11-28T21:09:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a406ca00 0x7f54a414db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a406cde0 0x7f54a4071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 0x7f54a414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4157a50 con 0x7f54a406cde0 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4156ba0 con 0x7f54a406ca00 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a414e090 con 0x7f54a415c440 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a406cde0 0x7f54a4071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a406cde0 0x7f54a4071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49710/0 (socket says 172.21.15.6:49710) 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a37fe640 1 -- 172.21.15.6:0/1831574073 learned_addr learned my addr 172.21.15.6:0/1831574073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a3fff640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a406ca00 0x7f54a414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a8f3a640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 0x7f54a414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a37fe640 1 -- 172.21.15.6:0/1831574073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 msgr2=0x7f54a414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a37fe640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 0x7f54a414ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a37fe640 1 -- 172.21.15.6:0/1831574073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a406ca00 msgr2=0x7f54a414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a37fe640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a406ca00 0x7f54a414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a37fe640 1 -- 172.21.15.6:0/1831574073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54940094d0 con 0x7f54a406cde0 2023-11-28T21:09:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a8f3a640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 0x7f54a414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a37fe640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a406cde0 0x7f54a4071bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f549800c500 tx=0x7f549800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a0ff9640 1 -- 172.21.15.6:0/1831574073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498005220 con 0x7f54a406cde0 2023-11-28T21:09:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a4153d30 con 0x7f54a406cde0 2023-11-28T21:09:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a0ff9640 1 -- 172.21.15.6:0/1831574073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5498005380 con 0x7f54a406cde0 2023-11-28T21:09:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54a0ff9640 1 -- 172.21.15.6:0/1831574073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498007270 con 0x7f54a406cde0 2023-11-28T21:09:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.767+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a4157120 con 0x7f54a406cde0 2023-11-28T21:09:08.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.771+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a4157c00 con 0x7f54a406cde0 2023-11-28T21:09:08.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.771+0000 7f54a0ff9640 1 -- 172.21.15.6:0/1831574073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f54980073d0 con 0x7f54a406cde0 2023-11-28T21:09:08.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.771+0000 7f54a0ff9640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5490066470 0x7f5490068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:08.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.771+0000 7f54a0ff9640 1 -- 172.21.15.6:0/1831574073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f54980834a0 con 0x7f54a406cde0 2023-11-28T21:09:08.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.771+0000 7f54a3fff640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5490066470 0x7f5490068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:08.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.771+0000 7f54a3fff640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5490066470 0x7f5490068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54940af000 tx=0x7f54940a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.775+0000 7f54a0ff9640 1 -- 172.21.15.6:0/1831574073 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5498050be0 con 0x7f54a406cde0 2023-11-28T21:09:08.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.987+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f54a4072b90 con 0x7f54a406cde0 2023-11-28T21:09:08.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54a0ff9640 1 -- 172.21.15.6:0/1831574073 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5498054200 con 0x7f54a406cde0 2023-11-28T21:09:08.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5490066470 msgr2=0x7f5490068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5490066470 0x7f5490068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54940af000 tx=0x7f54940a7000 comp rx=0 tx=0).stop 2023-11-28T21:09:08.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a406cde0 msgr2=0x7f54a4071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:08.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a406cde0 0x7f54a4071bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f549800c500 tx=0x7f549800c9c0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 shutdown_connections 2023-11-28T21:09:08.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5490066470 0x7f5490068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54a415c440 0x7f54a414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a406cde0 0x7f54a4071bf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 --2- 172.21.15.6:0/1831574073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a406ca00 0x7f54a414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:08.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 >> 172.21.15.6:0/1831574073 conn(0x7f54a406a980 msgr2=0x7f54a406ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:08.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 shutdown_connections 2023-11-28T21:09:08.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:08.991+0000 7f54aa99d640 1 -- 172.21.15.6:0/1831574073 wait complete. 2023-11-28T21:09:09.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T21:09:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f260ba32640 1 Processor -- start 2023-11-28T21:09:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f260ba32640 1 -- start start 2023-11-28T21:09:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f260ba32640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26040cbf40 0x7f26040ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f260ba32640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f260415e750 0x7f260415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f260ba32640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260415b510 con 0x7f260415e370 2023-11-28T21:09:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f260ba32640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26040cd730 con 0x7f26040cbf40 2023-11-28T21:09:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f260ba32640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260413d450 con 0x7f260415e750 2023-11-28T21:09:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f2608fcd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26040cbf40 0x7f26040ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f2608fcd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f26040cbf40 0x7f26040ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49712/0 (socket says 172.21.15.6:49712) 2023-11-28T21:09:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f2608fcd640 1 -- 172.21.15.6:0/2517306724 learned_addr learned my addr 172.21.15.6:0/2517306724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.155+0000 7f2609fcf640 1 --2- 172.21.15.6:0/2517306724 >> v2:172.21.15.31:3300/0 conn(0x7f260415e750 0x7f260415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f2608fcd640 1 -- 172.21.15.6:0/2517306724 >> v2:172.21.15.31:3300/0 conn(0x7f260415e750 msgr2=0x7f260415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f2608fcd640 1 --2- 172.21.15.6:0/2517306724 >> v2:172.21.15.31:3300/0 conn(0x7f260415e750 0x7f260415a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f2608fcd640 1 -- 172.21.15.6:0/2517306724 >> v1:172.21.15.31:6789/0 conn(0x7f260415e370 legacy=0x7f26040cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f2608fcd640 1 -- 172.21.15.6:0/2517306724 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26040cd940 con 0x7f26040cbf40 2023-11-28T21:09:09.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f2608fcd640 1 --2- 172.21.15.6:0/2517306724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 0x7f26040ce700 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f26040cc410 tx=0x7f25f401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a715275a231dee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f25fbfff640 1 -- 172.21.15.6:0/2517306724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f40ab5f0 con 0x7f26040cbf40 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f25fbfff640 1 -- 172.21.15.6:0/2517306724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f40ab750 con 0x7f26040cbf40 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f25fbfff640 1 -- 172.21.15.6:0/2517306724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f40abae0 con 0x7f26040cbf40 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f260ba32640 1 -- 172.21.15.6:0/2517306724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 msgr2=0x7f26040ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.159+0000 7f260ba32640 1 --2- 172.21.15.6:0/2517306724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 0x7f26040ce700 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f26040cc410 tx=0x7f25f401c500 comp rx=0 tx=0).stop 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 -- 172.21.15.6:0/2517306724 shutdown_connections 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 --2- 172.21.15.6:0/2517306724 >> v2:172.21.15.31:3300/0 conn(0x7f260415e750 0x7f260415a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 --2- 172.21.15.6:0/2517306724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 0x7f26040ce700 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 -- 172.21.15.6:0/2517306724 >> 172.21.15.6:0/2517306724 conn(0x7f260406a980 msgr2=0x7f260406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 -- 172.21.15.6:0/2517306724 shutdown_connections 2023-11-28T21:09:09.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 -- 172.21.15.6:0/2517306724 wait complete. 2023-11-28T21:09:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 Processor -- start 2023-11-28T21:09:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 -- start start 2023-11-28T21:09:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 0x7f26040a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f260415e370 0x7f26041653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f260415e750 0x7f26041f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26040a9260 con 0x7f26040cbf40 2023-11-28T21:09:09.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260413f920 con 0x7f260415e370 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f260ba32640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26041f7b30 con 0x7f260415e750 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f26097ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 0x7f26040a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f26097ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 0x7f26040a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49720/0 (socket says 172.21.15.6:49720) 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f26097ce640 1 -- 172.21.15.6:0/3448464927 learned_addr learned my addr 172.21.15.6:0/3448464927 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f2608fcd640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f260415e370 0x7f26041653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f2609fcf640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f260415e750 0x7f26041f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f26097ce640 1 -- 172.21.15.6:0/3448464927 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f260415e750 msgr2=0x7f26041f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f26097ce640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f260415e750 0x7f26041f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f26097ce640 1 -- 172.21.15.6:0/3448464927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f260415e370 msgr2=0x7f26041653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f26097ce640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f260415e370 0x7f26041653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f26097ce640 1 -- 172.21.15.6:0/3448464927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40094d0 con 0x7f26040cbf40 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f2609fcf640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f260415e750 0x7f26041f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:09.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f26097ce640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 0x7f26040a8d20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f260000c500 tx=0x7f260000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:09.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.163+0000 7f25f9ffb640 1 -- 172.21.15.6:0/3448464927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600005220 con 0x7f26040cbf40 2023-11-28T21:09:09.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f25f9ffb640 1 -- 172.21.15.6:0/3448464927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2600005380 con 0x7f26040cbf40 2023-11-28T21:09:09.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f25f9ffb640 1 -- 172.21.15.6:0/3448464927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600007270 con 0x7f26040cbf40 2023-11-28T21:09:09.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26041f7e10 con 0x7f26040cbf40 2023-11-28T21:09:09.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26041f83d0 con 0x7f26040cbf40 2023-11-28T21:09:09.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2604072b90 con 0x7f26040cbf40 2023-11-28T21:09:09.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f25f9ffb640 1 -- 172.21.15.6:0/3448464927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26000073d0 con 0x7f26040cbf40 2023-11-28T21:09:09.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f25f9ffb640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f25e8066470 0x7f25e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f25f9ffb640 1 -- 172.21.15.6:0/3448464927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2600083490 con 0x7f26040cbf40 2023-11-28T21:09:09.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f2608fcd640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f25e8066470 0x7f25e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.167+0000 7f2608fcd640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f25e8066470 0x7f25e8068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f25f40af000 tx=0x7f25f40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:09.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.171+0000 7f25f9ffb640 1 -- 172.21.15.6:0/3448464927 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2600050c70 con 0x7f26040cbf40 2023-11-28T21:09:09.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.387+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f260406e0d0 con 0x7f26040cbf40 2023-11-28T21:09:09.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.391+0000 7f25f9ffb640 1 -- 172.21.15.6:0/3448464927 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2600054290 con 0x7f26040cbf40 2023-11-28T21:09:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.391+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f25e8066470 msgr2=0x7f25e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.391+0000 7f260ba32640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f25e8066470 0x7f25e8068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f25f40af000 tx=0x7f25f40a7000 comp rx=0 tx=0).stop 2023-11-28T21:09:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.391+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 msgr2=0x7f26040a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.391+0000 7f260ba32640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 0x7f26040a8d20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f260000c500 tx=0x7f260000c9c0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.391+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 shutdown_connections 2023-11-28T21:09:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.391+0000 7f260ba32640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f25e8066470 0x7f25e8068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.395+0000 7f260ba32640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f260415e750 0x7f26041f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.395+0000 7f260ba32640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f260415e370 0x7f26041653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.395+0000 7f260ba32640 1 --2- 172.21.15.6:0/3448464927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26040cbf40 0x7f26040a8d20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.395+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 >> 172.21.15.6:0/3448464927 conn(0x7f260406a980 msgr2=0x7f260415cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.395+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 shutdown_connections 2023-11-28T21:09:09.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.395+0000 7f260ba32640 1 -- 172.21.15.6:0/3448464927 wait complete. 2023-11-28T21:09:09.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:09:09.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.555+0000 7f160eefe640 1 Processor -- start 2023-11-28T21:09:09.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.555+0000 7f160eefe640 1 -- start start 2023-11-28T21:09:09.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160eefe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1608146a10 0x7f1608160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160eefe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f160806e980 0x7f160806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160eefe640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1608161d80 con 0x7f1608161320 2023-11-28T21:09:09.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160eefe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160806f370 con 0x7f160806e980 2023-11-28T21:09:09.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160eefe640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1608146df0 con 0x7f1608146a10 2023-11-28T21:09:09.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160d49b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f160806e980 0x7f160806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160d49b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f160806e980 0x7f160806ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49734/0 (socket says 172.21.15.6:49734) 2023-11-28T21:09:09.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160cc9a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1608146a10 0x7f1608160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160d49b640 1 -- 172.21.15.6:0/2758647045 learned_addr learned my addr 172.21.15.6:0/2758647045 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:09.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160d49b640 1 -- 172.21.15.6:0/2758647045 >> v2:172.21.15.31:3300/0 conn(0x7f1608146a10 msgr2=0x7f1608160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:09.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160d49b640 1 --2- 172.21.15.6:0/2758647045 >> v2:172.21.15.31:3300/0 conn(0x7f1608146a10 0x7f1608160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160d49b640 1 -- 172.21.15.6:0/2758647045 >> v1:172.21.15.31:6789/0 conn(0x7f1608161320 legacy=0x7f16080d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.559+0000 7f160d49b640 1 -- 172.21.15.6:0/2758647045 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16081617c0 con 0x7f160806e980 2023-11-28T21:09:09.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160d49b640 1 --2- 172.21.15.6:0/2758647045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160806e980 0x7f160806ee30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1608067d10 tx=0x7f160001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e01b3fb8baa906 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:09.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f16077fe640 1 -- 172.21.15.6:0/2758647045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16000a5800 con 0x7f160806e980 2023-11-28T21:09:09.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f16077fe640 1 -- 172.21.15.6:0/2758647045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16000a5960 con 0x7f160806e980 2023-11-28T21:09:09.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f16077fe640 1 -- 172.21.15.6:0/2758647045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16000a5cf0 con 0x7f160806e980 2023-11-28T21:09:09.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 -- 172.21.15.6:0/2758647045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160806e980 msgr2=0x7f160806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 --2- 172.21.15.6:0/2758647045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160806e980 0x7f160806ee30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1608067d10 tx=0x7f160001c940 comp rx=0 tx=0).stop 2023-11-28T21:09:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 -- 172.21.15.6:0/2758647045 shutdown_connections 2023-11-28T21:09:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 --2- 172.21.15.6:0/2758647045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f160806e980 0x7f160806ee30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 --2- 172.21.15.6:0/2758647045 >> v2:172.21.15.31:3300/0 conn(0x7f1608146a10 0x7f1608160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 -- 172.21.15.6:0/2758647045 >> 172.21.15.6:0/2758647045 conn(0x7f160806d720 msgr2=0x7f160806db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 -- 172.21.15.6:0/2758647045 shutdown_connections 2023-11-28T21:09:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 -- 172.21.15.6:0/2758647045 wait complete. 2023-11-28T21:09:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 Processor -- start 2023-11-28T21:09:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.563+0000 7f160eefe640 1 -- start start 2023-11-28T21:09:09.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160eefe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f160806e980 0x7f1608143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160eefe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1608146a10 0x7f16081f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160eefe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1608161320 0x7f16080ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160eefe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16081393a0 con 0x7f1608146a10 2023-11-28T21:09:09.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160eefe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608138790 con 0x7f1608161320 2023-11-28T21:09:09.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160eefe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1608138a70 con 0x7f160806e980 2023-11-28T21:09:09.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f1607fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1608146a10 0x7f16081f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f1607fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1608146a10 0x7f16081f65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49738/0 (socket says 172.21.15.6:49738) 2023-11-28T21:09:09.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f1607fff640 1 -- 172.21.15.6:0/4231324635 learned_addr learned my addr 172.21.15.6:0/4231324635 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:09.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160cc9a640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f160806e980 0x7f1608143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160d49b640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1608161320 0x7f16080ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f1607fff640 1 -- 172.21.15.6:0/4231324635 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f160806e980 msgr2=0x7f1608143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f1607fff640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f160806e980 0x7f1608143070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f1607fff640 1 -- 172.21.15.6:0/4231324635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1608161320 msgr2=0x7f16080ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f1607fff640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1608161320 0x7f16080ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f1607fff640 1 -- 172.21.15.6:0/4231324635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600009b30 con 0x7f1608146a10 2023-11-28T21:09:09.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f1607fff640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1608146a10 0x7f16081f65e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c390 tx=0x7f15f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:09.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f16057fa640 1 -- 172.21.15.6:0/4231324635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40052d0 con 0x7f1608146a10 2023-11-28T21:09:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f16057fa640 1 -- 172.21.15.6:0/4231324635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f4005430 con 0x7f1608146a10 2023-11-28T21:09:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f16057fa640 1 -- 172.21.15.6:0/4231324635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4003820 con 0x7f1608146a10 2023-11-28T21:09:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1608138d50 con 0x7f1608146a10 2023-11-28T21:09:09.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16081435b0 con 0x7f1608146a10 2023-11-28T21:09:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1608139510 con 0x7f1608146a10 2023-11-28T21:09:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.567+0000 7f16057fa640 1 -- 172.21.15.6:0/4231324635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15f4003980 con 0x7f1608146a10 2023-11-28T21:09:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.571+0000 7f16057fa640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f15ec066470 0x7f15ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.571+0000 7f16057fa640 1 -- 172.21.15.6:0/4231324635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f15f4083090 con 0x7f1608146a10 2023-11-28T21:09:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.571+0000 7f160cc9a640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f15ec066470 0x7f15ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.571+0000 7f160cc9a640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f15ec066470 0x7f15ec068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009b60 tx=0x7f15fc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:09.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.575+0000 7f16057fa640 1 -- 172.21.15.6:0/4231324635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15f4050870 con 0x7f1608146a10 2023-11-28T21:09:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.731+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16080674d0 con 0x7f1608146a10 2023-11-28T21:09:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f16057fa640 1 -- 172.21.15.6:0/4231324635 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12749 (secure 0 0 0) 0x7f15f4053e90 con 0x7f1608146a10 2023-11-28T21:09:09.739 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:09.740 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:09:06.552183+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:09:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f15ec066470 msgr2=0x7f15ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f15ec066470 0x7f15ec068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009b60 tx=0x7f15fc009190 comp rx=0 tx=0).stop 2023-11-28T21:09:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1608146a10 msgr2=0x7f16081f65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1608146a10 0x7f16081f65e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c390 tx=0x7f15f400c850 comp rx=0 tx=0).stop 2023-11-28T21:09:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 shutdown_connections 2023-11-28T21:09:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f15ec066470 0x7f15ec068930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1608161320 0x7f16080ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1608146a10 0x7f16081f65e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 --2- 172.21.15.6:0/4231324635 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f160806e980 0x7f1608143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 >> 172.21.15.6:0/4231324635 conn(0x7f160806d720 msgr2=0x7f160806f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 shutdown_connections 2023-11-28T21:09:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.735+0000 7f160eefe640 1 -- 172.21.15.6:0/4231324635 wait complete. 2023-11-28T21:09:09.761 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T21:09:09.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T21:09:09.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3faafd640 1 Processor -- start 2023-11-28T21:09:09.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3faafd640 1 -- start start 2023-11-28T21:09:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3faafd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd3f406ca00 0x7fd3f40cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3faafd640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f40cc930 con 0x7fd3f406cde0 2023-11-28T21:09:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3faafd640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f40ccb60 con 0x7fd3f415c440 2023-11-28T21:09:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3faafd640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f40cd400 con 0x7fd3f406ca00 2023-11-28T21:09:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3f3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd3f406cde0 0x7fd3f415bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37150/0 (socket says 172.21.15.6:37150) 2023-11-28T21:09:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3f3fff640 1 -- 172.21.15.6:0/153622946 learned_addr learned my addr 172.21.15.6:0/153622946 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3f8899640 1 --2- 172.21.15.6:0/153622946 >> v2:172.21.15.6:3300/0 conn(0x7fd3f406ca00 0x7fd3f40cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3f8899640 1 -- 172.21.15.6:0/153622946 >> v1:172.21.15.31:6789/0 conn(0x7fd3f415c440 legacy=0x7fd3f415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3f8899640 1 -- 172.21.15.6:0/153622946 >> v1:172.21.15.6:6789/0 conn(0x7fd3f406cde0 legacy=0x7fd3f415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3f8899640 1 -- 172.21.15.6:0/153622946 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f40cce40 con 0x7fd3f406ca00 2023-11-28T21:09:09.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.903+0000 7fd3f37fe640 1 -- 172.21.15.6:0/153622946 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437959786 0 0) 0x7fd3f40cc930 con 0x7fd3f406cde0 2023-11-28T21:09:09.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3f8899640 1 --2- 172.21.15.6:0/153622946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f406ca00 0x7fd3f40cc3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80097f0 tx=0x7fd3e801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9558c00f98433f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3f37fe640 1 -- 172.21.15.6:0/153622946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e80ac620 con 0x7fd3f406ca00 2023-11-28T21:09:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3f37fe640 1 -- 172.21.15.6:0/153622946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e80ac780 con 0x7fd3f406ca00 2023-11-28T21:09:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3f37fe640 1 -- 172.21.15.6:0/153622946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e80acb10 con 0x7fd3f406ca00 2023-11-28T21:09:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3faafd640 1 -- 172.21.15.6:0/153622946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f406ca00 msgr2=0x7fd3f40cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3faafd640 1 --2- 172.21.15.6:0/153622946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f406ca00 0x7fd3f40cc3f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80097f0 tx=0x7fd3e801c3c0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3faafd640 1 -- 172.21.15.6:0/153622946 shutdown_connections 2023-11-28T21:09:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3faafd640 1 --2- 172.21.15.6:0/153622946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f406ca00 0x7fd3f40cc3f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3faafd640 1 -- 172.21.15.6:0/153622946 >> 172.21.15.6:0/153622946 conn(0x7fd3f406a980 msgr2=0x7fd3f406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3faafd640 1 -- 172.21.15.6:0/153622946 shutdown_connections 2023-11-28T21:09:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.907+0000 7fd3faafd640 1 -- 172.21.15.6:0/153622946 wait complete. 2023-11-28T21:09:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 Processor -- start 2023-11-28T21:09:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 -- start start 2023-11-28T21:09:09.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f406ca00 0x7fd3f4151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f406cde0 0x7fd3f40b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f415c440 0x7fd3f4149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4151ca0 con 0x7fd3f415c440 2023-11-28T21:09:09.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4148dd0 con 0x7fd3f406ca00 2023-11-28T21:09:09.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4157980 con 0x7fd3f406cde0 2023-11-28T21:09:09.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f909a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f415c440 0x7fd3f4149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f909a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f415c440 0x7fd3f4149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49760/0 (socket says 172.21.15.6:49760) 2023-11-28T21:09:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f909a640 1 -- 172.21.15.6:0/161594409 learned_addr learned my addr 172.21.15.6:0/161594409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f8899640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f406ca00 0x7fd3f4151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f3fff640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f406cde0 0x7fd3f40b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f909a640 1 -- 172.21.15.6:0/161594409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f406cde0 msgr2=0x7fd3f40b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f909a640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f406cde0 0x7fd3f40b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f909a640 1 -- 172.21.15.6:0/161594409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f406ca00 msgr2=0x7fd3f4151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f909a640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f406ca00 0x7fd3f4151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f909a640 1 -- 172.21.15.6:0/161594409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8009420 con 0x7fd3f415c440 2023-11-28T21:09:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f909a640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f415c440 0x7fd3f4149260 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00c700 tx=0x7fd3ec00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f17fa640 1 -- 172.21.15.6:0/161594409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec003b80 con 0x7fd3f415c440 2023-11-28T21:09:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f17fa640 1 -- 172.21.15.6:0/161594409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec003ce0 con 0x7fd3f415c440 2023-11-28T21:09:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3f17fa640 1 -- 172.21.15.6:0/161594409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00aa90 con 0x7fd3f415c440 2023-11-28T21:09:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f4151ef0 con 0x7fd3f415c440 2023-11-28T21:09:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f4157610 con 0x7fd3f415c440 2023-11-28T21:09:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.911+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f41523a0 con 0x7fd3f415c440 2023-11-28T21:09:09.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.915+0000 7fd3f17fa640 1 -- 172.21.15.6:0/161594409 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3ec00abf0 con 0x7fd3f415c440 2023-11-28T21:09:09.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.915+0000 7fd3f17fa640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd3d80664a0 0x7fd3d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.915+0000 7fd3f17fa640 1 -- 172.21.15.6:0/161594409 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd3ec0838b0 con 0x7fd3f415c440 2023-11-28T21:09:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.915+0000 7fd3f8899640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd3d80664a0 0x7fd3d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.915+0000 7fd3f8899640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd3d80664a0 0x7fd3d8068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80ae000 tx=0x7fd3e80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:09.919+0000 7fd3f17fa640 1 -- 172.21.15.6:0/161594409 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3ec051070 con 0x7fd3f415c440 2023-11-28T21:09:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.075+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3f4072b90 con 0x7fd3f415c440 2023-11-28T21:09:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.075+0000 7fd3f17fa640 1 -- 172.21.15.6:0/161594409 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3ec054690 con 0x7fd3f415c440 2023-11-28T21:09:10.083 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-28T21:09:10.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd3d80664a0 msgr2=0x7fd3d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd3d80664a0 0x7fd3d8068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80ae000 tx=0x7fd3e80a7000 comp rx=0 tx=0).stop 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f415c440 msgr2=0x7fd3f4149260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f415c440 0x7fd3f4149260 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00c700 tx=0x7fd3ec00cbc0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 shutdown_connections 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd3d80664a0 0x7fd3d8068960 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3f415c440 0x7fd3f4149260 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd3f406cde0 0x7fd3f40b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 --2- 172.21.15.6:0/161594409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f406ca00 0x7fd3f4151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 >> 172.21.15.6:0/161594409 conn(0x7fd3f406a980 msgr2=0x7fd3f415ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 shutdown_connections 2023-11-28T21:09:10.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.079+0000 7fd3faafd640 1 -- 172.21.15.6:0/161594409 wait complete. 2023-11-28T21:09:10.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T21:09:10.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c7dce3640 1 Processor -- start 2023-11-28T21:09:10.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c7dce3640 1 -- start start 2023-11-28T21:09:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c7dce3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 0x7f7c780b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c7dce3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c780b2550 0x7f7c780b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c7dce3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c780aff60 con 0x7f7c780d1880 2023-11-28T21:09:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c7dce3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c780b0240 con 0x7f7c780b2550 2023-11-28T21:09:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c7dce3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780b0520 con 0x7f7c78160cd0 2023-11-28T21:09:10.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 0x7f7c780b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c77fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c780b2550 0x7f7c780b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c6ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 0x7f7c780b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:44756/0 (socket says 172.21.15.6:44756) 2023-11-28T21:09:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c77fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c780b2550 0x7f7c780b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:52674/0 (socket says 172.21.15.6:52674) 2023-11-28T21:09:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c6ffff640 1 -- 172.21.15.6:0/2121169777 learned_addr learned my addr 172.21.15.6:0/2121169777 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c77fff640 1 -- 172.21.15.6:0/2121169777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 msgr2=0x7f7c780b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c77fff640 1 --2- 172.21.15.6:0/2121169777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 0x7f7c780b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c77fff640 1 -- 172.21.15.6:0/2121169777 >> v1:172.21.15.31:6789/0 conn(0x7f7c780d1880 legacy=0x7f7c781605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c77fff640 1 -- 172.21.15.6:0/2121169777 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780b0800 con 0x7f7c780b2550 2023-11-28T21:09:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.243+0000 7f7c76ffd640 1 -- 172.21.15.6:0/2121169777 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400805288 0 0) 0x7f7c780aff60 con 0x7f7c780d1880 2023-11-28T21:09:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c77fff640 1 --2- 172.21.15.6:0/2121169777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c780b2550 0x7f7c780b1260 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009d90 tx=0x7f7c7001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84121dddf2878f30 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c76ffd640 1 -- 172.21.15.6:0/2121169777 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700a5920 con 0x7f7c780b2550 2023-11-28T21:09:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c76ffd640 1 -- 172.21.15.6:0/2121169777 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c700a5a80 con 0x7f7c780b2550 2023-11-28T21:09:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c76ffd640 1 -- 172.21.15.6:0/2121169777 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700a5e10 con 0x7f7c780b2550 2023-11-28T21:09:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c7dce3640 1 -- 172.21.15.6:0/2121169777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c780b2550 msgr2=0x7f7c780b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c7dce3640 1 --2- 172.21.15.6:0/2121169777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c780b2550 0x7f7c780b1260 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009d90 tx=0x7f7c7001c950 comp rx=0 tx=0).stop 2023-11-28T21:09:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c7dce3640 1 -- 172.21.15.6:0/2121169777 shutdown_connections 2023-11-28T21:09:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c7dce3640 1 --2- 172.21.15.6:0/2121169777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c780b2550 0x7f7c780b1260 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c7dce3640 1 --2- 172.21.15.6:0/2121169777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 0x7f7c780b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c7dce3640 1 -- 172.21.15.6:0/2121169777 >> 172.21.15.6:0/2121169777 conn(0x7f7c7809c460 msgr2=0x7f7c780d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c7dce3640 1 -- 172.21.15.6:0/2121169777 shutdown_connections 2023-11-28T21:09:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.247+0000 7f7c7dce3640 1 -- 172.21.15.6:0/2121169777 wait complete. 2023-11-28T21:09:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 Processor -- start 2023-11-28T21:09:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 -- start start 2023-11-28T21:09:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c780b2550 0x7f7c7815f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c780d1880 0x7f7c7815fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 0x7f7c780c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781f94a0 con 0x7f7c780b2550 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780ccf10 con 0x7f7c780d1880 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781f9740 con 0x7f7c78160cd0 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c780b2550 0x7f7c7815f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c780b2550 0x7f7c7815f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49762/0 (socket says 172.21.15.6:49762) 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c777fe640 1 -- 172.21.15.6:0/433742898 learned_addr learned my addr 172.21.15.6:0/433742898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c6ffff640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c780d1880 0x7f7c7815fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c77fff640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 0x7f7c780c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c777fe640 1 -- 172.21.15.6:0/433742898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 msgr2=0x7f7c780c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c777fe640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 0x7f7c780c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c777fe640 1 -- 172.21.15.6:0/433742898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c780d1880 msgr2=0x7f7c7815fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c777fe640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c780d1880 0x7f7c7815fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c777fe640 1 -- 172.21.15.6:0/433742898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70009a70 con 0x7f7c780b2550 2023-11-28T21:09:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c777fe640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c780b2550 0x7f7c7815f5f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800c4d0 tx=0x7f7c6800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c74ff9640 1 -- 172.21.15.6:0/433742898 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68005480 con 0x7f7c780b2550 2023-11-28T21:09:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c74ff9640 1 -- 172.21.15.6:0/433742898 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c68003600 con 0x7f7c780b2550 2023-11-28T21:09:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c781f9a20 con 0x7f7c780b2550 2023-11-28T21:09:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c74ff9640 1 -- 172.21.15.6:0/433742898 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c680039b0 con 0x7f7c780b2550 2023-11-28T21:09:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.251+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c781fa220 con 0x7f7c780b2550 2023-11-28T21:09:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.255+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c780674d0 con 0x7f7c780b2550 2023-11-28T21:09:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.255+0000 7f7c74ff9640 1 -- 172.21.15.6:0/433742898 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c68003b10 con 0x7f7c780b2550 2023-11-28T21:09:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.255+0000 7f7c74ff9640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7c580664a0 0x7f7c58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.255+0000 7f7c74ff9640 1 -- 172.21.15.6:0/433742898 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c68082fc0 con 0x7f7c780b2550 2023-11-28T21:09:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.255+0000 7f7c6ffff640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7c580664a0 0x7f7c58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.255+0000 7f7c6ffff640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7c580664a0 0x7f7c58068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c781f9400 tx=0x7f7c60009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.259+0000 7f7c74ff9640 1 -- 172.21.15.6:0/433742898 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c680b4280 con 0x7f7c780b2550 2023-11-28T21:09:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7c780d2b40 con 0x7f7c780b2550 2023-11-28T21:09:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c74ff9640 1 -- 172.21.15.6:0/433742898 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7c68017070 con 0x7f7c780b2550 2023-11-28T21:09:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:10.425 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-11-28T21:09:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-11-28T21:09:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-11-28T21:09:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-11-28T21:09:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:10.426 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-11-28T21:09:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7c580664a0 msgr2=0x7f7c58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7c580664a0 0x7f7c58068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c781f9400 tx=0x7f7c60009240 comp rx=0 tx=0).stop 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c780b2550 msgr2=0x7f7c7815f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c780b2550 0x7f7c7815f5f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800c4d0 tx=0x7f7c6800c990 comp rx=0 tx=0).stop 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 shutdown_connections 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7c580664a0 0x7f7c58068960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c78160cd0 0x7f7c780c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c780d1880 0x7f7c7815fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 --2- 172.21.15.6:0/433742898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c780b2550 0x7f7c7815f5f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 >> 172.21.15.6:0/433742898 conn(0x7f7c7809c460 msgr2=0x7f7c780b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 shutdown_connections 2023-11-28T21:09:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.419+0000 7f7c7dce3640 1 -- 172.21.15.6:0/433742898 wait complete. 2023-11-28T21:09:10.446 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T21:09:10.446 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T21:09:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa8664bb640 1 Processor -- start 2023-11-28T21:09:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa8664bb640 1 -- start start 2023-11-28T21:09:10.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa8664bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa860071cc0 0x7fa86006c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa8664bb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa8601433b0 0x7fa8600cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa8664bb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa860143100 con 0x7fa860142d20 2023-11-28T21:09:10.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa8664bb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86015e9c0 con 0x7fa8601433b0 2023-11-28T21:09:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa8664bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86006e150 con 0x7fa860071cc0 2023-11-28T21:09:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa85ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa860142d20 0x7fa8600715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37166/0 (socket says 172.21.15.6:37166) 2023-11-28T21:09:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa85ffff640 1 -- 172.21.15.6:0/2936261566 learned_addr learned my addr 172.21.15.6:0/2936261566 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa864a58640 1 --2- 172.21.15.6:0/2936261566 >> v2:172.21.15.31:3300/0 conn(0x7fa8601433b0 0x7fa8600cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.586+0000 7fa85f7fe640 1 --2- 172.21.15.6:0/2936261566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa860071cc0 0x7fa86006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa85effd640 1 -- 172.21.15.6:0/2936261566 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895244814 0 0) 0x7fa860143100 con 0x7fa860142d20 2023-11-28T21:09:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa85effd640 1 -- 172.21.15.6:0/2936261566 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa848003530 con 0x7fa860142d20 2023-11-28T21:09:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa864a58640 1 -- 172.21.15.6:0/2936261566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa860071cc0 msgr2=0x7fa86006c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa864a58640 1 --2- 172.21.15.6:0/2936261566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa860071cc0 0x7fa86006c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa864a58640 1 -- 172.21.15.6:0/2936261566 >> v1:172.21.15.6:6789/0 conn(0x7fa860142d20 legacy=0x7fa8600715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa85effd640 1 -- 172.21.15.6:0/2936261566 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3870893834 0 0) 0x7fa848003530 con 0x7fa860142d20 2023-11-28T21:09:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa864a58640 1 -- 172.21.15.6:0/2936261566 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86006e430 con 0x7fa8601433b0 2023-11-28T21:09:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa864a58640 1 --2- 172.21.15.6:0/2936261566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8601433b0 0x7fa8600cd010 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa858009d90 tx=0x7fa85801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97e74fa346a0171f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa85effd640 1 -- 172.21.15.6:0/2936261566 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850001680 con 0x7fa8601433b0 2023-11-28T21:09:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa85effd640 1 -- 172.21.15.6:0/2936261566 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8580a5610 con 0x7fa8601433b0 2023-11-28T21:09:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.590+0000 7fa85effd640 1 -- 172.21.15.6:0/2936261566 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580a59a0 con 0x7fa8601433b0 2023-11-28T21:09:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 -- 172.21.15.6:0/2936261566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8601433b0 msgr2=0x7fa8600cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 --2- 172.21.15.6:0/2936261566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8601433b0 0x7fa8600cd010 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa858009d90 tx=0x7fa85801c870 comp rx=0 tx=0).stop 2023-11-28T21:09:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 -- 172.21.15.6:0/2936261566 shutdown_connections 2023-11-28T21:09:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 --2- 172.21.15.6:0/2936261566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa860071cc0 0x7fa86006c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 --2- 172.21.15.6:0/2936261566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8601433b0 0x7fa8600cd010 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 -- 172.21.15.6:0/2936261566 >> 172.21.15.6:0/2936261566 conn(0x7fa8600b0b00 msgr2=0x7fa8600b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 -- 172.21.15.6:0/2936261566 shutdown_connections 2023-11-28T21:09:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 -- 172.21.15.6:0/2936261566 wait complete. 2023-11-28T21:09:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 Processor -- start 2023-11-28T21:09:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 -- start start 2023-11-28T21:09:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa860071cc0 0x7fa8600b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa860142d20 0x7fa8600cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8601433b0 0x7fa860158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600b4490 con 0x7fa860071cc0 2023-11-28T21:09:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600b4770 con 0x7fa860142d20 2023-11-28T21:09:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa8664bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600b4a50 con 0x7fa8601433b0 2023-11-28T21:09:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa85ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa860071cc0 0x7fa8600b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa85ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa860071cc0 0x7fa8600b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49770/0 (socket says 172.21.15.6:49770) 2023-11-28T21:09:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa85ffff640 1 -- 172.21.15.6:0/3348053621 learned_addr learned my addr 172.21.15.6:0/3348053621 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa85f7fe640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa860142d20 0x7fa8600cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa864a58640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8601433b0 0x7fa860158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa85ffff640 1 -- 172.21.15.6:0/3348053621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8601433b0 msgr2=0x7fa860158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa85ffff640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8601433b0 0x7fa860158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa85ffff640 1 -- 172.21.15.6:0/3348053621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa860142d20 msgr2=0x7fa8600cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa85ffff640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa860142d20 0x7fa8600cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.594+0000 7fa85ffff640 1 -- 172.21.15.6:0/3348053621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858009a70 con 0x7fa860071cc0 2023-11-28T21:09:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.598+0000 7fa85ffff640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa860071cc0 0x7fa8600b3b40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa85000c760 tx=0x7fa85000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.598+0000 7fa85cff9640 1 -- 172.21.15.6:0/3348053621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850005ae0 con 0x7fa860071cc0 2023-11-28T21:09:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.598+0000 7fa85cff9640 1 -- 172.21.15.6:0/3348053621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa850005c40 con 0x7fa860071cc0 2023-11-28T21:09:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.598+0000 7fa85cff9640 1 -- 172.21.15.6:0/3348053621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850007070 con 0x7fa860071cc0 2023-11-28T21:09:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.598+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86015bdc0 con 0x7fa860071cc0 2023-11-28T21:09:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.598+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8600b4080 con 0x7fa860071cc0 2023-11-28T21:09:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.598+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8600674d0 con 0x7fa860071cc0 2023-11-28T21:09:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.602+0000 7fa85cff9640 1 -- 172.21.15.6:0/3348053621 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8500071d0 con 0x7fa860071cc0 2023-11-28T21:09:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.602+0000 7fa85cff9640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa84c0664a0 0x7fa84c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.602+0000 7fa85cff9640 1 -- 172.21.15.6:0/3348053621 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa850084310 con 0x7fa860071cc0 2023-11-28T21:09:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.602+0000 7fa85f7fe640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa84c0664a0 0x7fa84c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.602+0000 7fa85f7fe640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa84c0664a0 0x7fa84c068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa860134680 tx=0x7fa854009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:10.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.606+0000 7fa85cff9640 1 -- 172.21.15.6:0/3348053621 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa850055690 con 0x7fa860071cc0 2023-11-28T21:09:10.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:10.762+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa8600b0800 con 0x7fa860071cc0 2023-11-28T21:09:11.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa85cff9640 1 -- 172.21.15.6:0/3348053621 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa850055220 con 0x7fa860071cc0 2023-11-28T21:09:11.616 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-11-28T21:09:11.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa84c0664a0 msgr2=0x7fa84c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa84c0664a0 0x7fa84c068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa860134680 tx=0x7fa854009190 comp rx=0 tx=0).stop 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa860071cc0 msgr2=0x7fa8600b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa860071cc0 0x7fa8600b3b40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa85000c760 tx=0x7fa85000cc20 comp rx=0 tx=0).stop 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 shutdown_connections 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa84c0664a0 0x7fa84c068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8601433b0 0x7fa860158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa860142d20 0x7fa8600cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 --2- 172.21.15.6:0/3348053621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa860071cc0 0x7fa8600b3b40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 >> 172.21.15.6:0/3348053621 conn(0x7fa8600b0b00 msgr2=0x7fa860163820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.610+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 shutdown_connections 2023-11-28T21:09:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.614+0000 7fa8664bb640 1 -- 172.21.15.6:0/3348053621 wait complete. 2023-11-28T21:09:11.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T21:09:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b86ed6640 1 Processor -- start 2023-11-28T21:09:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b86ed6640 1 -- start start 2023-11-28T21:09:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b86ed6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 0x7f4b800cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:11.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b86ed6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b8006cde0 0x7f4b8015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b86ed6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4b8015c270 0x7f4b8015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b86ed6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b800cd400 con 0x7f4b8006cde0 2023-11-28T21:09:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b86ed6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8015c700 con 0x7f4b8015c270 2023-11-28T21:09:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b86ed6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800cc930 con 0x7f4b8006ca00 2023-11-28T21:09:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b7ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b8006cde0 0x7f4b8015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b7ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b8006cde0 0x7f4b8015bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49776/0 (socket says 172.21.15.6:49776) 2023-11-28T21:09:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b7ffff640 1 -- 172.21.15.6:0/800333474 learned_addr learned my addr 172.21.15.6:0/800333474 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b85473640 1 --2- 172.21.15.6:0/800333474 >> v2:172.21.15.31:3300/0 conn(0x7f4b8015c270 0x7f4b8015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:11.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b84c72640 1 --2- 172.21.15.6:0/800333474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 0x7f4b800cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b7ffff640 1 -- 172.21.15.6:0/800333474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 msgr2=0x7f4b800cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b7ffff640 1 --2- 172.21.15.6:0/800333474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 0x7f4b800cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b7ffff640 1 -- 172.21.15.6:0/800333474 >> v2:172.21.15.31:3300/0 conn(0x7f4b8015c270 msgr2=0x7f4b8015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b7ffff640 1 --2- 172.21.15.6:0/800333474 >> v2:172.21.15.31:3300/0 conn(0x7f4b8015c270 0x7f4b8015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.798+0000 7f4b7ffff640 1 -- 172.21.15.6:0/800333474 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800ccb60 con 0x7f4b8006cde0 2023-11-28T21:09:11.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b7ffff640 1 --2- 172.21.15.6:0/800333474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006cde0 0x7f4b8015bd30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4b8006e680 tx=0x7f4b6c01c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b020549b74a70b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b7f7fe640 1 -- 172.21.15.6:0/800333474 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0ab600 con 0x7f4b8006cde0 2023-11-28T21:09:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b7f7fe640 1 -- 172.21.15.6:0/800333474 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0a7050 con 0x7f4b8006cde0 2023-11-28T21:09:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b7f7fe640 1 -- 172.21.15.6:0/800333474 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0ab980 con 0x7f4b8006cde0 2023-11-28T21:09:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 -- 172.21.15.6:0/800333474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006cde0 msgr2=0x7f4b8015bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:11.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/800333474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006cde0 0x7f4b8015bd30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4b8006e680 tx=0x7f4b6c01c180 comp rx=0 tx=0).stop 2023-11-28T21:09:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 -- 172.21.15.6:0/800333474 shutdown_connections 2023-11-28T21:09:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/800333474 >> v2:172.21.15.31:3300/0 conn(0x7f4b8015c270 0x7f4b8015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/800333474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006cde0 0x7f4b8015bd30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/800333474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 0x7f4b800cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 -- 172.21.15.6:0/800333474 >> 172.21.15.6:0/800333474 conn(0x7f4b8006a980 msgr2=0x7f4b8006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:11.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 -- 172.21.15.6:0/800333474 shutdown_connections 2023-11-28T21:09:11.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 -- 172.21.15.6:0/800333474 wait complete. 2023-11-28T21:09:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 Processor -- start 2023-11-28T21:09:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.802+0000 7f4b86ed6640 1 -- start start 2023-11-28T21:09:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b86ed6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 0x7f4b80070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b86ed6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b8006cde0 0x7f4b80144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:11.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b86ed6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8015c270 0x7f4b800b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:11.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b86ed6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80071520 con 0x7f4b8015c270 2023-11-28T21:09:11.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b86ed6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800b2230 con 0x7f4b8006cde0 2023-11-28T21:09:11.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b86ed6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80145110 con 0x7f4b8006ca00 2023-11-28T21:09:11.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b85473640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8015c270 0x7f4b800b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:11.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b85473640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8015c270 0x7f4b800b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49792/0 (socket says 172.21.15.6:49792) 2023-11-28T21:09:11.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b85473640 1 -- 172.21.15.6:0/1621051101 learned_addr learned my addr 172.21.15.6:0/1621051101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:11.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b84c72640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 0x7f4b80070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b7ffff640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b8006cde0 0x7f4b80144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b85473640 1 -- 172.21.15.6:0/1621051101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 msgr2=0x7f4b80070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b85473640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 0x7f4b80070fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b85473640 1 -- 172.21.15.6:0/1621051101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b8006cde0 msgr2=0x7f4b80144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b85473640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b8006cde0 0x7f4b80144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b85473640 1 -- 172.21.15.6:0/1621051101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0094d0 con 0x7f4b8015c270 2023-11-28T21:09:11.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b7ffff640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b8006cde0 0x7f4b80144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:11.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b85473640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8015c270 0x7f4b800b25f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800efc0 tx=0x7f4b7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:11.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b7d7fa640 1 -- 172.21.15.6:0/1621051101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78009ba0 con 0x7f4b8015c270 2023-11-28T21:09:11.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b7d7fa640 1 -- 172.21.15.6:0/1621051101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7800f040 con 0x7f4b8015c270 2023-11-28T21:09:11.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b80071f90 con 0x7f4b8015c270 2023-11-28T21:09:11.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b7d7fa640 1 -- 172.21.15.6:0/1621051101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780146c0 con 0x7f4b8015c270 2023-11-28T21:09:11.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b800b1be0 con 0x7f4b8015c270 2023-11-28T21:09:11.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.806+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8004e930 con 0x7f4b8015c270 2023-11-28T21:09:11.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.810+0000 7f4b7d7fa640 1 -- 172.21.15.6:0/1621051101 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b78014820 con 0x7f4b8015c270 2023-11-28T21:09:11.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.810+0000 7f4b7d7fa640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4b64066470 0x7f4b64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:11.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.810+0000 7f4b7d7fa640 1 -- 172.21.15.6:0/1621051101 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4b780846a0 con 0x7f4b8015c270 2023-11-28T21:09:11.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.810+0000 7f4b84c72640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4b64066470 0x7f4b64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:11.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.810+0000 7f4b84c72640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4b64066470 0x7f4b64068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009ae0 tx=0x7f4b74009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:11.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.814+0000 7f4b7d7fa640 1 -- 172.21.15.6:0/1621051101 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b78051cf0 con 0x7f4b8015c270 2023-11-28T21:09:11.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:11.974+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4b8006e0c0 con 0x7f4b8015c270 2023-11-28T21:09:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.614+0000 7f4b7d7fa640 1 -- 172.21.15.6:0/1621051101 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4b78055310 con 0x7f4b8015c270 2023-11-28T21:09:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-11-28T21:09:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.614+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4b64066470 msgr2=0x7f4b64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.614+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4b64066470 0x7f4b64068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009ae0 tx=0x7f4b74009190 comp rx=0 tx=0).stop 2023-11-28T21:09:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.614+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8015c270 msgr2=0x7f4b800b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.614+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8015c270 0x7f4b800b25f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800efc0 tx=0x7f4b7800c490 comp rx=0 tx=0).stop 2023-11-28T21:09:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.618+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 shutdown_connections 2023-11-28T21:09:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.618+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4b64066470 0x7f4b64068930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.618+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8015c270 0x7f4b800b25f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.618+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b8006cde0 0x7f4b80144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.618+0000 7f4b86ed6640 1 --2- 172.21.15.6:0/1621051101 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4b8006ca00 0x7f4b80070fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.618+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 >> 172.21.15.6:0/1621051101 conn(0x7f4b8006a980 msgr2=0x7f4b80159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.618+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 shutdown_connections 2023-11-28T21:09:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.618+0000 7f4b86ed6640 1 -- 172.21.15.6:0/1621051101 wait complete. 2023-11-28T21:09:12.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T21:09:12.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f0721d72640 1 Processor -- start 2023-11-28T21:09:12.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f0721d72640 1 -- start start 2023-11-28T21:09:12.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f0721d72640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f071c143970 0x7f071c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:12.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f0721d72640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f071c0b4110 0x7f071c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:12.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f0721d72640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c0b30b0 con 0x7f071c15da90 2023-11-28T21:09:12.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f0721d72640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071c15e7e0 con 0x7f071c143970 2023-11-28T21:09:12.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f0721d72640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071c0b3350 con 0x7f071c0b4110 2023-11-28T21:09:12.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f071b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f071c143970 0x7f071c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:12.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f071bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f071c15da90 0x7f071c15df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37168/0 (socket says 172.21.15.6:37168) 2023-11-28T21:09:12.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f071bfff640 1 -- 172.21.15.6:0/1540518657 learned_addr learned my addr 172.21.15.6:0/1540518657 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:12.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f071affd640 1 --2- 172.21.15.6:0/1540518657 >> v2:172.21.15.31:3300/0 conn(0x7f071c0b4110 0x7f071c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:12.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f071b7fe640 1 -- 172.21.15.6:0/1540518657 >> v2:172.21.15.31:3300/0 conn(0x7f071c0b4110 msgr2=0x7f071c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:12.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f071b7fe640 1 --2- 172.21.15.6:0/1540518657 >> v2:172.21.15.31:3300/0 conn(0x7f071c0b4110 0x7f071c06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.806+0000 7f071b7fe640 1 -- 172.21.15.6:0/1540518657 >> v1:172.21.15.6:6789/0 conn(0x7f071c15da90 legacy=0x7f071c15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:12.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f071a7fc640 1 -- 172.21.15.6:0/1540518657 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103249008 0 0) 0x7f071c0b30b0 con 0x7f071c15da90 2023-11-28T21:09:12.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f071b7fe640 1 -- 172.21.15.6:0/1540518657 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c0b3630 con 0x7f071c143970 2023-11-28T21:09:12.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f071affd640 1 --2- 172.21.15.6:0/1540518657 >> v2:172.21.15.31:3300/0 conn(0x7f071c0b4110 0x7f071c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:12.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f071b7fe640 1 --2- 172.21.15.6:0/1540518657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 0x7f071c06c950 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f071c0b2bf0 tx=0x7f070c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121bbdb1ee173fae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:12.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f071a7fc640 1 -- 172.21.15.6:0/1540518657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0ab600 con 0x7f071c143970 2023-11-28T21:09:12.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f071a7fc640 1 -- 172.21.15.6:0/1540518657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c0a7050 con 0x7f071c143970 2023-11-28T21:09:12.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f071a7fc640 1 -- 172.21.15.6:0/1540518657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0ab980 con 0x7f071c143970 2023-11-28T21:09:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f0721d72640 1 -- 172.21.15.6:0/1540518657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 msgr2=0x7f071c06c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f0721d72640 1 --2- 172.21.15.6:0/1540518657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 0x7f071c06c950 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f071c0b2bf0 tx=0x7f070c01c3d0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f0721d72640 1 -- 172.21.15.6:0/1540518657 shutdown_connections 2023-11-28T21:09:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f0721d72640 1 --2- 172.21.15.6:0/1540518657 >> v2:172.21.15.31:3300/0 conn(0x7f071c0b4110 0x7f071c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f0721d72640 1 --2- 172.21.15.6:0/1540518657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 0x7f071c06c950 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f0721d72640 1 -- 172.21.15.6:0/1540518657 >> 172.21.15.6:0/1540518657 conn(0x7f071c06a980 msgr2=0x7f071c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f0721d72640 1 -- 172.21.15.6:0/1540518657 shutdown_connections 2023-11-28T21:09:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.810+0000 7f0721d72640 1 -- 172.21.15.6:0/1540518657 wait complete. 2023-11-28T21:09:12.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f0721d72640 1 Processor -- start 2023-11-28T21:09:12.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f0721d72640 1 -- start start 2023-11-28T21:09:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f0721d72640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f071c0b4110 0x7f071c145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f0721d72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 0x7f071c0c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f0721d72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f071c15da90 0x7f071c0c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f0721d72640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c0c7160 con 0x7f071c143970 2023-11-28T21:09:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f0721d72640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c0b0580 con 0x7f071c15da90 2023-11-28T21:09:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f0721d72640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071c146970 con 0x7f071c0b4110 2023-11-28T21:09:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 0x7f071c0c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 0x7f071c0c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49818/0 (socket says 172.21.15.6:49818) 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071affd640 1 -- 172.21.15.6:0/793488724 learned_addr learned my addr 172.21.15.6:0/793488724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071b7fe640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f071c0b4110 0x7f071c145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071bfff640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f071c15da90 0x7f071c0c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071affd640 1 -- 172.21.15.6:0/793488724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f071c0b4110 msgr2=0x7f071c145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071affd640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f071c0b4110 0x7f071c145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071affd640 1 -- 172.21.15.6:0/793488724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f071c15da90 msgr2=0x7f071c0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071affd640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f071c15da90 0x7f071c0c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071affd640 1 -- 172.21.15.6:0/793488724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c009420 con 0x7f071c143970 2023-11-28T21:09:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071bfff640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f071c15da90 0x7f071c0c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.814+0000 7f071affd640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 0x7f071c0c4270 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f071000e810 tx=0x7f071000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f0703fff640 1 -- 172.21.15.6:0/793488724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000c6d0 con 0x7f071c143970 2023-11-28T21:09:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f0703fff640 1 -- 172.21.15.6:0/793488724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071000c830 con 0x7f071c143970 2023-11-28T21:09:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f0703fff640 1 -- 172.21.15.6:0/793488724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000cbe0 con 0x7f071c143970 2023-11-28T21:09:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071c0c3de0 con 0x7f071c143970 2023-11-28T21:09:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071c146bc0 con 0x7f071c143970 2023-11-28T21:09:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071c0723f0 con 0x7f071c143970 2023-11-28T21:09:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f0703fff640 1 -- 172.21.15.6:0/793488724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f071000cd40 con 0x7f071c143970 2023-11-28T21:09:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f0703fff640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0708066470 0x7f0708068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:12.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f0703fff640 1 -- 172.21.15.6:0/793488724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0710083bd0 con 0x7f071c143970 2023-11-28T21:09:12.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f071b7fe640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0708066470 0x7f0708068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:12.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.818+0000 7f071b7fe640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0708066470 0x7f0708068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f070c0ad000 tx=0x7f070c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:12.822+0000 7f0703fff640 1 -- 172.21.15.6:0/793488724 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0710051150 con 0x7f071c143970 2023-11-28T21:09:13.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.018+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f071c072b90 con 0x7f071c143970 2023-11-28T21:09:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.634+0000 7f0703fff640 1 -- 172.21.15.6:0/793488724 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0710054770 con 0x7f071c143970 2023-11-28T21:09:13.639 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 4 and data pool 5 2023-11-28T21:09:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0708066470 msgr2=0x7f0708068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0708066470 0x7f0708068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f070c0ad000 tx=0x7f070c0a6000 comp rx=0 tx=0).stop 2023-11-28T21:09:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 msgr2=0x7f071c0c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:13.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 0x7f071c0c4270 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f071000e810 tx=0x7f071000ecd0 comp rx=0 tx=0).stop 2023-11-28T21:09:13.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 shutdown_connections 2023-11-28T21:09:13.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0708066470 0x7f0708068930 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f070c0ad000 tx=0x7f070c0a6000 comp rx=0 tx=0).stop 2023-11-28T21:09:13.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f071c15da90 0x7f071c0c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:13.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f071c143970 0x7f071c0c4270 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:13.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 --2- 172.21.15.6:0/793488724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f071c0b4110 0x7f071c145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:13.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.638+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 >> 172.21.15.6:0/793488724 conn(0x7f071c06a980 msgr2=0x7f071c0715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:13.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.642+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 shutdown_connections 2023-11-28T21:09:13.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.642+0000 7f0721d72640 1 -- 172.21.15.6:0/793488724 wait complete. 2023-11-28T21:09:13.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:09:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b759e640 1 Processor -- start 2023-11-28T21:09:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b759e640 1 -- start start 2023-11-28T21:09:13.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b80d0050 0x7fa8b8167f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:13.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b759e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b80b3580 con 0x7fa8b815d500 2023-11-28T21:09:13.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b759e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b806b940 con 0x7fa8b80cc8f0 2023-11-28T21:09:13.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b815d8e0 con 0x7fa8b80d0050 2023-11-28T21:09:13.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa8b815d500 0x7fa8b8099980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37178/0 (socket says 172.21.15.6:37178) 2023-11-28T21:09:13.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b659c640 1 -- 172.21.15.6:0/513452398 learned_addr learned my addr 172.21.15.6:0/513452398 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b6d9d640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b80d0050 0x7fa8b8167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334587323 0 0) 0x7fa8b80b3580 con 0x7fa8b815d500 2023-11-28T21:09:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a0003530 con 0x7fa8b815d500 2023-11-28T21:09:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 763387673 0 0) 0x7fa8a0003530 con 0x7fa8b815d500 2023-11-28T21:09:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b80d0050 msgr2=0x7fa8b8167f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b559a640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b80d0050 0x7fa8b8167f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 >> v1:172.21.15.31:6789/0 conn(0x7fa8b80cc8f0 legacy=0x7fa8b809a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b806bc20 con 0x7fa8b815d500 2023-11-28T21:09:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.834+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fa8a8001680 con 0x7fa8b815d500 2023-11-28T21:09:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 >> v1:172.21.15.6:6789/0 conn(0x7fa8b815d500 legacy=0x7fa8b8099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a0003a20 0x7fa8a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b80d0050 0x7fa8a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a0004d10 0x7fa8a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b815d8e0 con 0x7fa8a0004d10 2023-11-28T21:09:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a000bb20 con 0x7fa8a0003a20 2023-11-28T21:09:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a000bce0 con 0x7fa8b80d0050 2023-11-28T21:09:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b6d9d640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a0004d10 0x7fa8a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b659c640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a0003a20 0x7fa8a0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b5d9b640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b80d0050 0x7fa8a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b6d9d640 1 -- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b80d0050 msgr2=0x7fa8a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b6d9d640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8b80d0050 0x7fa8a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b6d9d640 1 -- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a0003a20 msgr2=0x7fa8a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:13.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b6d9d640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a0003a20 0x7fa8a0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:13.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b6d9d640 1 -- 172.21.15.6:0/513452398 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0003530 con 0x7fa8a0004d10 2023-11-28T21:09:13.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b6d9d640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a0004d10 0x7fa8a0005190 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009fc0 tx=0x7fa8b001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6d207303279149 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:13.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00a5b70 con 0x7fa8a0004d10 2023-11-28T21:09:13.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b000f040 con 0x7fa8a0004d10 2023-11-28T21:09:13.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.838+0000 7fa8b559a640 1 -- 172.21.15.6:0/513452398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00ad440 con 0x7fa8a0004d10 2023-11-28T21:09:13.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 -- 172.21.15.6:0/513452398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a0004d10 msgr2=0x7fa8a0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:13.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 --2- 172.21.15.6:0/513452398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a0004d10 0x7fa8a0005190 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009fc0 tx=0x7fa8b001cc60 comp rx=0 tx=0).stop 2023-11-28T21:09:13.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b6d9d640 1 -- 172.21.15.6:0/513452398 reap_dead start 2023-11-28T21:09:13.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 -- 172.21.15.6:0/513452398 shutdown_connections 2023-11-28T21:09:13.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 -- 172.21.15.6:0/513452398 >> 172.21.15.6:0/513452398 conn(0x7fa8b80b29c0 msgr2=0x7fa8b80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:13.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 -- 172.21.15.6:0/513452398 shutdown_connections 2023-11-28T21:09:13.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 -- 172.21.15.6:0/513452398 wait complete. 2023-11-28T21:09:13.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 Processor -- start 2023-11-28T21:09:13.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 -- start start 2023-11-28T21:09:13.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8a0004d10 0x7fa8b80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:13.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afff0 0x7fa8b80aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:13.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80ca520 0x7fa8b814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:13.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b815f080 con 0x7fa8b80afff0 2023-11-28T21:09:13.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80b3f20 con 0x7fa8b80ca520 2023-11-28T21:09:13.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b759e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80af520 con 0x7fa8a0004d10 2023-11-28T21:09:13.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afff0 0x7fa8b80aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:13.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afff0 0x7fa8b80aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49822/0 (socket says 172.21.15.6:49822) 2023-11-28T21:09:13.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b5d9b640 1 -- 172.21.15.6:0/3508140111 learned_addr learned my addr 172.21.15.6:0/3508140111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:13.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.842+0000 7fa8b659c640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8a0004d10 0x7fa8b80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:13.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b6d9d640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80ca520 0x7fa8b814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:13.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b5d9b640 1 -- 172.21.15.6:0/3508140111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8a0004d10 msgr2=0x7fa8b80b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:13.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b5d9b640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8a0004d10 0x7fa8b80b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:13.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b5d9b640 1 -- 172.21.15.6:0/3508140111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80ca520 msgr2=0x7fa8b814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:13.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b5d9b640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80ca520 0x7fa8b814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:13.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b5d9b640 1 -- 172.21.15.6:0/3508140111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b80af800 con 0x7fa8b80afff0 2023-11-28T21:09:13.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b6d9d640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80ca520 0x7fa8b814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:13.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b5d9b640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afff0 0x7fa8b80aec20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00f5f0 tx=0x7fa8ac00f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:13.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8a6ffd640 1 -- 172.21.15.6:0/3508140111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0052e0 con 0x7fa8b80afff0 2023-11-28T21:09:13.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8a6ffd640 1 -- 172.21.15.6:0/3508140111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac005440 con 0x7fa8b80afff0 2023-11-28T21:09:13.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b815ed10 con 0x7fa8b80afff0 2023-11-28T21:09:13.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8a6ffd640 1 -- 172.21.15.6:0/3508140111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac003840 con 0x7fa8b80afff0 2023-11-28T21:09:13.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b80ca9a0 con 0x7fa8b80afff0 2023-11-28T21:09:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b809ef50 con 0x7fa8b80afff0 2023-11-28T21:09:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8a6ffd640 1 -- 172.21.15.6:0/3508140111 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8ac0039a0 con 0x7fa8b80afff0 2023-11-28T21:09:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8a6ffd640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa898066470 0x7fa898068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:13.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.846+0000 7fa8a6ffd640 1 -- 172.21.15.6:0/3508140111 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8ac083d30 con 0x7fa8b80afff0 2023-11-28T21:09:13.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.850+0000 7fa8b659c640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa898066470 0x7fa898068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:13.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.850+0000 7fa8b659c640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa898066470 0x7fa898068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8b806fd10 tx=0x7fa8a8000ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:13.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:13.850+0000 7fa8a6ffd640 1 -- 172.21.15.6:0/3508140111 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8ac051110 con 0x7fa8b80afff0 2023-11-28T21:09:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.010+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8b804e930 con 0x7fa8b80afff0 2023-11-28T21:09:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.010+0000 7fa8a6ffd640 1 -- 172.21.15.6:0/3508140111 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16474 (secure 0 0 0) 0x7fa8ac054730 con 0x7fa8b80afff0 2023-11-28T21:09:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:14.019 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:09:13.024099+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:09:10.815928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T21:09:12.024583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:09:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa898066470 msgr2=0x7fa898068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa898066470 0x7fa898068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8b806fd10 tx=0x7fa8a8000ee0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afff0 msgr2=0x7fa8b80aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afff0 0x7fa8b80aec20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00f5f0 tx=0x7fa8ac00f9f0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 shutdown_connections 2023-11-28T21:09:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa898066470 0x7fa898068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8b80ca520 0x7fa8b814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8b80afff0 0x7fa8b80aec20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 --2- 172.21.15.6:0/3508140111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa8a0004d10 0x7fa8b80b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 >> 172.21.15.6:0/3508140111 conn(0x7fa8b80b29c0 msgr2=0x7fa8b80cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:14.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 shutdown_connections 2023-11-28T21:09:14.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.014+0000 7fa8b759e640 1 -- 172.21.15.6:0/3508140111 wait complete. 2023-11-28T21:09:14.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:09:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.178+0000 7f0edcfc4640 1 Processor -- start 2023-11-28T21:09:14.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0edcfc4640 1 -- start start 2023-11-28T21:09:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0edcfc4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed8142da0 0x7f0ed8071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0edcfc4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ed815e7d0 0x7f0ed806d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0edcfc4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ed81437f0 0x7f0ed806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0edcfc4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed815dae0 con 0x7f0ed81437f0 2023-11-28T21:09:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0edcfc4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed815e340 con 0x7f0ed815e7d0 2023-11-28T21:09:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0edcfc4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80b39b0 con 0x7f0ed8142da0 2023-11-28T21:09:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ed6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ed81437f0 0x7f0ed806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ed6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ed81437f0 0x7f0ed806dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49832/0 (socket says 172.21.15.6:49832) 2023-11-28T21:09:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ed6d9d640 1 -- 172.21.15.6:0/2781495952 learned_addr learned my addr 172.21.15.6:0/2781495952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ecffff640 1 --2- 172.21.15.6:0/2781495952 >> v2:172.21.15.31:3300/0 conn(0x7f0ed815e7d0 0x7f0ed806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ed659c640 1 --2- 172.21.15.6:0/2781495952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed8142da0 0x7f0ed8071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ed6d9d640 1 -- 172.21.15.6:0/2781495952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed8142da0 msgr2=0x7f0ed8071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ed6d9d640 1 --2- 172.21.15.6:0/2781495952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed8142da0 0x7f0ed8071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ed6d9d640 1 -- 172.21.15.6:0/2781495952 >> v2:172.21.15.31:3300/0 conn(0x7f0ed815e7d0 msgr2=0x7f0ed806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ed6d9d640 1 --2- 172.21.15.6:0/2781495952 >> v2:172.21.15.31:3300/0 conn(0x7f0ed815e7d0 0x7f0ed806d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.182+0000 7f0ed6d9d640 1 -- 172.21.15.6:0/2781495952 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8143440 con 0x7f0ed81437f0 2023-11-28T21:09:14.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0ed6d9d640 1 --2- 172.21.15.6:0/2781495952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 0x7f0ed806dbc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0ed806b500 tx=0x7f0ed001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a740744e55ff14 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:14.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0ed5d9b640 1 -- 172.21.15.6:0/2781495952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed000b2d0 con 0x7f0ed81437f0 2023-11-28T21:09:14.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0ed5d9b640 1 -- 172.21.15.6:0/2781495952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed000b430 con 0x7f0ed81437f0 2023-11-28T21:09:14.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0ed5d9b640 1 -- 172.21.15.6:0/2781495952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00a7c50 con 0x7f0ed81437f0 2023-11-28T21:09:14.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 -- 172.21.15.6:0/2781495952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 msgr2=0x7f0ed806dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/2781495952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 0x7f0ed806dbc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0ed806b500 tx=0x7f0ed001eba0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 -- 172.21.15.6:0/2781495952 shutdown_connections 2023-11-28T21:09:14.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/2781495952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 0x7f0ed806dbc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/2781495952 >> v2:172.21.15.31:3300/0 conn(0x7f0ed815e7d0 0x7f0ed806d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/2781495952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed8142da0 0x7f0ed8071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 -- 172.21.15.6:0/2781495952 >> 172.21.15.6:0/2781495952 conn(0x7f0ed806ab80 msgr2=0x7f0ed80b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:14.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 -- 172.21.15.6:0/2781495952 shutdown_connections 2023-11-28T21:09:14.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 -- 172.21.15.6:0/2781495952 wait complete. 2023-11-28T21:09:14.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 Processor -- start 2023-11-28T21:09:14.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.186+0000 7f0edcfc4640 1 -- start start 2023-11-28T21:09:14.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0edcfc4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed8142da0 0x7f0ed813d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0edcfc4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 0x7f0ed8159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0edcfc4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed815e7d0 0x7f0ed815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0edcfc4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81598b0 con 0x7f0ed81437f0 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0edcfc4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed815b470 con 0x7f0ed8142da0 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0edcfc4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed815b710 con 0x7f0ed815e7d0 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 0x7f0ed8159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ecffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 0x7f0ed8159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49844/0 (socket says 172.21.15.6:49844) 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ecffff640 1 -- 172.21.15.6:0/1635159169 learned_addr learned my addr 172.21.15.6:0/1635159169 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ed6d9d640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed815e7d0 0x7f0ed815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ed659c640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed8142da0 0x7f0ed813d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ecffff640 1 -- 172.21.15.6:0/1635159169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed815e7d0 msgr2=0x7f0ed815af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ecffff640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed815e7d0 0x7f0ed815af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ecffff640 1 -- 172.21.15.6:0/1635159169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed8142da0 msgr2=0x7f0ed813d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ecffff640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed8142da0 0x7f0ed813d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ecffff640 1 -- 172.21.15.6:0/1635159169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed000bd40 con 0x7f0ed81437f0 2023-11-28T21:09:14.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ed659c640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed8142da0 0x7f0ed813d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:14.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0ecffff640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 0x7f0ed8159370 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000d5f0 tx=0x7f0ec000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:14.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0eceffd640 1 -- 172.21.15.6:0/1635159169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec00125f0 con 0x7f0ed81437f0 2023-11-28T21:09:14.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0eceffd640 1 -- 172.21.15.6:0/1635159169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec0012750 con 0x7f0ed81437f0 2023-11-28T21:09:14.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0eceffd640 1 -- 172.21.15.6:0/1635159169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0012ae0 con 0x7f0ed81437f0 2023-11-28T21:09:14.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed815b9f0 con 0x7f0ed81437f0 2023-11-28T21:09:14.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed815bfb0 con 0x7f0ed81437f0 2023-11-28T21:09:14.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.190+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed80674d0 con 0x7f0ed81437f0 2023-11-28T21:09:14.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.194+0000 7f0eceffd640 1 -- 172.21.15.6:0/1635159169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0ec0012c40 con 0x7f0ed81437f0 2023-11-28T21:09:14.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.194+0000 7f0eceffd640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0eb8066470 0x7f0eb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.194+0000 7f0eceffd640 1 -- 172.21.15.6:0/1635159169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ec00842d0 con 0x7f0ed81437f0 2023-11-28T21:09:14.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.194+0000 7f0ed659c640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0eb8066470 0x7f0eb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.194+0000 7f0ed659c640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0eb8066470 0x7f0eb8068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8004660 tx=0x7f0ec8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:14.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.198+0000 7f0eceffd640 1 -- 172.21.15.6:0/1635159169 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ec0051730 con 0x7f0ed81437f0 2023-11-28T21:09:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.354+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ed80b3010 con 0x7f0ed81437f0 2023-11-28T21:09:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0eceffd640 1 -- 172.21.15.6:0/1635159169 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f0ec0007380 con 0x7f0ed81437f0 2023-11-28T21:09:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:14.364 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:09:13.024099+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:09:10.815928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T21:09:12.024583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:09:14.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0eb8066470 msgr2=0x7f0eb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0eb8066470 0x7f0eb8068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8004660 tx=0x7f0ec8008040 comp rx=0 tx=0).stop 2023-11-28T21:09:14.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 msgr2=0x7f0ed8159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 0x7f0ed8159370 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000d5f0 tx=0x7f0ec000dab0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 shutdown_connections 2023-11-28T21:09:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0eb8066470 0x7f0eb8068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ed815e7d0 0x7f0ed815af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ed81437f0 0x7f0ed8159370 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 --2- 172.21.15.6:0/1635159169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ed8142da0 0x7f0ed813d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 >> 172.21.15.6:0/1635159169 conn(0x7f0ed806ab80 msgr2=0x7f0ed80713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 shutdown_connections 2023-11-28T21:09:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.358+0000 7f0edcfc4640 1 -- 172.21.15.6:0/1635159169 wait complete. 2023-11-28T21:09:14.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T21:09:14.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fbdc5a640 1 Processor -- start 2023-11-28T21:09:14.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fbdc5a640 1 -- start start 2023-11-28T21:09:14.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fbdc5a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80cbf40 0x7f4fb80ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fbdc5a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fb815e750 0x7f4fb815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fbdc5a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb815b510 con 0x7f4fb815e370 2023-11-28T21:09:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fbdc5a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb80cd730 con 0x7f4fb815e750 2023-11-28T21:09:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fbdc5a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb813d450 con 0x7f4fb80cbf40 2023-11-28T21:09:14.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fb7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fb815e750 0x7f4fb815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fb7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fb815e750 0x7f4fb815a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49846/0 (socket says 172.21.15.6:49846) 2023-11-28T21:09:14.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fb7fff640 1 -- 172.21.15.6:0/477042388 learned_addr learned my addr 172.21.15.6:0/477042388 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:14.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.526+0000 7f4fb6ffd640 1 --2- 172.21.15.6:0/477042388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80cbf40 0x7f4fb80ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fb7fff640 1 -- 172.21.15.6:0/477042388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80cbf40 msgr2=0x7f4fb80ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fb7fff640 1 --2- 172.21.15.6:0/477042388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80cbf40 0x7f4fb80ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fb7fff640 1 -- 172.21.15.6:0/477042388 >> v1:172.21.15.31:6789/0 conn(0x7f4fb815e370 legacy=0x7f4fb80cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fb7fff640 1 -- 172.21.15.6:0/477042388 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80cd940 con 0x7f4fb815e750 2023-11-28T21:09:14.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fb6ffd640 1 --2- 172.21.15.6:0/477042388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80cbf40 0x7f4fb80ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:14.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fb7fff640 1 --2- 172.21.15.6:0/477042388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 0x7f4fb815a7e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009e50 tx=0x7f4fb001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc02c71844b2eb38 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:14.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fb67fc640 1 -- 172.21.15.6:0/477042388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00a56d0 con 0x7f4fb815e750 2023-11-28T21:09:14.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fb67fc640 1 -- 172.21.15.6:0/477042388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb00a5830 con 0x7f4fb815e750 2023-11-28T21:09:14.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fb67fc640 1 -- 172.21.15.6:0/477042388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00a5bc0 con 0x7f4fb815e750 2023-11-28T21:09:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/477042388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 msgr2=0x7f4fb815a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fbdc5a640 1 --2- 172.21.15.6:0/477042388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 0x7f4fb815a7e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009e50 tx=0x7f4fb001ca10 comp rx=0 tx=0).stop 2023-11-28T21:09:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/477042388 shutdown_connections 2023-11-28T21:09:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fbdc5a640 1 --2- 172.21.15.6:0/477042388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 0x7f4fb815a7e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fbdc5a640 1 --2- 172.21.15.6:0/477042388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80cbf40 0x7f4fb80ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/477042388 >> 172.21.15.6:0/477042388 conn(0x7f4fb806a980 msgr2=0x7f4fb806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/477042388 shutdown_connections 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.530+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/477042388 wait complete. 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fbdc5a640 1 Processor -- start 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fbdc5a640 1 -- start start 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fbdc5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80cbf40 0x7f4fb814cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fbdc5a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb815e370 0x7f4fb80b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fbdc5a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 0x7f4fb812be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fbdc5a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80af7f0 con 0x7f4fb815e750 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fbdc5a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80afa60 con 0x7f4fb80cbf40 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fbdc5a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80afd40 con 0x7f4fb815e370 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 0x7f4fb812be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80cbf40 0x7f4fb814cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80cbf40 0x7f4fb814cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:52796/0 (socket says 172.21.15.6:52796) 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb77fe640 1 -- 172.21.15.6:0/1662619238 learned_addr learned my addr 172.21.15.6:0/1662619238 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb6ffd640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb815e370 0x7f4fb80b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb7fff640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 0x7f4fb812be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49850/0 (socket says 172.21.15.6:49850) 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb7fff640 1 -- 172.21.15.6:0/1662619238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb815e370 msgr2=0x7f4fb80b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb7fff640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb815e370 0x7f4fb80b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb7fff640 1 -- 172.21.15.6:0/1662619238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80cbf40 msgr2=0x7f4fb814cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb7fff640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80cbf40 0x7f4fb814cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb7fff640 1 -- 172.21.15.6:0/1662619238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0009b30 con 0x7f4fb815e750 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.534+0000 7f4fb7fff640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 0x7f4fb812be80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00ab000 tx=0x7f4fb00197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4f9ffff640 1 -- 172.21.15.6:0/1662619238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00be070 con 0x7f4fb815e750 2023-11-28T21:09:14.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4f9ffff640 1 -- 172.21.15.6:0/1662619238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0009510 con 0x7f4fb815e750 2023-11-28T21:09:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4f9ffff640 1 -- 172.21.15.6:0/1662619238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00b8640 con 0x7f4fb815e750 2023-11-28T21:09:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb80b0020 con 0x7f4fb815e750 2023-11-28T21:09:14.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb80b0d60 con 0x7f4fb815e750 2023-11-28T21:09:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb80b0f50 con 0x7f4fb815e750 2023-11-28T21:09:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4f9ffff640 1 -- 172.21.15.6:0/1662619238 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fb00b87a0 con 0x7f4fb815e750 2023-11-28T21:09:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4f9ffff640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa40664f0 0x7f4fa40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4f9ffff640 1 -- 172.21.15.6:0/1662619238 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fb011e660 con 0x7f4fb815e750 2023-11-28T21:09:14.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.538+0000 7f4fb77fe640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa40664f0 0x7f4fa40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:14.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.542+0000 7f4fb77fe640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa40664f0 0x7f4fa40689b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80018b0 tx=0x7f4fa8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:14.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.542+0000 7f4f9ffff640 1 -- 172.21.15.6:0/1662619238 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fb00ebb80 con 0x7f4fb815e750 2023-11-28T21:09:14.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:14.738+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4fb8072b90 con 0x7f4fb815e750 2023-11-28T21:09:15.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.662+0000 7f4f9ffff640 1 -- 172.21.15.6:0/1662619238 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4fb00ef1a0 con 0x7f4fb815e750 2023-11-28T21:09:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa40664f0 msgr2=0x7f4fa40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa40664f0 0x7f4fa40689b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80018b0 tx=0x7f4fa8009040 comp rx=0 tx=0).stop 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 msgr2=0x7f4fb812be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 0x7f4fb812be80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00ab000 tx=0x7f4fb00197b0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 shutdown_connections 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4fa40664f0 0x7f4fa40689b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb815e750 0x7f4fb812be80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb815e370 0x7f4fb80b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 --2- 172.21.15.6:0/1662619238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80cbf40 0x7f4fb814cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 >> 172.21.15.6:0/1662619238 conn(0x7f4fb806a980 msgr2=0x7f4fb80b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 shutdown_connections 2023-11-28T21:09:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.666+0000 7f4fbdc5a640 1 -- 172.21.15.6:0/1662619238 wait complete. 2023-11-28T21:09:15.697 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T21:09:15.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T21:09:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.842+0000 7fc885e17640 1 Processor -- start 2023-11-28T21:09:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.842+0000 7fc885e17640 1 -- start start 2023-11-28T21:09:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc885e17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc880143970 0x7fc88006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc885e17640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8800b4110 0x7fc88006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc885e17640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc88015da90 0x7fc88015df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc885e17640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88015e7e0 con 0x7fc8800b4110 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc885e17640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8800b30b0 con 0x7fc88015da90 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc885e17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800b3350 con 0x7fc880143970 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8800b4110 0x7fc88006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc8800b4110 0x7fc88006ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49852/0 (socket says 172.21.15.6:49852) 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87effd640 1 -- 172.21.15.6:0/3032840880 learned_addr learned my addr 172.21.15.6:0/3032840880 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87ffff640 1 --2- 172.21.15.6:0/3032840880 >> v2:172.21.15.31:3300/0 conn(0x7fc88015da90 0x7fc88015df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87f7fe640 1 --2- 172.21.15.6:0/3032840880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc880143970 0x7fc88006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87effd640 1 -- 172.21.15.6:0/3032840880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc880143970 msgr2=0x7fc88006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87effd640 1 --2- 172.21.15.6:0/3032840880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc880143970 0x7fc88006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87effd640 1 -- 172.21.15.6:0/3032840880 >> v2:172.21.15.31:3300/0 conn(0x7fc88015da90 msgr2=0x7fc88015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87effd640 1 --2- 172.21.15.6:0/3032840880 >> v2:172.21.15.31:3300/0 conn(0x7fc88015da90 0x7fc88015df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87effd640 1 -- 172.21.15.6:0/3032840880 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8800b3630 con 0x7fc8800b4110 2023-11-28T21:09:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87ffff640 1 --2- 172.21.15.6:0/3032840880 >> v2:172.21.15.31:3300/0 conn(0x7fc88015da90 0x7fc88015df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87effd640 1 --2- 172.21.15.6:0/3032840880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8800b4110 0x7fc88006ce90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc88006e880 tx=0x7fc87401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73673929ae18811d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87e7fc640 1 -- 172.21.15.6:0/3032840880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740aa5f0 con 0x7fc8800b4110 2023-11-28T21:09:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87e7fc640 1 -- 172.21.15.6:0/3032840880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8740aa750 con 0x7fc8800b4110 2023-11-28T21:09:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.846+0000 7fc87e7fc640 1 -- 172.21.15.6:0/3032840880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740aaae0 con 0x7fc8800b4110 2023-11-28T21:09:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 -- 172.21.15.6:0/3032840880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8800b4110 msgr2=0x7fc88006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 --2- 172.21.15.6:0/3032840880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8800b4110 0x7fc88006ce90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc88006e880 tx=0x7fc87401c4d0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 -- 172.21.15.6:0/3032840880 shutdown_connections 2023-11-28T21:09:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 --2- 172.21.15.6:0/3032840880 >> v2:172.21.15.31:3300/0 conn(0x7fc88015da90 0x7fc88015df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 --2- 172.21.15.6:0/3032840880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8800b4110 0x7fc88006ce90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 --2- 172.21.15.6:0/3032840880 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc880143970 0x7fc88006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 -- 172.21.15.6:0/3032840880 >> 172.21.15.6:0/3032840880 conn(0x7fc88006a980 msgr2=0x7fc88006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 -- 172.21.15.6:0/3032840880 shutdown_connections 2023-11-28T21:09:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 -- 172.21.15.6:0/3032840880 wait complete. 2023-11-28T21:09:15.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 Processor -- start 2023-11-28T21:09:15.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 -- start start 2023-11-28T21:09:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8800b4110 0x7fc880156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:15.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880143970 0x7fc8801f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015da90 0x7fc880141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8801577a0 con 0x7fc880143970 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8801f9eb0 con 0x7fc8800b4110 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc885e17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc880156c20 con 0x7fc88015da90 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc87effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880143970 0x7fc8801f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc87effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880143970 0x7fc8801f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49858/0 (socket says 172.21.15.6:49858) 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc87effd640 1 -- 172.21.15.6:0/2119586901 learned_addr learned my addr 172.21.15.6:0/2119586901 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc87f7fe640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8800b4110 0x7fc880156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.850+0000 7fc87ffff640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015da90 0x7fc880141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc87effd640 1 -- 172.21.15.6:0/2119586901 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015da90 msgr2=0x7fc880141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc87effd640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015da90 0x7fc880141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc87effd640 1 -- 172.21.15.6:0/2119586901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8800b4110 msgr2=0x7fc880156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:15.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc87effd640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8800b4110 0x7fc880156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc87effd640 1 -- 172.21.15.6:0/2119586901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740094d0 con 0x7fc880143970 2023-11-28T21:09:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc87effd640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880143970 0x7fc8801f9970 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc87401ab80 tx=0x7fc87401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc867fff640 1 -- 172.21.15.6:0/2119586901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740aa5f0 con 0x7fc880143970 2023-11-28T21:09:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc867fff640 1 -- 172.21.15.6:0/2119586901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8740b3800 con 0x7fc880143970 2023-11-28T21:09:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc867fff640 1 -- 172.21.15.6:0/2119586901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740b3bb0 con 0x7fc880143970 2023-11-28T21:09:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc880156f00 con 0x7fc880143970 2023-11-28T21:09:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8801574c0 con 0x7fc880143970 2023-11-28T21:09:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc880072b90 con 0x7fc880143970 2023-11-28T21:09:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc867fff640 1 -- 172.21.15.6:0/2119586901 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc8740b3d10 con 0x7fc880143970 2023-11-28T21:09:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc867fff640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc86c066470 0x7fc86c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc867fff640 1 -- 172.21.15.6:0/2119586901 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8740a7070 con 0x7fc880143970 2023-11-28T21:09:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.854+0000 7fc87f7fe640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc86c066470 0x7fc86c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.858+0000 7fc87f7fe640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc86c066470 0x7fc86c068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc87000ba30 tx=0x7fc870008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:15.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:15.858+0000 7fc867fff640 1 -- 172.21.15.6:0/2119586901 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc8740eb8f0 con 0x7fc880143970 2023-11-28T21:09:16.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.054+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc8800ce780 con 0x7fc880143970 2023-11-28T21:09:16.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.670+0000 7fc867fff640 1 -- 172.21.15.6:0/2119586901 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc8740eef10 con 0x7fc880143970 2023-11-28T21:09:16.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc86c066470 msgr2=0x7fc86c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:16.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc86c066470 0x7fc86c068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc87000ba30 tx=0x7fc870008040 comp rx=0 tx=0).stop 2023-11-28T21:09:16.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880143970 msgr2=0x7fc8801f9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880143970 0x7fc8801f9970 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc87401ab80 tx=0x7fc87401ad10 comp rx=0 tx=0).stop 2023-11-28T21:09:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 shutdown_connections 2023-11-28T21:09:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc86c066470 0x7fc86c068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc88015da90 0x7fc880141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880143970 0x7fc8801f9970 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 --2- 172.21.15.6:0/2119586901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8800b4110 0x7fc880156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 >> 172.21.15.6:0/2119586901 conn(0x7fc88006a980 msgr2=0x7fc880142bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 shutdown_connections 2023-11-28T21:09:16.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.674+0000 7fc885e17640 1 -- 172.21.15.6:0/2119586901 wait complete. 2023-11-28T21:09:16.703 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T21:09:16.703 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:09:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9cd209640 1 Processor -- start 2023-11-28T21:09:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9cd209640 1 -- start start 2023-11-28T21:09:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9cd209640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9c80d1990 0x7ff9c80cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9cd209640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80d0180 0x7ff9c80ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9cd209640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c80d3f30 con 0x7ff9c8160a20 2023-11-28T21:09:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9cd209640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c80d1e20 con 0x7ff9c80d1990 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9cd209640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80d38e0 con 0x7ff9c80d0180 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff9c8160a20 0x7ff9c80cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37188/0 (socket says 172.21.15.6:37188) 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c7fff640 1 -- 172.21.15.6:0/3282976917 learned_addr learned my addr 172.21.15.6:0/3282976917 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9cca08640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80d0180 0x7ff9c80ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c77fe640 1 --2- 172.21.15.6:0/3282976917 >> v2:172.21.15.31:3300/0 conn(0x7ff9c80d1990 0x7ff9c80cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754271486 0 0) 0x7ff9c80d3f30 con 0x7ff9c8160a20 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b0003530 con 0x7ff9c8160a20 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3023380813 0 0) 0x7ff9b0003530 con 0x7ff9c8160a20 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80d0180 msgr2=0x7ff9c80ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80d0180 0x7ff9c80ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 >> v2:172.21.15.31:3300/0 conn(0x7ff9c80d1990 msgr2=0x7ff9c80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 --2- 172.21.15.6:0/3282976917 >> v2:172.21.15.31:3300/0 conn(0x7ff9c80d1990 0x7ff9c80cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80d3bc0 con 0x7ff9c8160a20 2023-11-28T21:09:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7ff9b8001680 con 0x7ff9c8160a20 2023-11-28T21:09:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 >> v1:172.21.15.6:6789/0 conn(0x7ff9c8160a20 legacy=0x7ff9c80cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80d0180 0x7ff9b00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b0004d10 0x7ff9b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80d1e20 con 0x7ff9b0003fc0 2023-11-28T21:09:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80d38e0 con 0x7ff9b0004d10 2023-11-28T21:09:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b000ba90 con 0x7ff9c80d0180 2023-11-28T21:09:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c77fe640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9cca08640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b0004d10 0x7ff9b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c7fff640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80d0180 0x7ff9b00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c77fe640 1 -- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80d0180 msgr2=0x7ff9b00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c77fe640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80d0180 0x7ff9b00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c77fe640 1 -- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b0004d10 msgr2=0x7ff9b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c77fe640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b0004d10 0x7ff9b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.846+0000 7ff9c77fe640 1 -- 172.21.15.6:0/3282976917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0003530 con 0x7ff9b0003fc0 2023-11-28T21:09:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9c77fe640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9b00047d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009ae0 tx=0x7ff9bc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c61c2dadaf91521 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0ab3f0 con 0x7ff9b0003fc0 2023-11-28T21:09:16.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0ab550 con 0x7ff9b0003fc0 2023-11-28T21:09:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9c6ffd640 1 -- 172.21.15.6:0/3282976917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0ab900 con 0x7ff9b0003fc0 2023-11-28T21:09:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9cd209640 1 -- 172.21.15.6:0/3282976917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 msgr2=0x7ff9b00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9cd209640 1 --2- 172.21.15.6:0/3282976917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9b00047d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009ae0 tx=0x7ff9bc01ca90 comp rx=0 tx=0).stop 2023-11-28T21:09:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9cca08640 1 -- 172.21.15.6:0/3282976917 reap_dead start 2023-11-28T21:09:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9cd209640 1 -- 172.21.15.6:0/3282976917 shutdown_connections 2023-11-28T21:09:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9cd209640 1 -- 172.21.15.6:0/3282976917 >> 172.21.15.6:0/3282976917 conn(0x7ff9c809c3d0 msgr2=0x7ff9c80d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9cd209640 1 -- 172.21.15.6:0/3282976917 shutdown_connections 2023-11-28T21:09:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.850+0000 7ff9cd209640 1 -- 172.21.15.6:0/3282976917 wait complete. 2023-11-28T21:09:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 Processor -- start 2023-11-28T21:09:16.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 -- start start 2023-11-28T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9c8150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80b0c20 0x7ff9c80b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9c815cd20 0x7ff9c815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c815d6e0 con 0x7ff9b0003fc0 2023-11-28T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80b2360 con 0x7ff9c815cd20 2023-11-28T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80b1750 con 0x7ff9c80b0c20 2023-11-28T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9c8150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9c8150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49878/0 (socket says 172.21.15.6:49878) 2023-11-28T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c7fff640 1 -- 172.21.15.6:0/1802607665 learned_addr learned my addr 172.21.15.6:0/1802607665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c77fe640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80b0c20 0x7ff9c80b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cca08640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9c815cd20 0x7ff9c815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c7fff640 1 -- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80b0c20 msgr2=0x7ff9c80b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c7fff640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80b0c20 0x7ff9c80b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c7fff640 1 -- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9c815cd20 msgr2=0x7ff9c815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c7fff640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9c815cd20 0x7ff9c815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c7fff640 1 -- 172.21.15.6:0/1802607665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80b1a30 con 0x7ff9b0003fc0 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c77fe640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80b0c20 0x7ff9c80b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cca08640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9c815cd20 0x7ff9c815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c7fff640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9c8150490 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8004f80 tx=0x7ff9b80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:16.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c4ff9640 1 -- 172.21.15.6:0/1802607665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800f750 con 0x7ff9b0003fc0 2023-11-28T21:09:16.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c4ff9640 1 -- 172.21.15.6:0/1802607665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b800f910 con 0x7ff9b0003fc0 2023-11-28T21:09:16.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c80b1d10 con 0x7ff9b0003fc0 2023-11-28T21:09:16.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9c4ff9640 1 -- 172.21.15.6:0/1802607665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800fcc0 con 0x7ff9b0003fc0 2023-11-28T21:09:16.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.854+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c81509d0 con 0x7ff9b0003fc0 2023-11-28T21:09:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.858+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c80a10b0 con 0x7ff9b0003fc0 2023-11-28T21:09:16.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.858+0000 7ff9c4ff9640 1 -- 172.21.15.6:0/1802607665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9b801d460 con 0x7ff9b0003fc0 2023-11-28T21:09:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.858+0000 7ff9c4ff9640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff9b40664a0 0x7ff9b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.858+0000 7ff9c4ff9640 1 -- 172.21.15.6:0/1802607665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9b8083fb0 con 0x7ff9b0003fc0 2023-11-28T21:09:16.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.858+0000 7ff9c77fe640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff9b40664a0 0x7ff9b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:16.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.858+0000 7ff9c77fe640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff9b40664a0 0x7ff9b4068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0af000 tx=0x7ff9bc0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:16.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:16.862+0000 7ff9c4ff9640 1 -- 172.21.15.6:0/1802607665 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9b8051390 con 0x7ff9b0003fc0 2023-11-28T21:09:17.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.054+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9c80b26f0 con 0x7ff9b0003fc0 2023-11-28T21:09:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.054+0000 7ff9c4ff9640 1 -- 172.21.15.6:0/1802607665 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4901 (secure 0 0 0) 0x7ff9b80549b0 con 0x7ff9b0003fc0 2023-11-28T21:09:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:17.062 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1525667557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1525667557},{"type":"v1","addr":"172.21.15.31:6834","nonce":1525667557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/71303197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":71303197},{"type":"v1","addr":"172.21.15.31:6835","nonce":71303197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/4130466882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":4130466882},{"type":"v1","addr":"172.21.15.6:6837","nonce":4130466882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:09:13.024455+0000","modified":"2023-11-28T21:09:16.059795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5190":{"gid":5190,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2805255705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2805255705},{"type":"v1","addr":"172.21.15.6:6835","nonce":2805255705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T21:09:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-11-28T21:09:17.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff9b40664a0 msgr2=0x7ff9b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff9b40664a0 0x7ff9b4068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0af000 tx=0x7ff9bc0046d0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 msgr2=0x7ff9c8150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9c8150490 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8004f80 tx=0x7ff9b80074f0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 shutdown_connections 2023-11-28T21:09:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff9b40664a0 0x7ff9b4068960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9c815cd20 0x7ff9c815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9c80b0c20 0x7ff9c80b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 --2- 172.21.15.6:0/1802607665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b0003fc0 0x7ff9c8150490 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 >> 172.21.15.6:0/1802607665 conn(0x7ff9c809c3d0 msgr2=0x7ff9c806c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 shutdown_connections 2023-11-28T21:09:17.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.058+0000 7ff9cd209640 1 -- 172.21.15.6:0/1802607665 wait complete. 2023-11-28T21:09:17.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T21:09:17.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.218+0000 7f005585a640 1 Processor -- start 2023-11-28T21:09:17.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.218+0000 7f005585a640 1 -- start start 2023-11-28T21:09:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f005585a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f005013cf90 0x7f00500cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f005585a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f005013fcb0 0x7f0050070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f005585a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00500ce0a0 con 0x7f00500cdb70 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f005585a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00500ce380 con 0x7f005013cf90 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f005585a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00500ce660 con 0x7f005013fcb0 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f005013cf90 0x7f00500cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f005013cf90 0x7f00500cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49890/0 (socket says 172.21.15.6:49890) 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004effd640 1 -- 172.21.15.6:0/3652083806 learned_addr learned my addr 172.21.15.6:0/3652083806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004f7fe640 1 --2- 172.21.15.6:0/3652083806 >> v2:172.21.15.31:3300/0 conn(0x7f005013fcb0 0x7f0050070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004effd640 1 -- 172.21.15.6:0/3652083806 >> v2:172.21.15.31:3300/0 conn(0x7f005013fcb0 msgr2=0x7f0050070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004effd640 1 --2- 172.21.15.6:0/3652083806 >> v2:172.21.15.31:3300/0 conn(0x7f005013fcb0 0x7f0050070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004effd640 1 -- 172.21.15.6:0/3652083806 >> v1:172.21.15.31:6789/0 conn(0x7f00500cdb70 legacy=0x7f005013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004effd640 1 -- 172.21.15.6:0/3652083806 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500ce940 con 0x7f005013cf90 2023-11-28T21:09:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004f7fe640 1 --2- 172.21.15.6:0/3652083806 >> v2:172.21.15.31:3300/0 conn(0x7f005013fcb0 0x7f0050070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.222+0000 7f004effd640 1 --2- 172.21.15.6:0/3652083806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f005013cf90 0x7f00500cd630 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f005006e860 tx=0x7f004001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9315802204cad23e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f004e7fc640 1 -- 172.21.15.6:0/3652083806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00400aa640 con 0x7f005013cf90 2023-11-28T21:09:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f004e7fc640 1 -- 172.21.15.6:0/3652083806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00400aa7a0 con 0x7f005013cf90 2023-11-28T21:09:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f004e7fc640 1 -- 172.21.15.6:0/3652083806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00400aab30 con 0x7f005013cf90 2023-11-28T21:09:17.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 -- 172.21.15.6:0/3652083806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f005013cf90 msgr2=0x7f00500cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 --2- 172.21.15.6:0/3652083806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f005013cf90 0x7f00500cd630 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f005006e860 tx=0x7f004001c4c0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 -- 172.21.15.6:0/3652083806 shutdown_connections 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 --2- 172.21.15.6:0/3652083806 >> v2:172.21.15.31:3300/0 conn(0x7f005013fcb0 0x7f0050070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 --2- 172.21.15.6:0/3652083806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f005013cf90 0x7f00500cd630 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 -- 172.21.15.6:0/3652083806 >> 172.21.15.6:0/3652083806 conn(0x7f005006a750 msgr2=0x7f005006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 -- 172.21.15.6:0/3652083806 shutdown_connections 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 -- 172.21.15.6:0/3652083806 wait complete. 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 Processor -- start 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 -- start start 2023-11-28T21:09:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00500cdb70 0x7f005014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005013cf90 0x7f0050136f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005013fcb0 0x7f00501374b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00501500a0 con 0x7f00500cdb70 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00501529d0 con 0x7f005013fcb0 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f005585a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00501539a0 con 0x7f005013cf90 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f004effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00500cdb70 0x7f005014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f004effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00500cdb70 0x7f005014fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49906/0 (socket says 172.21.15.6:49906) 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.226+0000 7f004effd640 1 -- 172.21.15.6:0/1774268320 learned_addr learned my addr 172.21.15.6:0/1774268320 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004f7fe640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005013fcb0 0x7f00501374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f0047fff640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005013cf90 0x7f0050136f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004effd640 1 -- 172.21.15.6:0/1774268320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005013cf90 msgr2=0x7f0050136f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004effd640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005013cf90 0x7f0050136f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004effd640 1 -- 172.21.15.6:0/1774268320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005013fcb0 msgr2=0x7f00501374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004effd640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005013fcb0 0x7f00501374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004effd640 1 -- 172.21.15.6:0/1774268320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400094d0 con 0x7f00500cdb70 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004effd640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00500cdb70 0x7f005014fb60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f004001c9a0 tx=0x7f004001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004cff9640 1 -- 172.21.15.6:0/1774268320 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00400aa640 con 0x7f00500cdb70 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004cff9640 1 -- 172.21.15.6:0/1774268320 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00400b3820 con 0x7f00500cdb70 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0050152be0 con 0x7f00500cdb70 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004cff9640 1 -- 172.21.15.6:0/1774268320 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00400b3bd0 con 0x7f00500cdb70 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00501531a0 con 0x7f00500cdb70 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005004e8c0 con 0x7f00500cdb70 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004cff9640 1 -- 172.21.15.6:0/1774268320 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00400a8050 con 0x7f00500cdb70 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.230+0000 7f004cff9640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f00300664a0 0x7f0030068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.234+0000 7f004cff9640 1 -- 172.21.15.6:0/1774268320 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f004011e1d0 con 0x7f00500cdb70 2023-11-28T21:09:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.234+0000 7f0047fff640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f00300664a0 0x7f0030068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.234+0000 7f0047fff640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f00300664a0 0x7f0030068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f005013b550 tx=0x7f0038009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.234+0000 7f004cff9640 1 -- 172.21.15.6:0/1774268320 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00400eb5b0 con 0x7f00500cdb70 2023-11-28T21:09:17.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.398+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f005006dee0 con 0x7f00500cdb70 2023-11-28T21:09:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.398+0000 7f004cff9640 1 -- 172.21.15.6:0/1774268320 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f00400eebd0 con 0x7f00500cdb70 2023-11-28T21:09:17.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:17.405 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:09:14.652293+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:09:10.815928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T21:09:12.024583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T21:09:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f00300664a0 msgr2=0x7f0030068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f00300664a0 0x7f0030068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f005013b550 tx=0x7f0038009040 comp rx=0 tx=0).stop 2023-11-28T21:09:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00500cdb70 msgr2=0x7f005014fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00500cdb70 0x7f005014fb60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f004001c9a0 tx=0x7f004001ad00 comp rx=0 tx=0).stop 2023-11-28T21:09:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 shutdown_connections 2023-11-28T21:09:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f00300664a0 0x7f0030068960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005013fcb0 0x7f00501374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f005013cf90 0x7f0050136f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 --2- 172.21.15.6:0/1774268320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00500cdb70 0x7f005014fb60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 >> 172.21.15.6:0/1774268320 conn(0x7f005006a750 msgr2=0x7f00501595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 shutdown_connections 2023-11-28T21:09:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.402+0000 7f005585a640 1 -- 172.21.15.6:0/1774268320 wait complete. 2023-11-28T21:09:17.427 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T21:09:17.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:09:17.555 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-28T21:09:17.550+0000 7f18233d5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T21:09:17.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47d5357640 1 Processor -- start 2023-11-28T21:09:17.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47d5357640 1 -- start start 2023-11-28T21:09:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47d5357640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f47d0142da0 0x7f47d0071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47d5357640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 0x7f47d00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47d5357640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d015e340 con 0x7f47d015e7d0 2023-11-28T21:09:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47d5357640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d015dae0 con 0x7f47d0142da0 2023-11-28T21:09:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47d5357640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d00b39b0 con 0x7f47d006dd90 2023-11-28T21:09:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47c7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f47d015e7d0 0x7f47d006d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37194/0 (socket says 172.21.15.6:37194) 2023-11-28T21:09:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47c7fff640 1 -- 172.21.15.6:0/3996481201 learned_addr learned my addr 172.21.15.6:0/3996481201 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47ceffd640 1 --2- 172.21.15.6:0/3996481201 >> v2:172.21.15.31:3300/0 conn(0x7f47d0142da0 0x7f47d0071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47cf7fe640 1 --2- 172.21.15.6:0/3996481201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 0x7f47d00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47ce7fc640 1 -- 172.21.15.6:0/3996481201 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808274765 0 0) 0x7f47d015e340 con 0x7f47d015e7d0 2023-11-28T21:09:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47ce7fc640 1 -- 172.21.15.6:0/3996481201 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47bc003530 con 0x7f47d015e7d0 2023-11-28T21:09:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47ceffd640 1 -- 172.21.15.6:0/3996481201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 msgr2=0x7f47d00b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47ceffd640 1 --2- 172.21.15.6:0/3996481201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 0x7f47d00b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47ceffd640 1 -- 172.21.15.6:0/3996481201 >> v1:172.21.15.6:6789/0 conn(0x7f47d015e7d0 legacy=0x7f47d006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47ce7fc640 1 -- 172.21.15.6:0/3996481201 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 272726843 0 0) 0x7f47bc003530 con 0x7f47d015e7d0 2023-11-28T21:09:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47ceffd640 1 -- 172.21.15.6:0/3996481201 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d0143440 con 0x7f47d0142da0 2023-11-28T21:09:17.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.566+0000 7f47cf7fe640 1 --2- 172.21.15.6:0/3996481201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 0x7f47d00b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:09:17.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47ceffd640 1 --2- 172.21.15.6:0/3996481201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d0142da0 0x7f47d0071fb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47c00097c0 tx=0x7f47c001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73d1d303d9a3ca34 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:17.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47ce7fc640 1 -- 172.21.15.6:0/3996481201 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8001680 con 0x7f47d0142da0 2023-11-28T21:09:17.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47ce7fc640 1 -- 172.21.15.6:0/3996481201 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c00a7050 con 0x7f47d0142da0 2023-11-28T21:09:17.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47ce7fc640 1 -- 172.21.15.6:0/3996481201 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c00ab620 con 0x7f47d0142da0 2023-11-28T21:09:17.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47d5357640 1 -- 172.21.15.6:0/3996481201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d0142da0 msgr2=0x7f47d0071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47d5357640 1 --2- 172.21.15.6:0/3996481201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d0142da0 0x7f47d0071fb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47c00097c0 tx=0x7f47c001c370 comp rx=0 tx=0).stop 2023-11-28T21:09:17.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47d5357640 1 -- 172.21.15.6:0/3996481201 shutdown_connections 2023-11-28T21:09:17.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47d5357640 1 --2- 172.21.15.6:0/3996481201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 0x7f47d00b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47d5357640 1 --2- 172.21.15.6:0/3996481201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d0142da0 0x7f47d0071fb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47d5357640 1 -- 172.21.15.6:0/3996481201 >> 172.21.15.6:0/3996481201 conn(0x7f47d006ab80 msgr2=0x7f47d00b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:17.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47d5357640 1 -- 172.21.15.6:0/3996481201 shutdown_connections 2023-11-28T21:09:17.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.570+0000 7f47d5357640 1 -- 172.21.15.6:0/3996481201 wait complete. 2023-11-28T21:09:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 Processor -- start 2023-11-28T21:09:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 -- start start 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 0x7f47d01388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47d0142da0 0x7f47d00cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d015e7d0 0x7f47d015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d015ce60 con 0x7f47d0142da0 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d015d0b0 con 0x7f47d015e7d0 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d015d390 con 0x7f47d006dd90 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47d0142da0 0x7f47d00cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47d0142da0 0x7f47d00cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49918/0 (socket says 172.21.15.6:49918) 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c7fff640 1 -- 172.21.15.6:0/2612069853 learned_addr learned my addr 172.21.15.6:0/2612069853 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47ceffd640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 0x7f47d01388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47cf7fe640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d015e7d0 0x7f47d015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c7fff640 1 -- 172.21.15.6:0/2612069853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 msgr2=0x7f47d01388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c7fff640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 0x7f47d01388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c7fff640 1 -- 172.21.15.6:0/2612069853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d015e7d0 msgr2=0x7f47d015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c7fff640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d015e7d0 0x7f47d015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c7fff640 1 -- 172.21.15.6:0/2612069853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c8009a70 con 0x7f47d0142da0 2023-11-28T21:09:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c7fff640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47d0142da0 0x7f47d00cc760 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c750 tx=0x7f47b800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c77fe640 1 -- 172.21.15.6:0/2612069853 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8005ae0 con 0x7f47d0142da0 2023-11-28T21:09:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c77fe640 1 -- 172.21.15.6:0/2612069853 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b800ce90 con 0x7f47d0142da0 2023-11-28T21:09:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47c77fe640 1 -- 172.21.15.6:0/2612069853 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8007070 con 0x7f47d0142da0 2023-11-28T21:09:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c0009420 con 0x7f47d0142da0 2023-11-28T21:09:17.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.574+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d015a8a0 con 0x7f47d0142da0 2023-11-28T21:09:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.578+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d00674d0 con 0x7f47d0142da0 2023-11-28T21:09:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.578+0000 7f47c77fe640 1 -- 172.21.15.6:0/2612069853 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f47b80071d0 con 0x7f47d0142da0 2023-11-28T21:09:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.578+0000 7f47c77fe640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47b0066470 0x7f47b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.578+0000 7f47c77fe640 1 -- 172.21.15.6:0/2612069853 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47b80839b0 con 0x7f47d0142da0 2023-11-28T21:09:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.578+0000 7f47ceffd640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47b0066470 0x7f47b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.578+0000 7f47ceffd640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47b0066470 0x7f47b0068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f47c00ad000 tx=0x7f47c00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.582+0000 7f47c77fe640 1 -- 172.21.15.6:0/2612069853 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47b8050e20 con 0x7f47d0142da0 2023-11-28T21:09:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.738+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47d00b3010 con 0x7f47b0066470 2023-11-28T21:09:17.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.746+0000 7f47c77fe640 1 -- 172.21.15.6:0/2612069853 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281026 (secure 0 0 0) 0x7f47d00b3010 con 0x7f47b0066470 2023-11-28T21:09:17.757 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:17.758 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-28T21:09:17.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47b0066470 msgr2=0x7f47b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47b0066470 0x7f47b0068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f47c00ad000 tx=0x7f47c00a6000 comp rx=0 tx=0).stop 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47d0142da0 msgr2=0x7f47d00cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47d0142da0 0x7f47d00cc760 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c750 tx=0x7f47b800cb50 comp rx=0 tx=0).stop 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 shutdown_connections 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f47b0066470 0x7f47b0068930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47d015e7d0 0x7f47d015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47d0142da0 0x7f47d00cc760 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 --2- 172.21.15.6:0/2612069853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47d006dd90 0x7f47d01388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 >> 172.21.15.6:0/2612069853 conn(0x7f47d006ab80 msgr2=0x7f47d0141050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 shutdown_connections 2023-11-28T21:09:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.750+0000 7f47d5357640 1 -- 172.21.15.6:0/2612069853 wait complete. 2023-11-28T21:09:17.778 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-28T21:09:16.670325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":150,"acting":150,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219968,"kb_used_data":3792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754752,"statfs":{"total":773094113280,"available":772868866048,"internally_reserved":0,"allocated":3883008,"data_stored":2197928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.052024"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.631470+0000","last_change":"2023-11-28T21:09:12.631470+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.631470+0000","last_undegraded":"2023-11-28T21:09:12.631470+0000","last_fullsized":"2023-11-28T21:09:12.631470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.634341+0000","last_change":"2023-11-28T21:09:12.634341+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.634341+0000","last_undegraded":"2023-11-28T21:09:12.634341+0000","last_fullsized":"2023-11-28T21:09:12.634341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.643146+0000","last_change":"2023-11-28T21:09:12.643146+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.643146+0000","last_undegraded":"2023-11-28T21:09:12.643146+0000","last_fullsized":"2023-11-28T21:09:12.643146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638249+0000","last_change":"2023-11-28T21:09:12.638249+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638249+0000","last_undegraded":"2023-11-28T21:09:12.638249+0000","last_fullsized":"2023-11-28T21:09:12.638249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638633+0000","last_change":"2023-11-28T21:09:12.638633+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638633+0000","last_undegraded":"2023-11-28T21:09:12.638633+0000","last_fullsized":"2023-11-28T21:09:12.638633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627992+0000","last_change":"2023-11-28T21:09:12.627992+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627992+0000","last_undegraded":"2023-11-28T21:09:12.627992+0000","last_fullsized":"2023-11-28T21:09:12.627992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636633+0000","last_change":"2023-11-28T21:09:12.636633+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636633+0000","last_undegraded":"2023-11-28T21:09:12.636633+0000","last_fullsized":"2023-11-28T21:09:12.636633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636124+0000","last_change":"2023-11-28T21:09:12.636124+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636124+0000","last_undegraded":"2023-11-28T21:09:12.636124+0000","last_fullsized":"2023-11-28T21:09:12.636124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.642661+0000","last_change":"2023-11-28T21:09:12.642661+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.642661+0000","last_undegraded":"2023-11-28T21:09:12.642661+0000","last_fullsized":"2023-11-28T21:09:12.642661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.633483+0000","last_change":"2023-11-28T21:09:12.633483+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.633483+0000","last_undegraded":"2023-11-28T21:09:12.633483+0000","last_fullsized":"2023-11-28T21:09:12.633483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636495+0000","last_change":"2023-11-28T21:09:12.636495+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636495+0000","last_undegraded":"2023-11-28T21:09:12.636495+0000","last_fullsized":"2023-11-28T21:09:12.636495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636252+0000","last_change":"2023-11-28T21:09:12.636252+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636252+0000","last_undegraded":"2023-11-28T21:09:12.636252+0000","last_fullsized":"2023-11-28T21:09:12.636252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.641316+0000","last_change":"2023-11-28T21:09:12.641316+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.641316+0000","last_undegraded":"2023-11-28T21:09:12.641316+0000","last_fullsized":"2023-11-28T21:09:12.641316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627117+0000","last_change":"2023-11-28T21:09:12.627117+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627117+0000","last_undegraded":"2023-11-28T21:09:12.627117+0000","last_fullsized":"2023-11-28T21:09:12.627117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627814+0000","last_change":"2023-11-28T21:09:12.627814+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627814+0000","last_undegraded":"2023-11-28T21:09:12.627814+0000","last_fullsized":"2023-11-28T21:09:12.627814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.633262+0000","last_change":"2023-11-28T21:09:12.633262+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.633262+0000","last_undegraded":"2023-11-28T21:09:12.633262+0000","last_fullsized":"2023-11-28T21:09:12.633262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.635679+0000","last_change":"2023-11-28T21:09:12.635679+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.635679+0000","last_undegraded":"2023-11-28T21:09:12.635679+0000","last_fullsized":"2023-11-28T21:09:12.635679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.626518+0000","last_change":"2023-11-28T21:09:12.626518+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.626518+0000","last_undegraded":"2023-11-28T21:09:12.626518+0000","last_fullsized":"2023-11-28T21:09:12.626518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638016+0000","last_change":"2023-11-28T21:09:12.638016+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638016+0000","last_undegraded":"2023-11-28T21:09:12.638016+0000","last_fullsized":"2023-11-28T21:09:12.638016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.631066+0000","last_change":"2023-11-28T21:09:12.631066+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.631066+0000","last_undegraded":"2023-11-28T21:09:12.631066+0000","last_fullsized":"2023-11-28T21:09:12.631066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638046+0000","last_change":"2023-11-28T21:09:12.638046+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638046+0000","last_undegraded":"2023-11-28T21:09:12.638046+0000","last_fullsized":"2023-11-28T21:09:12.638046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.651714+0000","last_change":"2023-11-28T21:09:12.649448+0000","last_active":"2023-11-28T21:09:12.651714+0000","last_peered":"2023-11-28T21:09:12.651714+0000","last_clean":"2023-11-28T21:09:12.651714+0000","last_became_active":"2023-11-28T21:09:12.649106+0000","last_became_peered":"2023-11-28T21:09:12.649106+0000","last_unstale":"2023-11-28T21:09:12.651714+0000","last_undegraded":"2023-11-28T21:09:12.651714+0000","last_fullsized":"2023-11-28T21:09:12.651714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:01:10.139438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.630491+0000","last_change":"2023-11-28T21:09:12.630491+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.630491+0000","last_undegraded":"2023-11-28T21:09:12.630491+0000","last_fullsized":"2023-11-28T21:09:12.630491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627013+0000","last_change":"2023-11-28T21:09:11.627013+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627013+0000","last_undegraded":"2023-11-28T21:09:11.627013+0000","last_fullsized":"2023-11-28T21:09:11.627013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.628323+0000","last_change":"2023-11-28T21:09:12.628323+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.628323+0000","last_undegraded":"2023-11-28T21:09:12.628323+0000","last_fullsized":"2023-11-28T21:09:12.628323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.625558+0000","last_change":"2023-11-28T21:09:11.625558+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.625558+0000","last_undegraded":"2023-11-28T21:09:11.625558+0000","last_fullsized":"2023-11-28T21:09:11.625558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.655585+0000","last_change":"2023-11-28T21:09:12.651372+0000","last_active":"2023-11-28T21:09:12.655585+0000","last_peered":"2023-11-28T21:09:12.655585+0000","last_clean":"2023-11-28T21:09:12.655585+0000","last_became_active":"2023-11-28T21:09:12.651014+0000","last_became_peered":"2023-11-28T21:09:12.651014+0000","last_unstale":"2023-11-28T21:09:12.655585+0000","last_undegraded":"2023-11-28T21:09:12.655585+0000","last_fullsized":"2023-11-28T21:09:12.655585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:46.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636173+0000","last_change":"2023-11-28T21:09:12.636173+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636173+0000","last_undegraded":"2023-11-28T21:09:12.636173+0000","last_fullsized":"2023-11-28T21:09:12.636173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.663791+0000","last_change":"2023-11-28T21:09:12.658946+0000","last_active":"2023-11-28T21:09:12.663791+0000","last_peered":"2023-11-28T21:09:12.663791+0000","last_clean":"2023-11-28T21:09:12.663791+0000","last_became_active":"2023-11-28T21:09:12.658480+0000","last_became_peered":"2023-11-28T21:09:12.658480+0000","last_unstale":"2023-11-28T21:09:12.663791+0000","last_undegraded":"2023-11-28T21:09:12.663791+0000","last_fullsized":"2023-11-28T21:09:12.663791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:38.368381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.640014+0000","last_change":"2023-11-28T21:09:12.640014+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.640014+0000","last_undegraded":"2023-11-28T21:09:12.640014+0000","last_fullsized":"2023-11-28T21:09:12.640014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.662962+0000","last_change":"2023-11-28T21:09:12.656711+0000","last_active":"2023-11-28T21:09:12.662962+0000","last_peered":"2023-11-28T21:09:12.662962+0000","last_clean":"2023-11-28T21:09:12.662962+0000","last_became_active":"2023-11-28T21:09:12.656379+0000","last_became_peered":"2023-11-28T21:09:12.656379+0000","last_unstale":"2023-11-28T21:09:12.662962+0000","last_undegraded":"2023-11-28T21:09:12.662962+0000","last_fullsized":"2023-11-28T21:09:12.662962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:30.654957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.625789+0000","last_change":"2023-11-28T21:09:12.625789+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.625789+0000","last_undegraded":"2023-11-28T21:09:12.625789+0000","last_fullsized":"2023-11-28T21:09:12.625789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.625715+0000","last_change":"2023-11-28T21:09:11.625715+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.625715+0000","last_undegraded":"2023-11-28T21:09:11.625715+0000","last_fullsized":"2023-11-28T21:09:11.625715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.650128+0000","last_change":"2023-11-28T21:09:12.646807+0000","last_active":"2023-11-28T21:09:12.650128+0000","last_peered":"2023-11-28T21:09:12.650128+0000","last_clean":"2023-11-28T21:09:12.650128+0000","last_became_active":"2023-11-28T21:09:12.646520+0000","last_became_peered":"2023-11-28T21:09:12.646520+0000","last_unstale":"2023-11-28T21:09:12.650128+0000","last_undegraded":"2023-11-28T21:09:12.650128+0000","last_fullsized":"2023-11-28T21:09:12.650128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:31:03.560952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636620+0000","last_change":"2023-11-28T21:09:12.636620+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636620+0000","last_undegraded":"2023-11-28T21:09:12.636620+0000","last_fullsized":"2023-11-28T21:09:12.636620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627001+0000","last_change":"2023-11-28T21:09:11.627001+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627001+0000","last_undegraded":"2023-11-28T21:09:11.627001+0000","last_fullsized":"2023-11-28T21:09:11.627001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.626478+0000","last_change":"2023-11-28T21:09:11.626478+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.626478+0000","last_undegraded":"2023-11-28T21:09:11.626478+0000","last_fullsized":"2023-11-28T21:09:11.626478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.658313+0000","last_change":"2023-11-28T21:09:12.651865+0000","last_active":"2023-11-28T21:09:12.658313+0000","last_peered":"2023-11-28T21:09:12.658313+0000","last_clean":"2023-11-28T21:09:12.658313+0000","last_became_active":"2023-11-28T21:09:12.651478+0000","last_became_peered":"2023-11-28T21:09:12.651478+0000","last_unstale":"2023-11-28T21:09:12.658313+0000","last_undegraded":"2023-11-28T21:09:12.658313+0000","last_fullsized":"2023-11-28T21:09:12.658313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:52.212158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.634846+0000","last_change":"2023-11-28T21:09:12.634846+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.634846+0000","last_undegraded":"2023-11-28T21:09:12.634846+0000","last_fullsized":"2023-11-28T21:09:12.634846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.626312+0000","last_change":"2023-11-28T21:09:11.626312+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.626312+0000","last_undegraded":"2023-11-28T21:09:11.626312+0000","last_fullsized":"2023-11-28T21:09:11.626312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.650069+0000","last_change":"2023-11-28T21:09:12.646329+0000","last_active":"2023-11-28T21:09:12.650069+0000","last_peered":"2023-11-28T21:09:12.650069+0000","last_clean":"2023-11-28T21:09:12.650069+0000","last_became_active":"2023-11-28T21:09:12.646002+0000","last_became_peered":"2023-11-28T21:09:12.646002+0000","last_unstale":"2023-11-28T21:09:12.650069+0000","last_undegraded":"2023-11-28T21:09:12.650069+0000","last_fullsized":"2023-11-28T21:09:12.650069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:46.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624590+0000","last_change":"2023-11-28T21:09:11.624590+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624590+0000","last_undegraded":"2023-11-28T21:09:11.624590+0000","last_fullsized":"2023-11-28T21:09:11.624590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.637598+0000","last_change":"2023-11-28T21:09:12.637598+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.637598+0000","last_undegraded":"2023-11-28T21:09:12.637598+0000","last_fullsized":"2023-11-28T21:09:12.637598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624989+0000","last_change":"2023-11-28T21:09:11.624989+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624989+0000","last_undegraded":"2023-11-28T21:09:11.624989+0000","last_fullsized":"2023-11-28T21:09:11.624989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.630468+0000","last_change":"2023-11-28T21:09:12.630468+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.630468+0000","last_undegraded":"2023-11-28T21:09:12.630468+0000","last_fullsized":"2023-11-28T21:09:12.630468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627891+0000","last_change":"2023-11-28T21:09:11.627891+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627891+0000","last_undegraded":"2023-11-28T21:09:11.627891+0000","last_fullsized":"2023-11-28T21:09:11.627891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627343+0000","last_change":"2023-11-28T21:09:12.627343+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627343+0000","last_undegraded":"2023-11-28T21:09:12.627343+0000","last_fullsized":"2023-11-28T21:09:12.627343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624030+0000","last_change":"2023-11-28T21:09:11.624030+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624030+0000","last_undegraded":"2023-11-28T21:09:11.624030+0000","last_fullsized":"2023-11-28T21:09:11.624030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.642668+0000","last_change":"2023-11-28T21:09:12.642668+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.642668+0000","last_undegraded":"2023-11-28T21:09:12.642668+0000","last_fullsized":"2023-11-28T21:09:12.642668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.650089+0000","last_change":"2023-11-28T21:09:12.646449+0000","last_active":"2023-11-28T21:09:12.650089+0000","last_peered":"2023-11-28T21:09:12.650089+0000","last_clean":"2023-11-28T21:09:12.650089+0000","last_became_active":"2023-11-28T21:09:12.645943+0000","last_became_peered":"2023-11-28T21:09:12.645943+0000","last_unstale":"2023-11-28T21:09:12.650089+0000","last_undegraded":"2023-11-28T21:09:12.650089+0000","last_fullsized":"2023-11-28T21:09:12.650089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:27.395345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.649813+0000","last_change":"2023-11-28T21:09:12.645973+0000","last_active":"2023-11-28T21:09:12.649813+0000","last_peered":"2023-11-28T21:09:12.649813+0000","last_clean":"2023-11-28T21:09:12.649813+0000","last_became_active":"2023-11-28T21:09:12.645659+0000","last_became_peered":"2023-11-28T21:09:12.645659+0000","last_unstale":"2023-11-28T21:09:12.649813+0000","last_undegraded":"2023-11-28T21:09:12.649813+0000","last_fullsized":"2023-11-28T21:09:12.649813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:03.868477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.639667+0000","last_change":"2023-11-28T21:09:12.639667+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.639667+0000","last_undegraded":"2023-11-28T21:09:12.639667+0000","last_fullsized":"2023-11-28T21:09:12.639667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.663778+0000","last_change":"2023-11-28T21:09:12.658797+0000","last_active":"2023-11-28T21:09:12.663778+0000","last_peered":"2023-11-28T21:09:12.663778+0000","last_clean":"2023-11-28T21:09:12.663778+0000","last_became_active":"2023-11-28T21:09:12.658507+0000","last_became_peered":"2023-11-28T21:09:12.658507+0000","last_unstale":"2023-11-28T21:09:12.663778+0000","last_undegraded":"2023-11-28T21:09:12.663778+0000","last_fullsized":"2023-11-28T21:09:12.663778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:11:20.698599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.639433+0000","last_change":"2023-11-28T21:09:12.639433+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.639433+0000","last_undegraded":"2023-11-28T21:09:12.639433+0000","last_fullsized":"2023-11-28T21:09:12.639433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627111+0000","last_change":"2023-11-28T21:09:11.627111+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627111+0000","last_undegraded":"2023-11-28T21:09:11.627111+0000","last_fullsized":"2023-11-28T21:09:11.627111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.640063+0000","last_change":"2023-11-28T21:09:12.640063+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.640063+0000","last_undegraded":"2023-11-28T21:09:12.640063+0000","last_fullsized":"2023-11-28T21:09:12.640063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.651445+0000","last_change":"2023-11-28T21:09:12.647997+0000","last_active":"2023-11-28T21:09:12.651445+0000","last_peered":"2023-11-28T21:09:12.651445+0000","last_clean":"2023-11-28T21:09:12.651445+0000","last_became_active":"2023-11-28T21:09:12.647711+0000","last_became_peered":"2023-11-28T21:09:12.647711+0000","last_unstale":"2023-11-28T21:09:12.651445+0000","last_undegraded":"2023-11-28T21:09:12.651445+0000","last_fullsized":"2023-11-28T21:09:12.651445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:15:51.100978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.634177+0000","last_change":"2023-11-28T21:09:12.634177+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.634177+0000","last_undegraded":"2023-11-28T21:09:12.634177+0000","last_fullsized":"2023-11-28T21:09:12.634177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.646587+0000","last_change":"2023-11-28T21:09:12.640178+0000","last_active":"2023-11-28T21:09:12.646587+0000","last_peered":"2023-11-28T21:09:12.646587+0000","last_clean":"2023-11-28T21:09:12.646587+0000","last_became_active":"2023-11-28T21:09:12.639755+0000","last_became_peered":"2023-11-28T21:09:12.639755+0000","last_unstale":"2023-11-28T21:09:12.646587+0000","last_undegraded":"2023-11-28T21:09:12.646587+0000","last_fullsized":"2023-11-28T21:09:12.646587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:58.726920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638856+0000","last_change":"2023-11-28T21:09:12.638856+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638856+0000","last_undegraded":"2023-11-28T21:09:12.638856+0000","last_fullsized":"2023-11-28T21:09:12.638856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.658331+0000","last_change":"2023-11-28T21:09:12.652318+0000","last_active":"2023-11-28T21:09:12.658331+0000","last_peered":"2023-11-28T21:09:12.658331+0000","last_clean":"2023-11-28T21:09:12.658331+0000","last_became_active":"2023-11-28T21:09:12.651417+0000","last_became_peered":"2023-11-28T21:09:12.651417+0000","last_unstale":"2023-11-28T21:09:12.658331+0000","last_undegraded":"2023-11-28T21:09:12.658331+0000","last_fullsized":"2023-11-28T21:09:12.658331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:29.233767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.639172+0000","last_change":"2023-11-28T21:09:12.639172+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.639172+0000","last_undegraded":"2023-11-28T21:09:12.639172+0000","last_fullsized":"2023-11-28T21:09:12.639172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.623397+0000","last_change":"2023-11-28T21:09:11.623397+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.623397+0000","last_undegraded":"2023-11-28T21:09:11.623397+0000","last_fullsized":"2023-11-28T21:09:11.623397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.642147+0000","last_change":"2023-11-28T21:09:12.642147+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.642147+0000","last_undegraded":"2023-11-28T21:09:12.642147+0000","last_fullsized":"2023-11-28T21:09:12.642147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624182+0000","last_change":"2023-11-28T21:09:11.624182+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624182+0000","last_undegraded":"2023-11-28T21:09:11.624182+0000","last_fullsized":"2023-11-28T21:09:11.624182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.623393+0000","last_change":"2023-11-28T21:09:11.623393+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.623393+0000","last_undegraded":"2023-11-28T21:09:11.623393+0000","last_fullsized":"2023-11-28T21:09:11.623393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.630365+0000","last_change":"2023-11-28T21:09:12.630365+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.630365+0000","last_undegraded":"2023-11-28T21:09:12.630365+0000","last_fullsized":"2023-11-28T21:09:12.630365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624693+0000","last_change":"2023-11-28T21:09:11.624693+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624693+0000","last_undegraded":"2023-11-28T21:09:11.624693+0000","last_fullsized":"2023-11-28T21:09:11.624693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624013+0000","last_change":"2023-11-28T21:09:11.624013+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624013+0000","last_undegraded":"2023-11-28T21:09:11.624013+0000","last_fullsized":"2023-11-28T21:09:11.624013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.647172+0000","last_change":"2023-11-28T21:09:12.644889+0000","last_active":"2023-11-28T21:09:12.647172+0000","last_peered":"2023-11-28T21:09:12.647172+0000","last_clean":"2023-11-28T21:09:12.647172+0000","last_became_active":"2023-11-28T21:09:12.644463+0000","last_became_peered":"2023-11-28T21:09:12.644463+0000","last_unstale":"2023-11-28T21:09:12.647172+0000","last_undegraded":"2023-11-28T21:09:12.647172+0000","last_fullsized":"2023-11-28T21:09:12.647172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:12.947599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.628205+0000","last_change":"2023-11-28T21:09:12.628205+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.628205+0000","last_undegraded":"2023-11-28T21:09:12.628205+0000","last_fullsized":"2023-11-28T21:09:12.628205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627379+0000","last_change":"2023-11-28T21:09:11.627379+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627379+0000","last_undegraded":"2023-11-28T21:09:11.627379+0000","last_fullsized":"2023-11-28T21:09:11.627379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636794+0000","last_change":"2023-11-28T21:09:12.636794+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636794+0000","last_undegraded":"2023-11-28T21:09:12.636794+0000","last_fullsized":"2023-11-28T21:09:12.636794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.647683+0000","last_change":"2023-11-28T21:09:12.646304+0000","last_active":"2023-11-28T21:09:12.647683+0000","last_peered":"2023-11-28T21:09:12.647683+0000","last_clean":"2023-11-28T21:09:12.647683+0000","last_became_active":"2023-11-28T21:09:12.645620+0000","last_became_peered":"2023-11-28T21:09:12.645620+0000","last_unstale":"2023-11-28T21:09:12.647683+0000","last_undegraded":"2023-11-28T21:09:12.647683+0000","last_fullsized":"2023-11-28T21:09:12.647683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:40:36.785608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T21:09:11.630373+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-28T21:09:11.630373+0000","last_peered":"2023-11-28T21:09:11.630373+0000","last_clean":"2023-11-28T21:09:11.630373+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-28T21:09:11.630373+0000","last_undegraded":"2023-11-28T21:09:11.630373+0000","last_fullsized":"2023-11-28T21:09:11.630373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":718915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79900000000000004}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.82099999999999995}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.75800000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55200000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64900000000000002}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73999999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.624}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.434}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.68200000000000005}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.497}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.623},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.58199999999999996}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.65100000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.752}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.70099999999999996}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.51900000000000002}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.82699999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.77800000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.4930000000000003,"5min":4.4930000000000003,"15min":4.4930000000000003},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":6.4770000000000003,"5min":6.4770000000000003,"15min":6.4770000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.0789999999999997,"5min":5.0789999999999997,"15min":5.0789999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.7190000000000003,"5min":6.7190000000000003,"15min":6.7190000000000003},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.7350000000000003,"5min":4.7350000000000003,"15min":4.7350000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.4640000000000004,"5min":4.4640000000000004,"15min":4.4640000000000004},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.7910000000000004,"5min":4.7910000000000004,"15min":4.7910000000000004},"last":0.86799999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":122730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":6.8869999999999996,"5min":6.8869999999999996,"15min":6.8869999999999996},"last":0.33900000000000002}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":7.0759999999999996,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.42799999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":6.9359999999999999,"5min":6.9359999999999999,"15min":6.9359999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.70299999999999996}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.2589999999999999,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.3290000000000002,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.61899999999999999}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":0.67800000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.496,"5min":3.496,"15min":3.496},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.177,"5min":3.177,"15min":3.177},"last":0.58999999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.374},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.433}]},{"osd":2,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.62},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.75700000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":713098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.313},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51500000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.745},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.91900000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":0.878}]},{"osd":6,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:09:17.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:09:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.958+0000 7f3ca339d640 1 Processor -- start 2023-11-28T21:09:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.958+0000 7f3ca339d640 1 -- start start 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.958+0000 7f3ca339d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c15c250 0x7f3c9c140780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.958+0000 7f3ca339d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c9c140cc0 0x7f3c9c06cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.958+0000 7f3ca339d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9c0cea50 con 0x7f3c9c13e090 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.958+0000 7f3ca339d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9c141170 con 0x7f3c9c140cc0 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.958+0000 7f3ca339d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c13e470 con 0x7f3c9c15c250 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca1139640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3c9c13e090 0x7f3c9c0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37206/0 (socket says 172.21.15.6:37206) 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca1139640 1 -- 172.21.15.6:0/2525522542 learned_addr learned my addr 172.21.15.6:0/2525522542 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca193a640 1 --2- 172.21.15.6:0/2525522542 >> v2:172.21.15.6:3300/0 conn(0x7f3c9c140cc0 0x7f3c9c06cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca0938640 1 --2- 172.21.15.6:0/2525522542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c15c250 0x7f3c9c140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3c93fff640 1 -- 172.21.15.6:0/2525522542 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797377288 0 0) 0x7f3c9c0cea50 con 0x7f3c9c13e090 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3c93fff640 1 -- 172.21.15.6:0/2525522542 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c88003530 con 0x7f3c9c13e090 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca193a640 1 -- 172.21.15.6:0/2525522542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c15c250 msgr2=0x7f3c9c140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca193a640 1 --2- 172.21.15.6:0/2525522542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c15c250 0x7f3c9c140780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca193a640 1 -- 172.21.15.6:0/2525522542 >> v1:172.21.15.6:6789/0 conn(0x7f3c9c13e090 legacy=0x7f3c9c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca193a640 1 -- 172.21.15.6:0/2525522542 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c0ce1b0 con 0x7f3c9c140cc0 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca0938640 1 --2- 172.21.15.6:0/2525522542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c15c250 0x7f3c9c140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3ca193a640 1 --2- 172.21.15.6:0/2525522542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 0x7f3c9c06cbc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009dc0 tx=0x7f3c9401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2475cb41d10fee21 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3c93fff640 1 -- 172.21.15.6:0/2525522542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940a5930 con 0x7f3c9c140cc0 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3c93fff640 1 -- 172.21.15.6:0/2525522542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940a5a90 con 0x7f3c9c140cc0 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.962+0000 7f3c93fff640 1 -- 172.21.15.6:0/2525522542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940a5e20 con 0x7f3c9c140cc0 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 -- 172.21.15.6:0/2525522542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 msgr2=0x7f3c9c06cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 --2- 172.21.15.6:0/2525522542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 0x7f3c9c06cbc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009dc0 tx=0x7f3c9401c870 comp rx=0 tx=0).stop 2023-11-28T21:09:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 -- 172.21.15.6:0/2525522542 shutdown_connections 2023-11-28T21:09:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 --2- 172.21.15.6:0/2525522542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 0x7f3c9c06cbc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 --2- 172.21.15.6:0/2525522542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c15c250 0x7f3c9c140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 -- 172.21.15.6:0/2525522542 >> 172.21.15.6:0/2525522542 conn(0x7f3c9c06ab80 msgr2=0x7f3c9c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 -- 172.21.15.6:0/2525522542 shutdown_connections 2023-11-28T21:09:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 -- 172.21.15.6:0/2525522542 wait complete. 2023-11-28T21:09:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 Processor -- start 2023-11-28T21:09:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 -- start start 2023-11-28T21:09:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c13e090 0x7f3c9c13b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 0x7f3c9c143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9c15c250 0x7f3c9c142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c15a680 con 0x7f3c9c140cc0 2023-11-28T21:09:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c13cdc0 con 0x7f3c9c15c250 2023-11-28T21:09:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca339d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c15a890 con 0x7f3c9c13e090 2023-11-28T21:09:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca0938640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 0x7f3c9c143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca0938640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 0x7f3c9c143c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49930/0 (socket says 172.21.15.6:49930) 2023-11-28T21:09:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca0938640 1 -- 172.21.15.6:0/1031339393 learned_addr learned my addr 172.21.15.6:0/1031339393 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca193a640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9c15c250 0x7f3c9c142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca1139640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c13e090 0x7f3c9c13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca0938640 1 -- 172.21.15.6:0/1031339393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c13e090 msgr2=0x7f3c9c13b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca0938640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c13e090 0x7f3c9c13b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca0938640 1 -- 172.21.15.6:0/1031339393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9c15c250 msgr2=0x7f3c9c142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca0938640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9c15c250 0x7f3c9c142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.966+0000 7f3ca0938640 1 -- 172.21.15.6:0/1031339393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94009a70 con 0x7f3c9c140cc0 2023-11-28T21:09:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3ca0938640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 0x7f3c9c143c40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00d800 tx=0x7f3c8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3c91ffb640 1 -- 172.21.15.6:0/1031339393 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00b6c0 con 0x7f3c9c140cc0 2023-11-28T21:09:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3c91ffb640 1 -- 172.21.15.6:0/1031339393 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c00b820 con 0x7f3c9c140cc0 2023-11-28T21:09:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3c91ffb640 1 -- 172.21.15.6:0/1031339393 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00bbd0 con 0x7f3c9c140cc0 2023-11-28T21:09:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c15ab70 con 0x7f3c9c140cc0 2023-11-28T21:09:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c13d250 con 0x7f3c9c140cc0 2023-11-28T21:09:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c0674d0 con 0x7f3c9c140cc0 2023-11-28T21:09:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3c91ffb640 1 -- 172.21.15.6:0/1031339393 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3c8c00bd30 con 0x7f3c9c140cc0 2023-11-28T21:09:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3c91ffb640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3c80066470 0x7f3c80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.970+0000 7f3c91ffb640 1 -- 172.21.15.6:0/1031339393 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c8c084380 con 0x7f3c9c140cc0 2023-11-28T21:09:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.974+0000 7f3ca1139640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3c80066470 0x7f3c80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.974+0000 7f3ca1139640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3c80066470 0x7f3c80068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c980011f0 tx=0x7f3c98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:17.974+0000 7f3c91ffb640 1 -- 172.21.15.6:0/1031339393 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c8c0517f0 con 0x7f3c9c140cc0 2023-11-28T21:09:18.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.134+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c9c0cde50 con 0x7f3c80066470 2023-11-28T21:09:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.142+0000 7f3c91ffb640 1 -- 172.21.15.6:0/1031339393 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281026 (secure 0 0 0) 0x7f3c98001cf0 con 0x7f3c80066470 2023-11-28T21:09:18.151 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:18.152 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-28T21:09:18.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3c80066470 msgr2=0x7f3c80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3c80066470 0x7f3c80068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c980011f0 tx=0x7f3c98009040 comp rx=0 tx=0).stop 2023-11-28T21:09:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 msgr2=0x7f3c9c143c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 0x7f3c9c143c40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00d800 tx=0x7f3c8c00dcc0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 shutdown_connections 2023-11-28T21:09:18.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3c80066470 0x7f3c80068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9c15c250 0x7f3c9c142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c140cc0 0x7f3c9c143c40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 --2- 172.21.15.6:0/1031339393 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c9c13e090 0x7f3c9c13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 >> 172.21.15.6:0/1031339393 conn(0x7f3c9c06ab80 msgr2=0x7f3c9c13e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 shutdown_connections 2023-11-28T21:09:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.146+0000 7f3ca339d640 1 -- 172.21.15.6:0/1031339393 wait complete. 2023-11-28T21:09:18.171 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-28T21:09:16.670325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":150,"acting":150,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219968,"kb_used_data":3792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754752,"statfs":{"total":773094113280,"available":772868866048,"internally_reserved":0,"allocated":3883008,"data_stored":2197928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.052024"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.631470+0000","last_change":"2023-11-28T21:09:12.631470+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.631470+0000","last_undegraded":"2023-11-28T21:09:12.631470+0000","last_fullsized":"2023-11-28T21:09:12.631470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.634341+0000","last_change":"2023-11-28T21:09:12.634341+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.634341+0000","last_undegraded":"2023-11-28T21:09:12.634341+0000","last_fullsized":"2023-11-28T21:09:12.634341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.643146+0000","last_change":"2023-11-28T21:09:12.643146+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.643146+0000","last_undegraded":"2023-11-28T21:09:12.643146+0000","last_fullsized":"2023-11-28T21:09:12.643146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638249+0000","last_change":"2023-11-28T21:09:12.638249+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638249+0000","last_undegraded":"2023-11-28T21:09:12.638249+0000","last_fullsized":"2023-11-28T21:09:12.638249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638633+0000","last_change":"2023-11-28T21:09:12.638633+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638633+0000","last_undegraded":"2023-11-28T21:09:12.638633+0000","last_fullsized":"2023-11-28T21:09:12.638633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627992+0000","last_change":"2023-11-28T21:09:12.627992+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627992+0000","last_undegraded":"2023-11-28T21:09:12.627992+0000","last_fullsized":"2023-11-28T21:09:12.627992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636633+0000","last_change":"2023-11-28T21:09:12.636633+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636633+0000","last_undegraded":"2023-11-28T21:09:12.636633+0000","last_fullsized":"2023-11-28T21:09:12.636633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636124+0000","last_change":"2023-11-28T21:09:12.636124+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636124+0000","last_undegraded":"2023-11-28T21:09:12.636124+0000","last_fullsized":"2023-11-28T21:09:12.636124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.642661+0000","last_change":"2023-11-28T21:09:12.642661+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.642661+0000","last_undegraded":"2023-11-28T21:09:12.642661+0000","last_fullsized":"2023-11-28T21:09:12.642661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.633483+0000","last_change":"2023-11-28T21:09:12.633483+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.633483+0000","last_undegraded":"2023-11-28T21:09:12.633483+0000","last_fullsized":"2023-11-28T21:09:12.633483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636495+0000","last_change":"2023-11-28T21:09:12.636495+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636495+0000","last_undegraded":"2023-11-28T21:09:12.636495+0000","last_fullsized":"2023-11-28T21:09:12.636495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636252+0000","last_change":"2023-11-28T21:09:12.636252+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636252+0000","last_undegraded":"2023-11-28T21:09:12.636252+0000","last_fullsized":"2023-11-28T21:09:12.636252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.641316+0000","last_change":"2023-11-28T21:09:12.641316+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.641316+0000","last_undegraded":"2023-11-28T21:09:12.641316+0000","last_fullsized":"2023-11-28T21:09:12.641316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627117+0000","last_change":"2023-11-28T21:09:12.627117+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627117+0000","last_undegraded":"2023-11-28T21:09:12.627117+0000","last_fullsized":"2023-11-28T21:09:12.627117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627814+0000","last_change":"2023-11-28T21:09:12.627814+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627814+0000","last_undegraded":"2023-11-28T21:09:12.627814+0000","last_fullsized":"2023-11-28T21:09:12.627814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.633262+0000","last_change":"2023-11-28T21:09:12.633262+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.633262+0000","last_undegraded":"2023-11-28T21:09:12.633262+0000","last_fullsized":"2023-11-28T21:09:12.633262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.635679+0000","last_change":"2023-11-28T21:09:12.635679+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.635679+0000","last_undegraded":"2023-11-28T21:09:12.635679+0000","last_fullsized":"2023-11-28T21:09:12.635679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.626518+0000","last_change":"2023-11-28T21:09:12.626518+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.626518+0000","last_undegraded":"2023-11-28T21:09:12.626518+0000","last_fullsized":"2023-11-28T21:09:12.626518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638016+0000","last_change":"2023-11-28T21:09:12.638016+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638016+0000","last_undegraded":"2023-11-28T21:09:12.638016+0000","last_fullsized":"2023-11-28T21:09:12.638016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.631066+0000","last_change":"2023-11-28T21:09:12.631066+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.631066+0000","last_undegraded":"2023-11-28T21:09:12.631066+0000","last_fullsized":"2023-11-28T21:09:12.631066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638046+0000","last_change":"2023-11-28T21:09:12.638046+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638046+0000","last_undegraded":"2023-11-28T21:09:12.638046+0000","last_fullsized":"2023-11-28T21:09:12.638046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.651714+0000","last_change":"2023-11-28T21:09:12.649448+0000","last_active":"2023-11-28T21:09:12.651714+0000","last_peered":"2023-11-28T21:09:12.651714+0000","last_clean":"2023-11-28T21:09:12.651714+0000","last_became_active":"2023-11-28T21:09:12.649106+0000","last_became_peered":"2023-11-28T21:09:12.649106+0000","last_unstale":"2023-11-28T21:09:12.651714+0000","last_undegraded":"2023-11-28T21:09:12.651714+0000","last_fullsized":"2023-11-28T21:09:12.651714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:01:10.139438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.630491+0000","last_change":"2023-11-28T21:09:12.630491+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.630491+0000","last_undegraded":"2023-11-28T21:09:12.630491+0000","last_fullsized":"2023-11-28T21:09:12.630491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627013+0000","last_change":"2023-11-28T21:09:11.627013+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627013+0000","last_undegraded":"2023-11-28T21:09:11.627013+0000","last_fullsized":"2023-11-28T21:09:11.627013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.628323+0000","last_change":"2023-11-28T21:09:12.628323+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.628323+0000","last_undegraded":"2023-11-28T21:09:12.628323+0000","last_fullsized":"2023-11-28T21:09:12.628323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.625558+0000","last_change":"2023-11-28T21:09:11.625558+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.625558+0000","last_undegraded":"2023-11-28T21:09:11.625558+0000","last_fullsized":"2023-11-28T21:09:11.625558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.655585+0000","last_change":"2023-11-28T21:09:12.651372+0000","last_active":"2023-11-28T21:09:12.655585+0000","last_peered":"2023-11-28T21:09:12.655585+0000","last_clean":"2023-11-28T21:09:12.655585+0000","last_became_active":"2023-11-28T21:09:12.651014+0000","last_became_peered":"2023-11-28T21:09:12.651014+0000","last_unstale":"2023-11-28T21:09:12.655585+0000","last_undegraded":"2023-11-28T21:09:12.655585+0000","last_fullsized":"2023-11-28T21:09:12.655585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:46.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636173+0000","last_change":"2023-11-28T21:09:12.636173+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636173+0000","last_undegraded":"2023-11-28T21:09:12.636173+0000","last_fullsized":"2023-11-28T21:09:12.636173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.663791+0000","last_change":"2023-11-28T21:09:12.658946+0000","last_active":"2023-11-28T21:09:12.663791+0000","last_peered":"2023-11-28T21:09:12.663791+0000","last_clean":"2023-11-28T21:09:12.663791+0000","last_became_active":"2023-11-28T21:09:12.658480+0000","last_became_peered":"2023-11-28T21:09:12.658480+0000","last_unstale":"2023-11-28T21:09:12.663791+0000","last_undegraded":"2023-11-28T21:09:12.663791+0000","last_fullsized":"2023-11-28T21:09:12.663791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:38.368381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.640014+0000","last_change":"2023-11-28T21:09:12.640014+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.640014+0000","last_undegraded":"2023-11-28T21:09:12.640014+0000","last_fullsized":"2023-11-28T21:09:12.640014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.662962+0000","last_change":"2023-11-28T21:09:12.656711+0000","last_active":"2023-11-28T21:09:12.662962+0000","last_peered":"2023-11-28T21:09:12.662962+0000","last_clean":"2023-11-28T21:09:12.662962+0000","last_became_active":"2023-11-28T21:09:12.656379+0000","last_became_peered":"2023-11-28T21:09:12.656379+0000","last_unstale":"2023-11-28T21:09:12.662962+0000","last_undegraded":"2023-11-28T21:09:12.662962+0000","last_fullsized":"2023-11-28T21:09:12.662962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:30.654957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.625789+0000","last_change":"2023-11-28T21:09:12.625789+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.625789+0000","last_undegraded":"2023-11-28T21:09:12.625789+0000","last_fullsized":"2023-11-28T21:09:12.625789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.625715+0000","last_change":"2023-11-28T21:09:11.625715+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.625715+0000","last_undegraded":"2023-11-28T21:09:11.625715+0000","last_fullsized":"2023-11-28T21:09:11.625715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.650128+0000","last_change":"2023-11-28T21:09:12.646807+0000","last_active":"2023-11-28T21:09:12.650128+0000","last_peered":"2023-11-28T21:09:12.650128+0000","last_clean":"2023-11-28T21:09:12.650128+0000","last_became_active":"2023-11-28T21:09:12.646520+0000","last_became_peered":"2023-11-28T21:09:12.646520+0000","last_unstale":"2023-11-28T21:09:12.650128+0000","last_undegraded":"2023-11-28T21:09:12.650128+0000","last_fullsized":"2023-11-28T21:09:12.650128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:31:03.560952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636620+0000","last_change":"2023-11-28T21:09:12.636620+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636620+0000","last_undegraded":"2023-11-28T21:09:12.636620+0000","last_fullsized":"2023-11-28T21:09:12.636620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627001+0000","last_change":"2023-11-28T21:09:11.627001+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627001+0000","last_undegraded":"2023-11-28T21:09:11.627001+0000","last_fullsized":"2023-11-28T21:09:11.627001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.626478+0000","last_change":"2023-11-28T21:09:11.626478+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.626478+0000","last_undegraded":"2023-11-28T21:09:11.626478+0000","last_fullsized":"2023-11-28T21:09:11.626478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.658313+0000","last_change":"2023-11-28T21:09:12.651865+0000","last_active":"2023-11-28T21:09:12.658313+0000","last_peered":"2023-11-28T21:09:12.658313+0000","last_clean":"2023-11-28T21:09:12.658313+0000","last_became_active":"2023-11-28T21:09:12.651478+0000","last_became_peered":"2023-11-28T21:09:12.651478+0000","last_unstale":"2023-11-28T21:09:12.658313+0000","last_undegraded":"2023-11-28T21:09:12.658313+0000","last_fullsized":"2023-11-28T21:09:12.658313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:52.212158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.634846+0000","last_change":"2023-11-28T21:09:12.634846+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.634846+0000","last_undegraded":"2023-11-28T21:09:12.634846+0000","last_fullsized":"2023-11-28T21:09:12.634846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.626312+0000","last_change":"2023-11-28T21:09:11.626312+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.626312+0000","last_undegraded":"2023-11-28T21:09:11.626312+0000","last_fullsized":"2023-11-28T21:09:11.626312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.650069+0000","last_change":"2023-11-28T21:09:12.646329+0000","last_active":"2023-11-28T21:09:12.650069+0000","last_peered":"2023-11-28T21:09:12.650069+0000","last_clean":"2023-11-28T21:09:12.650069+0000","last_became_active":"2023-11-28T21:09:12.646002+0000","last_became_peered":"2023-11-28T21:09:12.646002+0000","last_unstale":"2023-11-28T21:09:12.650069+0000","last_undegraded":"2023-11-28T21:09:12.650069+0000","last_fullsized":"2023-11-28T21:09:12.650069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:46.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624590+0000","last_change":"2023-11-28T21:09:11.624590+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624590+0000","last_undegraded":"2023-11-28T21:09:11.624590+0000","last_fullsized":"2023-11-28T21:09:11.624590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.637598+0000","last_change":"2023-11-28T21:09:12.637598+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.637598+0000","last_undegraded":"2023-11-28T21:09:12.637598+0000","last_fullsized":"2023-11-28T21:09:12.637598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624989+0000","last_change":"2023-11-28T21:09:11.624989+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624989+0000","last_undegraded":"2023-11-28T21:09:11.624989+0000","last_fullsized":"2023-11-28T21:09:11.624989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.630468+0000","last_change":"2023-11-28T21:09:12.630468+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.630468+0000","last_undegraded":"2023-11-28T21:09:12.630468+0000","last_fullsized":"2023-11-28T21:09:12.630468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627891+0000","last_change":"2023-11-28T21:09:11.627891+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627891+0000","last_undegraded":"2023-11-28T21:09:11.627891+0000","last_fullsized":"2023-11-28T21:09:11.627891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627343+0000","last_change":"2023-11-28T21:09:12.627343+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627343+0000","last_undegraded":"2023-11-28T21:09:12.627343+0000","last_fullsized":"2023-11-28T21:09:12.627343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624030+0000","last_change":"2023-11-28T21:09:11.624030+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624030+0000","last_undegraded":"2023-11-28T21:09:11.624030+0000","last_fullsized":"2023-11-28T21:09:11.624030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.642668+0000","last_change":"2023-11-28T21:09:12.642668+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.642668+0000","last_undegraded":"2023-11-28T21:09:12.642668+0000","last_fullsized":"2023-11-28T21:09:12.642668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.650089+0000","last_change":"2023-11-28T21:09:12.646449+0000","last_active":"2023-11-28T21:09:12.650089+0000","last_peered":"2023-11-28T21:09:12.650089+0000","last_clean":"2023-11-28T21:09:12.650089+0000","last_became_active":"2023-11-28T21:09:12.645943+0000","last_became_peered":"2023-11-28T21:09:12.645943+0000","last_unstale":"2023-11-28T21:09:12.650089+0000","last_undegraded":"2023-11-28T21:09:12.650089+0000","last_fullsized":"2023-11-28T21:09:12.650089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:27.395345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.649813+0000","last_change":"2023-11-28T21:09:12.645973+0000","last_active":"2023-11-28T21:09:12.649813+0000","last_peered":"2023-11-28T21:09:12.649813+0000","last_clean":"2023-11-28T21:09:12.649813+0000","last_became_active":"2023-11-28T21:09:12.645659+0000","last_became_peered":"2023-11-28T21:09:12.645659+0000","last_unstale":"2023-11-28T21:09:12.649813+0000","last_undegraded":"2023-11-28T21:09:12.649813+0000","last_fullsized":"2023-11-28T21:09:12.649813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:03.868477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.639667+0000","last_change":"2023-11-28T21:09:12.639667+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.639667+0000","last_undegraded":"2023-11-28T21:09:12.639667+0000","last_fullsized":"2023-11-28T21:09:12.639667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.663778+0000","last_change":"2023-11-28T21:09:12.658797+0000","last_active":"2023-11-28T21:09:12.663778+0000","last_peered":"2023-11-28T21:09:12.663778+0000","last_clean":"2023-11-28T21:09:12.663778+0000","last_became_active":"2023-11-28T21:09:12.658507+0000","last_became_peered":"2023-11-28T21:09:12.658507+0000","last_unstale":"2023-11-28T21:09:12.663778+0000","last_undegraded":"2023-11-28T21:09:12.663778+0000","last_fullsized":"2023-11-28T21:09:12.663778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:11:20.698599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.639433+0000","last_change":"2023-11-28T21:09:12.639433+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.639433+0000","last_undegraded":"2023-11-28T21:09:12.639433+0000","last_fullsized":"2023-11-28T21:09:12.639433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627111+0000","last_change":"2023-11-28T21:09:11.627111+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627111+0000","last_undegraded":"2023-11-28T21:09:11.627111+0000","last_fullsized":"2023-11-28T21:09:11.627111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.640063+0000","last_change":"2023-11-28T21:09:12.640063+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.640063+0000","last_undegraded":"2023-11-28T21:09:12.640063+0000","last_fullsized":"2023-11-28T21:09:12.640063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.651445+0000","last_change":"2023-11-28T21:09:12.647997+0000","last_active":"2023-11-28T21:09:12.651445+0000","last_peered":"2023-11-28T21:09:12.651445+0000","last_clean":"2023-11-28T21:09:12.651445+0000","last_became_active":"2023-11-28T21:09:12.647711+0000","last_became_peered":"2023-11-28T21:09:12.647711+0000","last_unstale":"2023-11-28T21:09:12.651445+0000","last_undegraded":"2023-11-28T21:09:12.651445+0000","last_fullsized":"2023-11-28T21:09:12.651445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:15:51.100978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.634177+0000","last_change":"2023-11-28T21:09:12.634177+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.634177+0000","last_undegraded":"2023-11-28T21:09:12.634177+0000","last_fullsized":"2023-11-28T21:09:12.634177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.646587+0000","last_change":"2023-11-28T21:09:12.640178+0000","last_active":"2023-11-28T21:09:12.646587+0000","last_peered":"2023-11-28T21:09:12.646587+0000","last_clean":"2023-11-28T21:09:12.646587+0000","last_became_active":"2023-11-28T21:09:12.639755+0000","last_became_peered":"2023-11-28T21:09:12.639755+0000","last_unstale":"2023-11-28T21:09:12.646587+0000","last_undegraded":"2023-11-28T21:09:12.646587+0000","last_fullsized":"2023-11-28T21:09:12.646587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:58.726920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638856+0000","last_change":"2023-11-28T21:09:12.638856+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638856+0000","last_undegraded":"2023-11-28T21:09:12.638856+0000","last_fullsized":"2023-11-28T21:09:12.638856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.658331+0000","last_change":"2023-11-28T21:09:12.652318+0000","last_active":"2023-11-28T21:09:12.658331+0000","last_peered":"2023-11-28T21:09:12.658331+0000","last_clean":"2023-11-28T21:09:12.658331+0000","last_became_active":"2023-11-28T21:09:12.651417+0000","last_became_peered":"2023-11-28T21:09:12.651417+0000","last_unstale":"2023-11-28T21:09:12.658331+0000","last_undegraded":"2023-11-28T21:09:12.658331+0000","last_fullsized":"2023-11-28T21:09:12.658331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:29.233767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.639172+0000","last_change":"2023-11-28T21:09:12.639172+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.639172+0000","last_undegraded":"2023-11-28T21:09:12.639172+0000","last_fullsized":"2023-11-28T21:09:12.639172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.623397+0000","last_change":"2023-11-28T21:09:11.623397+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.623397+0000","last_undegraded":"2023-11-28T21:09:11.623397+0000","last_fullsized":"2023-11-28T21:09:11.623397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.642147+0000","last_change":"2023-11-28T21:09:12.642147+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.642147+0000","last_undegraded":"2023-11-28T21:09:12.642147+0000","last_fullsized":"2023-11-28T21:09:12.642147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624182+0000","last_change":"2023-11-28T21:09:11.624182+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624182+0000","last_undegraded":"2023-11-28T21:09:11.624182+0000","last_fullsized":"2023-11-28T21:09:11.624182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.623393+0000","last_change":"2023-11-28T21:09:11.623393+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.623393+0000","last_undegraded":"2023-11-28T21:09:11.623393+0000","last_fullsized":"2023-11-28T21:09:11.623393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.630365+0000","last_change":"2023-11-28T21:09:12.630365+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.630365+0000","last_undegraded":"2023-11-28T21:09:12.630365+0000","last_fullsized":"2023-11-28T21:09:12.630365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624693+0000","last_change":"2023-11-28T21:09:11.624693+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624693+0000","last_undegraded":"2023-11-28T21:09:11.624693+0000","last_fullsized":"2023-11-28T21:09:11.624693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624013+0000","last_change":"2023-11-28T21:09:11.624013+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624013+0000","last_undegraded":"2023-11-28T21:09:11.624013+0000","last_fullsized":"2023-11-28T21:09:11.624013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.647172+0000","last_change":"2023-11-28T21:09:12.644889+0000","last_active":"2023-11-28T21:09:12.647172+0000","last_peered":"2023-11-28T21:09:12.647172+0000","last_clean":"2023-11-28T21:09:12.647172+0000","last_became_active":"2023-11-28T21:09:12.644463+0000","last_became_peered":"2023-11-28T21:09:12.644463+0000","last_unstale":"2023-11-28T21:09:12.647172+0000","last_undegraded":"2023-11-28T21:09:12.647172+0000","last_fullsized":"2023-11-28T21:09:12.647172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:12.947599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.628205+0000","last_change":"2023-11-28T21:09:12.628205+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.628205+0000","last_undegraded":"2023-11-28T21:09:12.628205+0000","last_fullsized":"2023-11-28T21:09:12.628205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627379+0000","last_change":"2023-11-28T21:09:11.627379+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627379+0000","last_undegraded":"2023-11-28T21:09:11.627379+0000","last_fullsized":"2023-11-28T21:09:11.627379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636794+0000","last_change":"2023-11-28T21:09:12.636794+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636794+0000","last_undegraded":"2023-11-28T21:09:12.636794+0000","last_fullsized":"2023-11-28T21:09:12.636794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.647683+0000","last_change":"2023-11-28T21:09:12.646304+0000","last_active":"2023-11-28T21:09:12.647683+0000","last_peered":"2023-11-28T21:09:12.647683+0000","last_clean":"2023-11-28T21:09:12.647683+0000","last_became_active":"2023-11-28T21:09:12.645620+0000","last_became_peered":"2023-11-28T21:09:12.645620+0000","last_unstale":"2023-11-28T21:09:12.647683+0000","last_undegraded":"2023-11-28T21:09:12.647683+0000","last_fullsized":"2023-11-28T21:09:12.647683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:40:36.785608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T21:09:11.630373+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-28T21:09:11.630373+0000","last_peered":"2023-11-28T21:09:11.630373+0000","last_clean":"2023-11-28T21:09:11.630373+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-28T21:09:11.630373+0000","last_undegraded":"2023-11-28T21:09:11.630373+0000","last_fullsized":"2023-11-28T21:09:11.630373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":718915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79900000000000004}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.82099999999999995}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.75800000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55200000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64900000000000002}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73999999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.624}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.434}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.68200000000000005}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.497}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.623},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.58199999999999996}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.65100000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.752}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.70099999999999996}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.51900000000000002}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.82699999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.77800000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.4930000000000003,"5min":4.4930000000000003,"15min":4.4930000000000003},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":6.4770000000000003,"5min":6.4770000000000003,"15min":6.4770000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.0789999999999997,"5min":5.0789999999999997,"15min":5.0789999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.7190000000000003,"5min":6.7190000000000003,"15min":6.7190000000000003},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.7350000000000003,"5min":4.7350000000000003,"15min":4.7350000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.4640000000000004,"5min":4.4640000000000004,"15min":4.4640000000000004},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.7910000000000004,"5min":4.7910000000000004,"15min":4.7910000000000004},"last":0.86799999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":122730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":6.8869999999999996,"5min":6.8869999999999996,"15min":6.8869999999999996},"last":0.33900000000000002}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":7.0759999999999996,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.42799999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":6.9359999999999999,"5min":6.9359999999999999,"15min":6.9359999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.70299999999999996}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.2589999999999999,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.3290000000000002,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.61899999999999999}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":0.67800000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.496,"5min":3.496,"15min":3.496},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.177,"5min":3.177,"15min":3.177},"last":0.58999999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.374},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.433}]},{"osd":2,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.62},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.75700000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":713098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.313},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51500000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.745},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.91900000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":0.878}]},{"osd":6,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:09:18.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:09:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffafb32a640 1 Processor -- start 2023-11-28T21:09:18.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffafb32a640 1 -- start start 2023-11-28T21:09:18.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffafb32a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffaf415f230 0x7ffaf40b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffafb32a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf40b32c0 con 0x7ffaf4162890 2023-11-28T21:09:18.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffafb32a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf415f610 con 0x7ffaf4070cf0 2023-11-28T21:09:18.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffafb32a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf40b26f0 con 0x7ffaf415f230 2023-11-28T21:09:18.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffaf90c6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffaf415f230 0x7ffaf40b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffaf88c5640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffaf4162890 0x7ffaf40705e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34584/0 (socket says 172.21.15.6:34584) 2023-11-28T21:09:18.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffaf88c5640 1 -- 172.21.15.6:0/4126047515 learned_addr learned my addr 172.21.15.6:0/4126047515 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffaf90c6640 1 -- 172.21.15.6:0/4126047515 >> v1:172.21.15.31:6789/0 conn(0x7ffaf4070cf0 legacy=0x7ffaf406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffaf90c6640 1 -- 172.21.15.6:0/4126047515 >> v1:172.21.15.6:6789/0 conn(0x7ffaf4162890 legacy=0x7ffaf40705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.354+0000 7ffaf90c6640 1 -- 172.21.15.6:0/4126047515 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf40b2990 con 0x7ffaf415f230 2023-11-28T21:09:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffaf90c6640 1 --2- 172.21.15.6:0/4126047515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf415f230 0x7ffaf40b1d90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00097c0 tx=0x7ffaf001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6c10ea2de804d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffaebfff640 1 -- 172.21.15.6:0/4126047515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00ab650 con 0x7ffaf415f230 2023-11-28T21:09:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffaebfff640 1 -- 172.21.15.6:0/4126047515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf00ab7b0 con 0x7ffaf415f230 2023-11-28T21:09:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffaebfff640 1 -- 172.21.15.6:0/4126047515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00abb40 con 0x7ffaf415f230 2023-11-28T21:09:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffafb32a640 1 -- 172.21.15.6:0/4126047515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf415f230 msgr2=0x7ffaf40b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffafb32a640 1 --2- 172.21.15.6:0/4126047515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf415f230 0x7ffaf40b1d90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00097c0 tx=0x7ffaf001c450 comp rx=0 tx=0).stop 2023-11-28T21:09:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffafb32a640 1 -- 172.21.15.6:0/4126047515 shutdown_connections 2023-11-28T21:09:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffafb32a640 1 --2- 172.21.15.6:0/4126047515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf415f230 0x7ffaf40b1d90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffafb32a640 1 -- 172.21.15.6:0/4126047515 >> 172.21.15.6:0/4126047515 conn(0x7ffaf406ab80 msgr2=0x7ffaf40b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffafb32a640 1 -- 172.21.15.6:0/4126047515 shutdown_connections 2023-11-28T21:09:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.358+0000 7ffafb32a640 1 -- 172.21.15.6:0/4126047515 wait complete. 2023-11-28T21:09:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 Processor -- start 2023-11-28T21:09:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 -- start start 2023-11-28T21:09:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf4070cf0 0x7ffaf40cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf415f230 0x7ffaf415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf4162890 0x7ffaf415cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf415d320 con 0x7ffaf4162890 2023-11-28T21:09:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf415d590 con 0x7ffaf415f230 2023-11-28T21:09:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf415d870 con 0x7ffaf4070cf0 2023-11-28T21:09:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf98c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf4162890 0x7ffaf415cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf90c6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf4070cf0 0x7ffaf40cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf98c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf4162890 0x7ffaf415cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40168/0 (socket says 172.21.15.6:40168) 2023-11-28T21:09:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf98c7640 1 -- 172.21.15.6:0/1400014706 learned_addr learned my addr 172.21.15.6:0/1400014706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf88c5640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf415f230 0x7ffaf415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf98c7640 1 -- 172.21.15.6:0/1400014706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf4070cf0 msgr2=0x7ffaf40cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf98c7640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf4070cf0 0x7ffaf40cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf98c7640 1 -- 172.21.15.6:0/1400014706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf415f230 msgr2=0x7ffaf415c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf98c7640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf415f230 0x7ffaf415c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf98c7640 1 -- 172.21.15.6:0/1400014706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf0009420 con 0x7ffaf4162890 2023-11-28T21:09:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffaf98c7640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf4162890 0x7ffaf415cde0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00c770 tx=0x7ffaec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffae9ffb640 1 -- 172.21.15.6:0/1400014706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec003b80 con 0x7ffaf4162890 2023-11-28T21:09:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffae9ffb640 1 -- 172.21.15.6:0/1400014706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec003ce0 con 0x7ffaf4162890 2023-11-28T21:09:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffae9ffb640 1 -- 172.21.15.6:0/1400014706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00aa90 con 0x7ffaf4162890 2023-11-28T21:09:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf415db50 con 0x7ffaf4162890 2023-11-28T21:09:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.362+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf415e110 con 0x7ffaf4162890 2023-11-28T21:09:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.366+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf415e2a0 con 0x7ffaf4162890 2023-11-28T21:09:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.366+0000 7ffae9ffb640 1 -- 172.21.15.6:0/1400014706 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffaec00abf0 con 0x7ffaf4162890 2023-11-28T21:09:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.366+0000 7ffae9ffb640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffad8066470 0x7ffad8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.366+0000 7ffae9ffb640 1 -- 172.21.15.6:0/1400014706 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffaec083c10 con 0x7ffaf4162890 2023-11-28T21:09:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.366+0000 7ffaf90c6640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffad8066470 0x7ffad8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.366+0000 7ffaf90c6640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffad8066470 0x7ffad8068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00af000 tx=0x7ffaf00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.370+0000 7ffae9ffb640 1 -- 172.21.15.6:0/1400014706 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffaec0510a0 con 0x7ffaf4162890 2023-11-28T21:09:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.526+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffaf416f360 con 0x7ffad8066470 2023-11-28T21:09:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.534+0000 7ffae9ffb640 1 -- 172.21.15.6:0/1400014706 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281026 (secure 0 0 0) 0x7ffaf00aba20 con 0x7ffad8066470 2023-11-28T21:09:18.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-28T21:09:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffad8066470 msgr2=0x7ffad8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffad8066470 0x7ffad8068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00af000 tx=0x7ffaf00a7000 comp rx=0 tx=0).stop 2023-11-28T21:09:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf4162890 msgr2=0x7ffaf415cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf4162890 0x7ffaf415cde0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00c770 tx=0x7ffaec00cc30 comp rx=0 tx=0).stop 2023-11-28T21:09:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 shutdown_connections 2023-11-28T21:09:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffad8066470 0x7ffad8068930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf4162890 0x7ffaf415cde0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf415f230 0x7ffaf415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 --2- 172.21.15.6:0/1400014706 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf4070cf0 0x7ffaf40cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 >> 172.21.15.6:0/1400014706 conn(0x7ffaf406ab80 msgr2=0x7ffaf40b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 shutdown_connections 2023-11-28T21:09:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.538+0000 7ffafb32a640 1 -- 172.21.15.6:0/1400014706 wait complete. 2023-11-28T21:09:18.564 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-28T21:09:16.670325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":150,"acting":150,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219968,"kb_used_data":3792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754752,"statfs":{"total":773094113280,"available":772868866048,"internally_reserved":0,"allocated":3883008,"data_stored":2197928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.052024"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.631470+0000","last_change":"2023-11-28T21:09:12.631470+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.631470+0000","last_undegraded":"2023-11-28T21:09:12.631470+0000","last_fullsized":"2023-11-28T21:09:12.631470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.634341+0000","last_change":"2023-11-28T21:09:12.634341+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.634341+0000","last_undegraded":"2023-11-28T21:09:12.634341+0000","last_fullsized":"2023-11-28T21:09:12.634341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.643146+0000","last_change":"2023-11-28T21:09:12.643146+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.643146+0000","last_undegraded":"2023-11-28T21:09:12.643146+0000","last_fullsized":"2023-11-28T21:09:12.643146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638249+0000","last_change":"2023-11-28T21:09:12.638249+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638249+0000","last_undegraded":"2023-11-28T21:09:12.638249+0000","last_fullsized":"2023-11-28T21:09:12.638249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638633+0000","last_change":"2023-11-28T21:09:12.638633+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638633+0000","last_undegraded":"2023-11-28T21:09:12.638633+0000","last_fullsized":"2023-11-28T21:09:12.638633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627992+0000","last_change":"2023-11-28T21:09:12.627992+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627992+0000","last_undegraded":"2023-11-28T21:09:12.627992+0000","last_fullsized":"2023-11-28T21:09:12.627992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636633+0000","last_change":"2023-11-28T21:09:12.636633+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636633+0000","last_undegraded":"2023-11-28T21:09:12.636633+0000","last_fullsized":"2023-11-28T21:09:12.636633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636124+0000","last_change":"2023-11-28T21:09:12.636124+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636124+0000","last_undegraded":"2023-11-28T21:09:12.636124+0000","last_fullsized":"2023-11-28T21:09:12.636124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.642661+0000","last_change":"2023-11-28T21:09:12.642661+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.642661+0000","last_undegraded":"2023-11-28T21:09:12.642661+0000","last_fullsized":"2023-11-28T21:09:12.642661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.633483+0000","last_change":"2023-11-28T21:09:12.633483+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.633483+0000","last_undegraded":"2023-11-28T21:09:12.633483+0000","last_fullsized":"2023-11-28T21:09:12.633483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636495+0000","last_change":"2023-11-28T21:09:12.636495+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636495+0000","last_undegraded":"2023-11-28T21:09:12.636495+0000","last_fullsized":"2023-11-28T21:09:12.636495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636252+0000","last_change":"2023-11-28T21:09:12.636252+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636252+0000","last_undegraded":"2023-11-28T21:09:12.636252+0000","last_fullsized":"2023-11-28T21:09:12.636252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.641316+0000","last_change":"2023-11-28T21:09:12.641316+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.641316+0000","last_undegraded":"2023-11-28T21:09:12.641316+0000","last_fullsized":"2023-11-28T21:09:12.641316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627117+0000","last_change":"2023-11-28T21:09:12.627117+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627117+0000","last_undegraded":"2023-11-28T21:09:12.627117+0000","last_fullsized":"2023-11-28T21:09:12.627117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627814+0000","last_change":"2023-11-28T21:09:12.627814+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627814+0000","last_undegraded":"2023-11-28T21:09:12.627814+0000","last_fullsized":"2023-11-28T21:09:12.627814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.633262+0000","last_change":"2023-11-28T21:09:12.633262+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.633262+0000","last_undegraded":"2023-11-28T21:09:12.633262+0000","last_fullsized":"2023-11-28T21:09:12.633262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.635679+0000","last_change":"2023-11-28T21:09:12.635679+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.635679+0000","last_undegraded":"2023-11-28T21:09:12.635679+0000","last_fullsized":"2023-11-28T21:09:12.635679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.626518+0000","last_change":"2023-11-28T21:09:12.626518+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.626518+0000","last_undegraded":"2023-11-28T21:09:12.626518+0000","last_fullsized":"2023-11-28T21:09:12.626518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638016+0000","last_change":"2023-11-28T21:09:12.638016+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638016+0000","last_undegraded":"2023-11-28T21:09:12.638016+0000","last_fullsized":"2023-11-28T21:09:12.638016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.631066+0000","last_change":"2023-11-28T21:09:12.631066+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.631066+0000","last_undegraded":"2023-11-28T21:09:12.631066+0000","last_fullsized":"2023-11-28T21:09:12.631066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638046+0000","last_change":"2023-11-28T21:09:12.638046+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638046+0000","last_undegraded":"2023-11-28T21:09:12.638046+0000","last_fullsized":"2023-11-28T21:09:12.638046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.651714+0000","last_change":"2023-11-28T21:09:12.649448+0000","last_active":"2023-11-28T21:09:12.651714+0000","last_peered":"2023-11-28T21:09:12.651714+0000","last_clean":"2023-11-28T21:09:12.651714+0000","last_became_active":"2023-11-28T21:09:12.649106+0000","last_became_peered":"2023-11-28T21:09:12.649106+0000","last_unstale":"2023-11-28T21:09:12.651714+0000","last_undegraded":"2023-11-28T21:09:12.651714+0000","last_fullsized":"2023-11-28T21:09:12.651714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:01:10.139438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.630491+0000","last_change":"2023-11-28T21:09:12.630491+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.630491+0000","last_undegraded":"2023-11-28T21:09:12.630491+0000","last_fullsized":"2023-11-28T21:09:12.630491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627013+0000","last_change":"2023-11-28T21:09:11.627013+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627013+0000","last_undegraded":"2023-11-28T21:09:11.627013+0000","last_fullsized":"2023-11-28T21:09:11.627013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.628323+0000","last_change":"2023-11-28T21:09:12.628323+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.628323+0000","last_undegraded":"2023-11-28T21:09:12.628323+0000","last_fullsized":"2023-11-28T21:09:12.628323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.625558+0000","last_change":"2023-11-28T21:09:11.625558+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.625558+0000","last_undegraded":"2023-11-28T21:09:11.625558+0000","last_fullsized":"2023-11-28T21:09:11.625558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.655585+0000","last_change":"2023-11-28T21:09:12.651372+0000","last_active":"2023-11-28T21:09:12.655585+0000","last_peered":"2023-11-28T21:09:12.655585+0000","last_clean":"2023-11-28T21:09:12.655585+0000","last_became_active":"2023-11-28T21:09:12.651014+0000","last_became_peered":"2023-11-28T21:09:12.651014+0000","last_unstale":"2023-11-28T21:09:12.655585+0000","last_undegraded":"2023-11-28T21:09:12.655585+0000","last_fullsized":"2023-11-28T21:09:12.655585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:46.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636173+0000","last_change":"2023-11-28T21:09:12.636173+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636173+0000","last_undegraded":"2023-11-28T21:09:12.636173+0000","last_fullsized":"2023-11-28T21:09:12.636173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.663791+0000","last_change":"2023-11-28T21:09:12.658946+0000","last_active":"2023-11-28T21:09:12.663791+0000","last_peered":"2023-11-28T21:09:12.663791+0000","last_clean":"2023-11-28T21:09:12.663791+0000","last_became_active":"2023-11-28T21:09:12.658480+0000","last_became_peered":"2023-11-28T21:09:12.658480+0000","last_unstale":"2023-11-28T21:09:12.663791+0000","last_undegraded":"2023-11-28T21:09:12.663791+0000","last_fullsized":"2023-11-28T21:09:12.663791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:38.368381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.640014+0000","last_change":"2023-11-28T21:09:12.640014+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.640014+0000","last_undegraded":"2023-11-28T21:09:12.640014+0000","last_fullsized":"2023-11-28T21:09:12.640014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.662962+0000","last_change":"2023-11-28T21:09:12.656711+0000","last_active":"2023-11-28T21:09:12.662962+0000","last_peered":"2023-11-28T21:09:12.662962+0000","last_clean":"2023-11-28T21:09:12.662962+0000","last_became_active":"2023-11-28T21:09:12.656379+0000","last_became_peered":"2023-11-28T21:09:12.656379+0000","last_unstale":"2023-11-28T21:09:12.662962+0000","last_undegraded":"2023-11-28T21:09:12.662962+0000","last_fullsized":"2023-11-28T21:09:12.662962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:59:30.654957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.625789+0000","last_change":"2023-11-28T21:09:12.625789+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.625789+0000","last_undegraded":"2023-11-28T21:09:12.625789+0000","last_fullsized":"2023-11-28T21:09:12.625789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.625715+0000","last_change":"2023-11-28T21:09:11.625715+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.625715+0000","last_undegraded":"2023-11-28T21:09:11.625715+0000","last_fullsized":"2023-11-28T21:09:11.625715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.650128+0000","last_change":"2023-11-28T21:09:12.646807+0000","last_active":"2023-11-28T21:09:12.650128+0000","last_peered":"2023-11-28T21:09:12.650128+0000","last_clean":"2023-11-28T21:09:12.650128+0000","last_became_active":"2023-11-28T21:09:12.646520+0000","last_became_peered":"2023-11-28T21:09:12.646520+0000","last_unstale":"2023-11-28T21:09:12.650128+0000","last_undegraded":"2023-11-28T21:09:12.650128+0000","last_fullsized":"2023-11-28T21:09:12.650128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:31:03.560952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636620+0000","last_change":"2023-11-28T21:09:12.636620+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636620+0000","last_undegraded":"2023-11-28T21:09:12.636620+0000","last_fullsized":"2023-11-28T21:09:12.636620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627001+0000","last_change":"2023-11-28T21:09:11.627001+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627001+0000","last_undegraded":"2023-11-28T21:09:11.627001+0000","last_fullsized":"2023-11-28T21:09:11.627001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.626478+0000","last_change":"2023-11-28T21:09:11.626478+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.626478+0000","last_undegraded":"2023-11-28T21:09:11.626478+0000","last_fullsized":"2023-11-28T21:09:11.626478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.658313+0000","last_change":"2023-11-28T21:09:12.651865+0000","last_active":"2023-11-28T21:09:12.658313+0000","last_peered":"2023-11-28T21:09:12.658313+0000","last_clean":"2023-11-28T21:09:12.658313+0000","last_became_active":"2023-11-28T21:09:12.651478+0000","last_became_peered":"2023-11-28T21:09:12.651478+0000","last_unstale":"2023-11-28T21:09:12.658313+0000","last_undegraded":"2023-11-28T21:09:12.658313+0000","last_fullsized":"2023-11-28T21:09:12.658313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:52.212158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.634846+0000","last_change":"2023-11-28T21:09:12.634846+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.634846+0000","last_undegraded":"2023-11-28T21:09:12.634846+0000","last_fullsized":"2023-11-28T21:09:12.634846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.626312+0000","last_change":"2023-11-28T21:09:11.626312+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.626312+0000","last_undegraded":"2023-11-28T21:09:11.626312+0000","last_fullsized":"2023-11-28T21:09:11.626312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.650069+0000","last_change":"2023-11-28T21:09:12.646329+0000","last_active":"2023-11-28T21:09:12.650069+0000","last_peered":"2023-11-28T21:09:12.650069+0000","last_clean":"2023-11-28T21:09:12.650069+0000","last_became_active":"2023-11-28T21:09:12.646002+0000","last_became_peered":"2023-11-28T21:09:12.646002+0000","last_unstale":"2023-11-28T21:09:12.650069+0000","last_undegraded":"2023-11-28T21:09:12.650069+0000","last_fullsized":"2023-11-28T21:09:12.650069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:59:46.879447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624590+0000","last_change":"2023-11-28T21:09:11.624590+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624590+0000","last_undegraded":"2023-11-28T21:09:11.624590+0000","last_fullsized":"2023-11-28T21:09:11.624590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.637598+0000","last_change":"2023-11-28T21:09:12.637598+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.637598+0000","last_undegraded":"2023-11-28T21:09:12.637598+0000","last_fullsized":"2023-11-28T21:09:12.637598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624989+0000","last_change":"2023-11-28T21:09:11.624989+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624989+0000","last_undegraded":"2023-11-28T21:09:11.624989+0000","last_fullsized":"2023-11-28T21:09:11.624989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.630468+0000","last_change":"2023-11-28T21:09:12.630468+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.630468+0000","last_undegraded":"2023-11-28T21:09:12.630468+0000","last_fullsized":"2023-11-28T21:09:12.630468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627891+0000","last_change":"2023-11-28T21:09:11.627891+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627891+0000","last_undegraded":"2023-11-28T21:09:11.627891+0000","last_fullsized":"2023-11-28T21:09:11.627891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.627343+0000","last_change":"2023-11-28T21:09:12.627343+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.627343+0000","last_undegraded":"2023-11-28T21:09:12.627343+0000","last_fullsized":"2023-11-28T21:09:12.627343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624030+0000","last_change":"2023-11-28T21:09:11.624030+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624030+0000","last_undegraded":"2023-11-28T21:09:11.624030+0000","last_fullsized":"2023-11-28T21:09:11.624030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.642668+0000","last_change":"2023-11-28T21:09:12.642668+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.642668+0000","last_undegraded":"2023-11-28T21:09:12.642668+0000","last_fullsized":"2023-11-28T21:09:12.642668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.650089+0000","last_change":"2023-11-28T21:09:12.646449+0000","last_active":"2023-11-28T21:09:12.650089+0000","last_peered":"2023-11-28T21:09:12.650089+0000","last_clean":"2023-11-28T21:09:12.650089+0000","last_became_active":"2023-11-28T21:09:12.645943+0000","last_became_peered":"2023-11-28T21:09:12.645943+0000","last_unstale":"2023-11-28T21:09:12.650089+0000","last_undegraded":"2023-11-28T21:09:12.650089+0000","last_fullsized":"2023-11-28T21:09:12.650089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:45:27.395345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.649813+0000","last_change":"2023-11-28T21:09:12.645973+0000","last_active":"2023-11-28T21:09:12.649813+0000","last_peered":"2023-11-28T21:09:12.649813+0000","last_clean":"2023-11-28T21:09:12.649813+0000","last_became_active":"2023-11-28T21:09:12.645659+0000","last_became_peered":"2023-11-28T21:09:12.645659+0000","last_unstale":"2023-11-28T21:09:12.649813+0000","last_undegraded":"2023-11-28T21:09:12.649813+0000","last_fullsized":"2023-11-28T21:09:12.649813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:10:03.868477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.639667+0000","last_change":"2023-11-28T21:09:12.639667+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.639667+0000","last_undegraded":"2023-11-28T21:09:12.639667+0000","last_fullsized":"2023-11-28T21:09:12.639667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.663778+0000","last_change":"2023-11-28T21:09:12.658797+0000","last_active":"2023-11-28T21:09:12.663778+0000","last_peered":"2023-11-28T21:09:12.663778+0000","last_clean":"2023-11-28T21:09:12.663778+0000","last_became_active":"2023-11-28T21:09:12.658507+0000","last_became_peered":"2023-11-28T21:09:12.658507+0000","last_unstale":"2023-11-28T21:09:12.663778+0000","last_undegraded":"2023-11-28T21:09:12.663778+0000","last_fullsized":"2023-11-28T21:09:12.663778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:11:20.698599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.639433+0000","last_change":"2023-11-28T21:09:12.639433+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.639433+0000","last_undegraded":"2023-11-28T21:09:12.639433+0000","last_fullsized":"2023-11-28T21:09:12.639433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627111+0000","last_change":"2023-11-28T21:09:11.627111+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627111+0000","last_undegraded":"2023-11-28T21:09:11.627111+0000","last_fullsized":"2023-11-28T21:09:11.627111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.640063+0000","last_change":"2023-11-28T21:09:12.640063+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.640063+0000","last_undegraded":"2023-11-28T21:09:12.640063+0000","last_fullsized":"2023-11-28T21:09:12.640063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.651445+0000","last_change":"2023-11-28T21:09:12.647997+0000","last_active":"2023-11-28T21:09:12.651445+0000","last_peered":"2023-11-28T21:09:12.651445+0000","last_clean":"2023-11-28T21:09:12.651445+0000","last_became_active":"2023-11-28T21:09:12.647711+0000","last_became_peered":"2023-11-28T21:09:12.647711+0000","last_unstale":"2023-11-28T21:09:12.651445+0000","last_undegraded":"2023-11-28T21:09:12.651445+0000","last_fullsized":"2023-11-28T21:09:12.651445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:15:51.100978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.634177+0000","last_change":"2023-11-28T21:09:12.634177+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.634177+0000","last_undegraded":"2023-11-28T21:09:12.634177+0000","last_fullsized":"2023-11-28T21:09:12.634177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.646587+0000","last_change":"2023-11-28T21:09:12.640178+0000","last_active":"2023-11-28T21:09:12.646587+0000","last_peered":"2023-11-28T21:09:12.646587+0000","last_clean":"2023-11-28T21:09:12.646587+0000","last_became_active":"2023-11-28T21:09:12.639755+0000","last_became_peered":"2023-11-28T21:09:12.639755+0000","last_unstale":"2023-11-28T21:09:12.646587+0000","last_undegraded":"2023-11-28T21:09:12.646587+0000","last_fullsized":"2023-11-28T21:09:12.646587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:33:58.726920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.638856+0000","last_change":"2023-11-28T21:09:12.638856+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.638856+0000","last_undegraded":"2023-11-28T21:09:12.638856+0000","last_fullsized":"2023-11-28T21:09:12.638856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.658331+0000","last_change":"2023-11-28T21:09:12.652318+0000","last_active":"2023-11-28T21:09:12.658331+0000","last_peered":"2023-11-28T21:09:12.658331+0000","last_clean":"2023-11-28T21:09:12.658331+0000","last_became_active":"2023-11-28T21:09:12.651417+0000","last_became_peered":"2023-11-28T21:09:12.651417+0000","last_unstale":"2023-11-28T21:09:12.658331+0000","last_undegraded":"2023-11-28T21:09:12.658331+0000","last_fullsized":"2023-11-28T21:09:12.658331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:29.233767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.639172+0000","last_change":"2023-11-28T21:09:12.639172+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.639172+0000","last_undegraded":"2023-11-28T21:09:12.639172+0000","last_fullsized":"2023-11-28T21:09:12.639172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.623397+0000","last_change":"2023-11-28T21:09:11.623397+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.623397+0000","last_undegraded":"2023-11-28T21:09:11.623397+0000","last_fullsized":"2023-11-28T21:09:11.623397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.642147+0000","last_change":"2023-11-28T21:09:12.642147+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.642147+0000","last_undegraded":"2023-11-28T21:09:12.642147+0000","last_fullsized":"2023-11-28T21:09:12.642147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624182+0000","last_change":"2023-11-28T21:09:11.624182+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624182+0000","last_undegraded":"2023-11-28T21:09:11.624182+0000","last_fullsized":"2023-11-28T21:09:11.624182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.623393+0000","last_change":"2023-11-28T21:09:11.623393+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.623393+0000","last_undegraded":"2023-11-28T21:09:11.623393+0000","last_fullsized":"2023-11-28T21:09:11.623393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.630365+0000","last_change":"2023-11-28T21:09:12.630365+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.630365+0000","last_undegraded":"2023-11-28T21:09:12.630365+0000","last_fullsized":"2023-11-28T21:09:12.630365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624693+0000","last_change":"2023-11-28T21:09:11.624693+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624693+0000","last_undegraded":"2023-11-28T21:09:11.624693+0000","last_fullsized":"2023-11-28T21:09:11.624693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.624013+0000","last_change":"2023-11-28T21:09:11.624013+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.624013+0000","last_undegraded":"2023-11-28T21:09:11.624013+0000","last_fullsized":"2023-11-28T21:09:11.624013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T21:09:12.615310+0000","last_change":"2023-11-28T21:09:12.615310+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.615310+0000","last_undegraded":"2023-11-28T21:09:12.615310+0000","last_fullsized":"2023-11-28T21:09:12.615310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.647172+0000","last_change":"2023-11-28T21:09:12.644889+0000","last_active":"2023-11-28T21:09:12.647172+0000","last_peered":"2023-11-28T21:09:12.647172+0000","last_clean":"2023-11-28T21:09:12.647172+0000","last_became_active":"2023-11-28T21:09:12.644463+0000","last_became_peered":"2023-11-28T21:09:12.644463+0000","last_unstale":"2023-11-28T21:09:12.647172+0000","last_undegraded":"2023-11-28T21:09:12.647172+0000","last_fullsized":"2023-11-28T21:09:12.647172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:07:12.947599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.628205+0000","last_change":"2023-11-28T21:09:12.628205+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.628205+0000","last_undegraded":"2023-11-28T21:09:12.628205+0000","last_fullsized":"2023-11-28T21:09:12.628205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-28T21:09:11.627379+0000","last_change":"2023-11-28T21:09:11.627379+0000","last_active":"2023-11-28T21:09:11.604497+0000","last_peered":"2023-11-28T21:09:11.604497+0000","last_clean":"2023-11-28T21:09:11.604497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:11.627379+0000","last_undegraded":"2023-11-28T21:09:11.627379+0000","last_fullsized":"2023-11-28T21:09:11.627379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T21:09:12.636794+0000","last_change":"2023-11-28T21:09:12.636794+0000","last_active":"2023-11-28T21:09:12.615310+0000","last_peered":"2023-11-28T21:09:12.615310+0000","last_clean":"2023-11-28T21:09:12.615310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T21:09:12.636794+0000","last_undegraded":"2023-11-28T21:09:12.636794+0000","last_fullsized":"2023-11-28T21:09:12.636794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T21:09:12.647683+0000","last_change":"2023-11-28T21:09:12.646304+0000","last_active":"2023-11-28T21:09:12.647683+0000","last_peered":"2023-11-28T21:09:12.647683+0000","last_clean":"2023-11-28T21:09:12.647683+0000","last_became_active":"2023-11-28T21:09:12.645620+0000","last_became_peered":"2023-11-28T21:09:12.645620+0000","last_unstale":"2023-11-28T21:09:12.647683+0000","last_undegraded":"2023-11-28T21:09:12.647683+0000","last_fullsized":"2023-11-28T21:09:12.647683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:40:36.785608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T21:09:11.630373+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-28T21:09:11.630373+0000","last_peered":"2023-11-28T21:09:11.630373+0000","last_clean":"2023-11-28T21:09:11.630373+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-28T21:09:11.630373+0000","last_undegraded":"2023-11-28T21:09:11.630373+0000","last_fullsized":"2023-11-28T21:09:11.630373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":718915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79900000000000004}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.82099999999999995}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.75800000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.49099999999999999}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.55200000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64900000000000002}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73999999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.624}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.76300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.434}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.68200000000000005}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56200000000000006}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.497}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.623},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.58199999999999996}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.65100000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.752}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.60899999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.70099999999999996}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.51900000000000002}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.82699999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.77800000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.4930000000000003,"5min":4.4930000000000003,"15min":4.4930000000000003},"last":0.51500000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":6.4770000000000003,"5min":6.4770000000000003,"15min":6.4770000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.0789999999999997,"5min":5.0789999999999997,"15min":5.0789999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.7190000000000003,"5min":6.7190000000000003,"15min":6.7190000000000003},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.7350000000000003,"5min":4.7350000000000003,"15min":4.7350000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.4640000000000004,"5min":4.4640000000000004,"15min":4.4640000000000004},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.7910000000000004,"5min":4.7910000000000004,"15min":4.7910000000000004},"last":0.86799999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":122730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":6.8869999999999996,"5min":6.8869999999999996,"15min":6.8869999999999996},"last":0.33900000000000002}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":7.0759999999999996,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.42799999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":6.9359999999999999,"5min":6.9359999999999999,"15min":6.9359999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.70299999999999996}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.2589999999999999,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.3290000000000002,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.61899999999999999}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":0.67800000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.496,"5min":3.496,"15min":3.496},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.177,"5min":3.177,"15min":3.177},"last":0.58999999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.374},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.433}]},{"osd":2,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.62},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.75700000000000001}]},{"osd":7,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":713098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.313},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51500000000000001}]},{"osd":2,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.745},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.91900000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":0.878}]},{"osd":6,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:09:18.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-28T21:09:18.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.631470+0000', 'last_change': '2023-11-28T21:09:12.631470+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.631470+0000', 'last_undegraded': '2023-11-28T21:09:12.631470+0000', 'last_fullsized': '2023-11-28T21:09:12.631470+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T21:09:18.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-28T21:09:18.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-28T21:09:18.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.634341+0000', 'last_change': '2023-11-28T21:09:12.634341+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.634341+0000', 'last_undegraded': '2023-11-28T21:09:12.634341+0000', 'last_fullsized': '2023-11-28T21:09:12.634341+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-28T21:09:18.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-28T21:09:18.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.643146+0000', 'last_change': '2023-11-28T21:09:12.643146+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.643146+0000', 'last_undegraded': '2023-11-28T21:09:12.643146+0000', 'last_fullsized': '2023-11-28T21:09:12.643146+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T21:09:18.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-28T21:09:18.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-28T21:09:18.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.638249+0000', 'last_change': '2023-11-28T21:09:12.638249+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.638249+0000', 'last_undegraded': '2023-11-28T21:09:12.638249+0000', 'last_fullsized': '2023-11-28T21:09:12.638249+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-28T21:09:18.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.638633+0000', 'last_change': '2023-11-28T21:09:12.638633+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.638633+0000', 'last_undegraded': '2023-11-28T21:09:12.638633+0000', 'last_fullsized': '2023-11-28T21:09:12.638633+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-28T21:09:18.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.627992+0000', 'last_change': '2023-11-28T21:09:12.627992+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.627992+0000', 'last_undegraded': '2023-11-28T21:09:12.627992+0000', 'last_fullsized': '2023-11-28T21:09:12.627992+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T21:09:18.572 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-28T21:09:18.572 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-28T21:09:18.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.636633+0000', 'last_change': '2023-11-28T21:09:12.636633+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.636633+0000', 'last_undegraded': '2023-11-28T21:09:12.636633+0000', 'last_fullsized': '2023-11-28T21:09:12.636633+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-28T21:09:18.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.636124+0000', 'last_change': '2023-11-28T21:09:12.636124+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.636124+0000', 'last_undegraded': '2023-11-28T21:09:12.636124+0000', 'last_fullsized': '2023-11-28T21:09:12.636124+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-28T21:09:18.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.642661+0000', 'last_change': '2023-11-28T21:09:12.642661+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.642661+0000', 'last_undegraded': '2023-11-28T21:09:12.642661+0000', 'last_fullsized': '2023-11-28T21:09:12.642661+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T21:09:18.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-28T21:09:18.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-28T21:09:18.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.633483+0000', 'last_change': '2023-11-28T21:09:12.633483+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.633483+0000', 'last_undegraded': '2023-11-28T21:09:12.633483+0000', 'last_fullsized': '2023-11-28T21:09:12.633483+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-28T21:09:18.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.636495+0000', 'last_change': '2023-11-28T21:09:12.636495+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.636495+0000', 'last_undegraded': '2023-11-28T21:09:12.636495+0000', 'last_fullsized': '2023-11-28T21:09:12.636495+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-28T21:09:18.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.636252+0000', 'last_change': '2023-11-28T21:09:12.636252+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.636252+0000', 'last_undegraded': '2023-11-28T21:09:12.636252+0000', 'last_fullsized': '2023-11-28T21:09:12.636252+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-28T21:09:18.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-28T21:09:18.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-28T21:09:18.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.641316+0000', 'last_change': '2023-11-28T21:09:12.641316+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.641316+0000', 'last_undegraded': '2023-11-28T21:09:12.641316+0000', 'last_fullsized': '2023-11-28T21:09:12.641316+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T21:09:18.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-28T21:09:18.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.627117+0000', 'last_change': '2023-11-28T21:09:12.627117+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.627117+0000', 'last_undegraded': '2023-11-28T21:09:12.627117+0000', 'last_fullsized': '2023-11-28T21:09:12.627117+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T21:09:18.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-28T21:09:18.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.627814+0000', 'last_change': '2023-11-28T21:09:12.627814+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.627814+0000', 'last_undegraded': '2023-11-28T21:09:12.627814+0000', 'last_fullsized': '2023-11-28T21:09:12.627814+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T21:09:18.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-28T21:09:18.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-28T21:09:18.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.633262+0000', 'last_change': '2023-11-28T21:09:12.633262+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.633262+0000', 'last_undegraded': '2023-11-28T21:09:12.633262+0000', 'last_fullsized': '2023-11-28T21:09:12.633262+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-28T21:09:18.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-28T21:09:18.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-28T21:09:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-28T21:09:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.635679+0000', 'last_change': '2023-11-28T21:09:12.635679+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.635679+0000', 'last_undegraded': '2023-11-28T21:09:12.635679+0000', 'last_fullsized': '2023-11-28T21:09:12.635679+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-28T21:09:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.626518+0000', 'last_change': '2023-11-28T21:09:12.626518+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.626518+0000', 'last_undegraded': '2023-11-28T21:09:12.626518+0000', 'last_fullsized': '2023-11-28T21:09:12.626518+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T21:09:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-28T21:09:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.638016+0000', 'last_change': '2023-11-28T21:09:12.638016+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.638016+0000', 'last_undegraded': '2023-11-28T21:09:12.638016+0000', 'last_fullsized': '2023-11-28T21:09:12.638016+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.631066+0000', 'last_change': '2023-11-28T21:09:12.631066+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.631066+0000', 'last_undegraded': '2023-11-28T21:09:12.631066+0000', 'last_fullsized': '2023-11-28T21:09:12.631066+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.638046+0000', 'last_change': '2023-11-28T21:09:12.638046+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.638046+0000', 'last_undegraded': '2023-11-28T21:09:12.638046+0000', 'last_fullsized': '2023-11-28T21:09:12.638046+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.630491+0000', 'last_change': '2023-11-28T21:09:12.630491+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.630491+0000', 'last_undegraded': '2023-11-28T21:09:12.630491+0000', 'last_fullsized': '2023-11-28T21:09:12.630491+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.627013+0000', 'last_change': '2023-11-28T21:09:11.627013+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.627013+0000', 'last_undegraded': '2023-11-28T21:09:11.627013+0000', 'last_fullsized': '2023-11-28T21:09:11.627013+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T21:09:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.628323+0000', 'last_change': '2023-11-28T21:09:12.628323+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.628323+0000', 'last_undegraded': '2023-11-28T21:09:12.628323+0000', 'last_fullsized': '2023-11-28T21:09:12.628323+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.625558+0000', 'last_change': '2023-11-28T21:09:11.625558+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.625558+0000', 'last_undegraded': '2023-11-28T21:09:11.625558+0000', 'last_fullsized': '2023-11-28T21:09:11.625558+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.636173+0000', 'last_change': '2023-11-28T21:09:12.636173+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.636173+0000', 'last_undegraded': '2023-11-28T21:09:12.636173+0000', 'last_fullsized': '2023-11-28T21:09:12.636173+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.640014+0000', 'last_change': '2023-11-28T21:09:12.640014+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.640014+0000', 'last_undegraded': '2023-11-28T21:09:12.640014+0000', 'last_fullsized': '2023-11-28T21:09:12.640014+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.625789+0000', 'last_change': '2023-11-28T21:09:12.625789+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.625789+0000', 'last_undegraded': '2023-11-28T21:09:12.625789+0000', 'last_fullsized': '2023-11-28T21:09:12.625789+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.625715+0000', 'last_change': '2023-11-28T21:09:11.625715+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.625715+0000', 'last_undegraded': '2023-11-28T21:09:11.625715+0000', 'last_fullsized': '2023-11-28T21:09:11.625715+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.636620+0000', 'last_change': '2023-11-28T21:09:12.636620+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.636620+0000', 'last_undegraded': '2023-11-28T21:09:12.636620+0000', 'last_fullsized': '2023-11-28T21:09:12.636620+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.627001+0000', 'last_change': '2023-11-28T21:09:11.627001+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.627001+0000', 'last_undegraded': '2023-11-28T21:09:11.627001+0000', 'last_fullsized': '2023-11-28T21:09:11.627001+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T21:09:18.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.626478+0000', 'last_change': '2023-11-28T21:09:11.626478+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.626478+0000', 'last_undegraded': '2023-11-28T21:09:11.626478+0000', 'last_fullsized': '2023-11-28T21:09:11.626478+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.634846+0000', 'last_change': '2023-11-28T21:09:12.634846+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.634846+0000', 'last_undegraded': '2023-11-28T21:09:12.634846+0000', 'last_fullsized': '2023-11-28T21:09:12.634846+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.626312+0000', 'last_change': '2023-11-28T21:09:11.626312+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.626312+0000', 'last_undegraded': '2023-11-28T21:09:11.626312+0000', 'last_fullsized': '2023-11-28T21:09:11.626312+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T21:09:18.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.624590+0000', 'last_change': '2023-11-28T21:09:11.624590+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.624590+0000', 'last_undegraded': '2023-11-28T21:09:11.624590+0000', 'last_fullsized': '2023-11-28T21:09:11.624590+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.637598+0000', 'last_change': '2023-11-28T21:09:12.637598+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.637598+0000', 'last_undegraded': '2023-11-28T21:09:12.637598+0000', 'last_fullsized': '2023-11-28T21:09:12.637598+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.624989+0000', 'last_change': '2023-11-28T21:09:11.624989+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.624989+0000', 'last_undegraded': '2023-11-28T21:09:11.624989+0000', 'last_fullsized': '2023-11-28T21:09:11.624989+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T21:09:18.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.630468+0000', 'last_change': '2023-11-28T21:09:12.630468+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.630468+0000', 'last_undegraded': '2023-11-28T21:09:12.630468+0000', 'last_fullsized': '2023-11-28T21:09:12.630468+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.627891+0000', 'last_change': '2023-11-28T21:09:11.627891+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.627891+0000', 'last_undegraded': '2023-11-28T21:09:11.627891+0000', 'last_fullsized': '2023-11-28T21:09:11.627891+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.627343+0000', 'last_change': '2023-11-28T21:09:12.627343+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.627343+0000', 'last_undegraded': '2023-11-28T21:09:12.627343+0000', 'last_fullsized': '2023-11-28T21:09:12.627343+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.624030+0000', 'last_change': '2023-11-28T21:09:11.624030+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.624030+0000', 'last_undegraded': '2023-11-28T21:09:11.624030+0000', 'last_fullsized': '2023-11-28T21:09:11.624030+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.642668+0000', 'last_change': '2023-11-28T21:09:12.642668+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.642668+0000', 'last_undegraded': '2023-11-28T21:09:12.642668+0000', 'last_fullsized': '2023-11-28T21:09:12.642668+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.639667+0000', 'last_change': '2023-11-28T21:09:12.639667+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.639667+0000', 'last_undegraded': '2023-11-28T21:09:12.639667+0000', 'last_fullsized': '2023-11-28T21:09:12.639667+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.639433+0000', 'last_change': '2023-11-28T21:09:12.639433+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.639433+0000', 'last_undegraded': '2023-11-28T21:09:12.639433+0000', 'last_fullsized': '2023-11-28T21:09:12.639433+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.627111+0000', 'last_change': '2023-11-28T21:09:11.627111+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.627111+0000', 'last_undegraded': '2023-11-28T21:09:11.627111+0000', 'last_fullsized': '2023-11-28T21:09:11.627111+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.640063+0000', 'last_change': '2023-11-28T21:09:12.640063+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.640063+0000', 'last_undegraded': '2023-11-28T21:09:12.640063+0000', 'last_fullsized': '2023-11-28T21:09:12.640063+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T21:09:18.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.634177+0000', 'last_change': '2023-11-28T21:09:12.634177+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.634177+0000', 'last_undegraded': '2023-11-28T21:09:12.634177+0000', 'last_fullsized': '2023-11-28T21:09:12.634177+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.638856+0000', 'last_change': '2023-11-28T21:09:12.638856+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.638856+0000', 'last_undegraded': '2023-11-28T21:09:12.638856+0000', 'last_fullsized': '2023-11-28T21:09:12.638856+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.639172+0000', 'last_change': '2023-11-28T21:09:12.639172+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.639172+0000', 'last_undegraded': '2023-11-28T21:09:12.639172+0000', 'last_fullsized': '2023-11-28T21:09:12.639172+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.623397+0000', 'last_change': '2023-11-28T21:09:11.623397+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.623397+0000', 'last_undegraded': '2023-11-28T21:09:11.623397+0000', 'last_fullsized': '2023-11-28T21:09:11.623397+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.642147+0000', 'last_change': '2023-11-28T21:09:12.642147+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.642147+0000', 'last_undegraded': '2023-11-28T21:09:12.642147+0000', 'last_fullsized': '2023-11-28T21:09:12.642147+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T21:09:18.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.624182+0000', 'last_change': '2023-11-28T21:09:11.624182+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.624182+0000', 'last_undegraded': '2023-11-28T21:09:11.624182+0000', 'last_fullsized': '2023-11-28T21:09:11.624182+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.623393+0000', 'last_change': '2023-11-28T21:09:11.623393+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.623393+0000', 'last_undegraded': '2023-11-28T21:09:11.623393+0000', 'last_fullsized': '2023-11-28T21:09:11.623393+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.630365+0000', 'last_change': '2023-11-28T21:09:12.630365+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.630365+0000', 'last_undegraded': '2023-11-28T21:09:12.630365+0000', 'last_fullsized': '2023-11-28T21:09:12.630365+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.624693+0000', 'last_change': '2023-11-28T21:09:11.624693+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.624693+0000', 'last_undegraded': '2023-11-28T21:09:11.624693+0000', 'last_fullsized': '2023-11-28T21:09:11.624693+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T21:09:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-28T21:09:18.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-28T21:09:18.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.624013+0000', 'last_change': '2023-11-28T21:09:11.624013+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.624013+0000', 'last_undegraded': '2023-11-28T21:09:11.624013+0000', 'last_fullsized': '2023-11-28T21:09:11.624013+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T21:09:18.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-28T21:09:18.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T21:09:12.615310+0000', 'last_change': '2023-11-28T21:09:12.615310+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.615310+0000', 'last_undegraded': '2023-11-28T21:09:12.615310+0000', 'last_fullsized': '2023-11-28T21:09:12.615310+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T21:09:18.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-28T21:09:18.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.628205+0000', 'last_change': '2023-11-28T21:09:12.628205+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.628205+0000', 'last_undegraded': '2023-11-28T21:09:12.628205+0000', 'last_fullsized': '2023-11-28T21:09:12.628205+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T21:09:18.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-28T21:09:18.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:11.627379+0000', 'last_change': '2023-11-28T21:09:11.627379+0000', 'last_active': '2023-11-28T21:09:11.604497+0000', 'last_peered': '2023-11-28T21:09:11.604497+0000', 'last_clean': '2023-11-28T21:09:11.604497+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:11.627379+0000', 'last_undegraded': '2023-11-28T21:09:11.627379+0000', 'last_fullsized': '2023-11-28T21:09:11.627379+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:11.604497+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T21:09:18.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-28T21:09:18.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T21:09:12.636794+0000', 'last_change': '2023-11-28T21:09:12.636794+0000', 'last_active': '2023-11-28T21:09:12.615310+0000', 'last_peered': '2023-11-28T21:09:12.615310+0000', 'last_clean': '2023-11-28T21:09:12.615310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T21:09:12.636794+0000', 'last_undegraded': '2023-11-28T21:09:12.636794+0000', 'last_fullsized': '2023-11-28T21:09:12.636794+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'last_clean_scrub_stamp': '2023-11-28T21:09:12.615310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T21:09:18.595 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T21:09:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39c1b1d640 1 Processor -- start 2023-11-28T21:09:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39c1b1d640 1 -- start start 2023-11-28T21:09:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39c1b1d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39bc13e090 0x7f39bc0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39c1b1d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc15c250 0x7f39bc140780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39c1b1d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc0cea50 con 0x7f39bc0cdc80 2023-11-28T21:09:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39c1b1d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc13e470 con 0x7f39bc13e090 2023-11-28T21:09:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39c1b1d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0ce1b0 con 0x7f39bc15c250 2023-11-28T21:09:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39bb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39bc13e090 0x7f39bc0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39baffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc15c250 0x7f39bc140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39bb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39bc13e090 0x7f39bc0cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53552/0 (socket says 172.21.15.6:53552) 2023-11-28T21:09:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39baffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc15c250 0x7f39bc140780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:44572/0 (socket says 172.21.15.6:44572) 2023-11-28T21:09:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39bb7fe640 1 -- 172.21.15.6:0/14218310 learned_addr learned my addr 172.21.15.6:0/14218310 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39bbfff640 1 --1- 172.21.15.6:0/14218310 >> v1:172.21.15.31:6789/0 conn(0x7f39bc0cdc80 0x7f39bc15eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:59368/0 (socket says 172.21.15.6:59368) 2023-11-28T21:09:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39bb7fe640 1 -- 172.21.15.6:0/14218310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc15c250 msgr2=0x7f39bc140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39bb7fe640 1 --2- 172.21.15.6:0/14218310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc15c250 0x7f39bc140780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.742+0000 7f39bb7fe640 1 -- 172.21.15.6:0/14218310 >> v1:172.21.15.31:6789/0 conn(0x7f39bc0cdc80 legacy=0x7f39bc15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.746+0000 7f39bb7fe640 1 -- 172.21.15.6:0/14218310 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc0ce490 con 0x7f39bc13e090 2023-11-28T21:09:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.746+0000 7f39ba7fc640 1 -- 172.21.15.6:0/14218310 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235668666 0 0) 0x7f39bc0cea50 con 0x7f39bc0cdc80 2023-11-28T21:09:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.746+0000 7f39baffd640 1 --2- 172.21.15.6:0/14218310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc15c250 0x7f39bc140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T21:09:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.746+0000 7f39bb7fe640 1 --2- 172.21.15.6:0/14218310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 0x7f39bc0cd740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009870 tx=0x7f39ac01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8fb5377145ed055 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.746+0000 7f39ba7fc640 1 -- 172.21.15.6:0/14218310 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0ab680 con 0x7f39bc13e090 2023-11-28T21:09:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.746+0000 7f39ba7fc640 1 -- 172.21.15.6:0/14218310 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac0ab7e0 con 0x7f39bc13e090 2023-11-28T21:09:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.746+0000 7f39ba7fc640 1 -- 172.21.15.6:0/14218310 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0abb70 con 0x7f39bc13e090 2023-11-28T21:09:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.746+0000 7f39c1b1d640 1 -- 172.21.15.6:0/14218310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 msgr2=0x7f39bc0cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.746+0000 7f39c1b1d640 1 --2- 172.21.15.6:0/14218310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 0x7f39bc0cd740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009870 tx=0x7f39ac01c480 comp rx=0 tx=0).stop 2023-11-28T21:09:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 -- 172.21.15.6:0/14218310 shutdown_connections 2023-11-28T21:09:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 --2- 172.21.15.6:0/14218310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc15c250 0x7f39bc140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 --2- 172.21.15.6:0/14218310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 0x7f39bc0cd740 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 -- 172.21.15.6:0/14218310 >> 172.21.15.6:0/14218310 conn(0x7f39bc06ab80 msgr2=0x7f39bc0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 -- 172.21.15.6:0/14218310 shutdown_connections 2023-11-28T21:09:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 -- 172.21.15.6:0/14218310 wait complete. 2023-11-28T21:09:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 Processor -- start 2023-11-28T21:09:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 -- start start 2023-11-28T21:09:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc0cdc80 0x7f39bc0aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 0x7f39bc0723d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39bc15c250 0x7f39bc1362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc072910 con 0x7f39bc15c250 2023-11-28T21:09:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0af0c0 con 0x7f39bc13e090 2023-11-28T21:09:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39c1b1d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0af3a0 con 0x7f39bc0cdc80 2023-11-28T21:09:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39bc15c250 0x7f39bc1362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39bc15c250 0x7f39bc1362d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40176/0 (socket says 172.21.15.6:40176) 2023-11-28T21:09:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bbfff640 1 -- 172.21.15.6:0/1447050395 learned_addr learned my addr 172.21.15.6:0/1447050395 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39baffd640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 0x7f39bc0723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bb7fe640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc0cdc80 0x7f39bc0aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bbfff640 1 -- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc0cdc80 msgr2=0x7f39bc0aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bbfff640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc0cdc80 0x7f39bc0aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bbfff640 1 -- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 msgr2=0x7f39bc0723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bbfff640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 0x7f39bc0723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bbfff640 1 -- 172.21.15.6:0/1447050395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0009420 con 0x7f39bc15c250 2023-11-28T21:09:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bb7fe640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc0cdc80 0x7f39bc0aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39baffd640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 0x7f39bc0723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.750+0000 7f39bbfff640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39bc15c250 0x7f39bc1362d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c780 tx=0x7f39b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39a3fff640 1 -- 172.21.15.6:0/1447050395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b400ce90 con 0x7f39bc15c250 2023-11-28T21:09:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39a3fff640 1 -- 172.21.15.6:0/1447050395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b400a640 con 0x7f39bc15c250 2023-11-28T21:09:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39a3fff640 1 -- 172.21.15.6:0/1447050395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b400a9d0 con 0x7f39bc15c250 2023-11-28T21:09:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac0094d0 con 0x7f39bc15c250 2023-11-28T21:09:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc0af960 con 0x7f39bc15c250 2023-11-28T21:09:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc0674d0 con 0x7f39bc15c250 2023-11-28T21:09:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39a3fff640 1 -- 172.21.15.6:0/1447050395 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f39b400ab30 con 0x7f39bc15c250 2023-11-28T21:09:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39a3fff640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f39a8066470 0x7f39a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39a3fff640 1 -- 172.21.15.6:0/1447050395 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39b40833d0 con 0x7f39bc15c250 2023-11-28T21:09:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39bb7fe640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f39a8066470 0x7f39a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.754+0000 7f39bb7fe640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f39a8066470 0x7f39a8068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0af000 tx=0x7f39ac0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.758+0000 7f39a3fff640 1 -- 172.21.15.6:0/1447050395 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f39b4050840 con 0x7f39bc15c250 2023-11-28T21:09:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f39bc0b1880 con 0x7f39bc15c250 2023-11-28T21:09:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39a3fff640 1 -- 172.21.15.6:0/1447050395 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1172 (secure 0 0 0) 0x7f39b40184b0 con 0x7f39bc15c250 2023-11-28T21:09:18.981 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:18.981 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":93,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1701205677,"num_in_osds":8,"osd_in_since":1701205668,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":225624064,"bytes_avail":772868489216,"bytes_total":773094113280,"write_bytes_sec":2369,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5190}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-28T21:09:04.668592+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T21:09:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f39a8066470 msgr2=0x7f39a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f39a8066470 0x7f39a8068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0af000 tx=0x7f39ac0a7000 comp rx=0 tx=0).stop 2023-11-28T21:09:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39bc15c250 msgr2=0x7f39bc1362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39bc15c250 0x7f39bc1362d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f39b400c780 tx=0x7f39b400cc40 comp rx=0 tx=0).stop 2023-11-28T21:09:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 shutdown_connections 2023-11-28T21:09:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f39a8066470 0x7f39a8068930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39bc15c250 0x7f39bc1362d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39bc13e090 0x7f39bc0723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 --2- 172.21.15.6:0/1447050395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39bc0cdc80 0x7f39bc0aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 >> 172.21.15.6:0/1447050395 conn(0x7f39bc06ab80 msgr2=0x7f39bc13f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 shutdown_connections 2023-11-28T21:09:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:18.974+0000 7f39c1b1d640 1 -- 172.21.15.6:0/1447050395 wait complete. 2023-11-28T21:09:19.002 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T21:09:19.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:09:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ed5716640 1 Processor -- start 2023-11-28T21:09:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ed5716640 1 -- start start 2023-11-28T21:09:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ed5716640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed015d300 0x7f6ed0071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ed5716640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ed006c570 0x7f6ed00b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ed5716640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ed00b2ba0 0x7f6ed0160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ed5716640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed0072360 con 0x7f6ed00b2ba0 2023-11-28T21:09:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ed5716640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed00b3010 con 0x7f6ed006c570 2023-11-28T21:09:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ed5716640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0071530 con 0x7f6ed015d300 2023-11-28T21:09:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ecf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ed00b2ba0 0x7f6ed0160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ecf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ed00b2ba0 0x7f6ed0160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40178/0 (socket says 172.21.15.6:40178) 2023-11-28T21:09:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ecf7fe640 1 -- 172.21.15.6:0/3882908422 learned_addr learned my addr 172.21.15.6:0/3882908422 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6eceffd640 1 --2- 172.21.15.6:0/3882908422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed015d300 0x7f6ed0071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.138+0000 7f6ec7fff640 1 --2- 172.21.15.6:0/3882908422 >> v2:172.21.15.31:3300/0 conn(0x7f6ed006c570 0x7f6ed00b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ecf7fe640 1 -- 172.21.15.6:0/3882908422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed015d300 msgr2=0x7f6ed0071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ecf7fe640 1 --2- 172.21.15.6:0/3882908422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed015d300 0x7f6ed0071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ecf7fe640 1 -- 172.21.15.6:0/3882908422 >> v2:172.21.15.31:3300/0 conn(0x7f6ed006c570 msgr2=0x7f6ed00b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ecf7fe640 1 --2- 172.21.15.6:0/3882908422 >> v2:172.21.15.31:3300/0 conn(0x7f6ed006c570 0x7f6ed00b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ecf7fe640 1 -- 172.21.15.6:0/3882908422 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0071810 con 0x7f6ed00b2ba0 2023-11-28T21:09:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ecf7fe640 1 --2- 172.21.15.6:0/3882908422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed00b2ba0 0x7f6ed0160d70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6ed006b500 tx=0x7f6ec801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253546a5848dc5ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ece7fc640 1 -- 172.21.15.6:0/3882908422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80a64b0 con 0x7f6ed00b2ba0 2023-11-28T21:09:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ece7fc640 1 -- 172.21.15.6:0/3882908422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec80a6610 con 0x7f6ed00b2ba0 2023-11-28T21:09:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ece7fc640 1 -- 172.21.15.6:0/3882908422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80a69a0 con 0x7f6ed00b2ba0 2023-11-28T21:09:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ed5716640 1 -- 172.21.15.6:0/3882908422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed00b2ba0 msgr2=0x7f6ed0160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.142+0000 7f6ed5716640 1 --2- 172.21.15.6:0/3882908422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed00b2ba0 0x7f6ed0160d70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6ed006b500 tx=0x7f6ec801c710 comp rx=0 tx=0).stop 2023-11-28T21:09:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 -- 172.21.15.6:0/3882908422 shutdown_connections 2023-11-28T21:09:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 --2- 172.21.15.6:0/3882908422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed00b2ba0 0x7f6ed0160d70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 --2- 172.21.15.6:0/3882908422 >> v2:172.21.15.31:3300/0 conn(0x7f6ed006c570 0x7f6ed00b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 --2- 172.21.15.6:0/3882908422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed015d300 0x7f6ed0071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 -- 172.21.15.6:0/3882908422 >> 172.21.15.6:0/3882908422 conn(0x7f6ed006ab80 msgr2=0x7f6ed00b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 -- 172.21.15.6:0/3882908422 shutdown_connections 2023-11-28T21:09:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 -- 172.21.15.6:0/3882908422 wait complete. 2023-11-28T21:09:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 Processor -- start 2023-11-28T21:09:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 -- start start 2023-11-28T21:09:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed006c570 0x7f6ed014fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed00b2ba0 0x7f6ed014bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ed015d300 0x7f6ed014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed014c920 con 0x7f6ed006c570 2023-11-28T21:09:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed014cc00 con 0x7f6ed015d300 2023-11-28T21:09:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ed5716640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed014cee0 con 0x7f6ed00b2ba0 2023-11-28T21:09:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6eceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed006c570 0x7f6ed014fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6eceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed006c570 0x7f6ed014fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40190/0 (socket says 172.21.15.6:40190) 2023-11-28T21:09:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6eceffd640 1 -- 172.21.15.6:0/412003720 learned_addr learned my addr 172.21.15.6:0/412003720 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ec7fff640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed00b2ba0 0x7f6ed014bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ecf7fe640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ed015d300 0x7f6ed014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6eceffd640 1 -- 172.21.15.6:0/412003720 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed00b2ba0 msgr2=0x7f6ed014bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6eceffd640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed00b2ba0 0x7f6ed014bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6eceffd640 1 -- 172.21.15.6:0/412003720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ed015d300 msgr2=0x7f6ed014f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6eceffd640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ed015d300 0x7f6ed014f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6eceffd640 1 -- 172.21.15.6:0/412003720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8009b30 con 0x7f6ed006c570 2023-11-28T21:09:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ec7fff640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed00b2ba0 0x7f6ed014bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6eceffd640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed006c570 0x7f6ed014fc80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000e870 tx=0x7f6ec000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.146+0000 7f6ec77fe640 1 -- 172.21.15.6:0/412003720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0009510 con 0x7f6ed006c570 2023-11-28T21:09:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ec77fe640 1 -- 172.21.15.6:0/412003720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000eec0 con 0x7f6ed006c570 2023-11-28T21:09:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed014d1c0 con 0x7f6ed006c570 2023-11-28T21:09:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ec77fe640 1 -- 172.21.15.6:0/412003720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000cb40 con 0x7f6ed006c570 2023-11-28T21:09:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed01501c0 con 0x7f6ed006c570 2023-11-28T21:09:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed00674d0 con 0x7f6ed006c570 2023-11-28T21:09:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ec77fe640 1 -- 172.21.15.6:0/412003720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ec000cca0 con 0x7f6ed006c570 2023-11-28T21:09:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ec77fe640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6eb0066470 0x7f6eb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ec77fe640 1 -- 172.21.15.6:0/412003720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ec0083fb0 con 0x7f6ed006c570 2023-11-28T21:09:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ec7fff640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6eb0066470 0x7f6eb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.150+0000 7f6ec7fff640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6eb0066470 0x7f6eb0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0150960 tx=0x7f6eb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:19.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.154+0000 7f6ec77fe640 1 -- 172.21.15.6:0/412003720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ec0051390 con 0x7f6ed006c570 2023-11-28T21:09:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.310+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ed014cd70 con 0x7f6eb0066470 2023-11-28T21:09:19.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.318+0000 7f6ec77fe640 1 -- 172.21.15.6:0/412003720 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289121 (secure 0 0 0) 0x7f6ed014cd70 con 0x7f6eb0066470 2023-11-28T21:09:19.326 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:19.328 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6eb0066470 msgr2=0x7f6eb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6eb0066470 0x7f6eb0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0150960 tx=0x7f6eb8008040 comp rx=0 tx=0).stop 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed006c570 msgr2=0x7f6ed014fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed006c570 0x7f6ed014fc80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000e870 tx=0x7f6ec000ec70 comp rx=0 tx=0).stop 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 shutdown_connections 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6eb0066470 0x7f6eb0068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ed015d300 0x7f6ed014f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6ed00b2ba0 0x7f6ed014bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 --2- 172.21.15.6:0/412003720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed006c570 0x7f6ed014fc80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 >> 172.21.15.6:0/412003720 conn(0x7f6ed006ab80 msgr2=0x7f6ed0150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 shutdown_connections 2023-11-28T21:09:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:19.322+0000 7f6ed5716640 1 -- 172.21.15.6:0/412003720 wait complete. 2023-11-28T21:09:19.347 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-11-28T21:09:18.670641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220336,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754384,"statfs":{"total":773094113280,"available":772868489216,"internally_reserved":0,"allocated":4268032,"data_stored":2368668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.049188"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661266+0000","last_change":"2023-11-28T21:09:13.660274+0000","last_active":"2023-11-28T21:09:14.661266+0000","last_peered":"2023-11-28T21:09:14.661266+0000","last_clean":"2023-11-28T21:09:14.661266+0000","last_became_active":"2023-11-28T21:09:13.659569+0000","last_became_peered":"2023-11-28T21:09:13.659569+0000","last_unstale":"2023-11-28T21:09:14.661266+0000","last_undegraded":"2023-11-28T21:09:14.661266+0000","last_fullsized":"2023-11-28T21:09:14.661266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:53.222971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835726+0000","last_change":"2023-11-28T21:09:13.660581+0000","last_active":"2023-11-28T21:09:14.835726+0000","last_peered":"2023-11-28T21:09:14.835726+0000","last_clean":"2023-11-28T21:09:14.835726+0000","last_became_active":"2023-11-28T21:09:13.660304+0000","last_became_peered":"2023-11-28T21:09:13.660304+0000","last_unstale":"2023-11-28T21:09:14.835726+0000","last_undegraded":"2023-11-28T21:09:14.835726+0000","last_fullsized":"2023-11-28T21:09:14.835726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:37.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891686+0000","last_change":"2023-11-28T21:09:13.672515+0000","last_active":"2023-11-28T21:09:15.891686+0000","last_peered":"2023-11-28T21:09:15.891686+0000","last_clean":"2023-11-28T21:09:15.891686+0000","last_became_active":"2023-11-28T21:09:13.672101+0000","last_became_peered":"2023-11-28T21:09:13.672101+0000","last_unstale":"2023-11-28T21:09:15.891686+0000","last_undegraded":"2023-11-28T21:09:15.891686+0000","last_fullsized":"2023-11-28T21:09:15.891686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:49.406077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757557+0000","last_change":"2023-11-28T21:09:13.671866+0000","last_active":"2023-11-28T21:09:15.757557+0000","last_peered":"2023-11-28T21:09:15.757557+0000","last_clean":"2023-11-28T21:09:15.757557+0000","last_became_active":"2023-11-28T21:09:13.671575+0000","last_became_peered":"2023-11-28T21:09:13.671575+0000","last_unstale":"2023-11-28T21:09:15.757557+0000","last_undegraded":"2023-11-28T21:09:15.757557+0000","last_fullsized":"2023-11-28T21:09:15.757557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:32.681369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889384+0000","last_change":"2023-11-28T21:09:13.671317+0000","last_active":"2023-11-28T21:09:15.889384+0000","last_peered":"2023-11-28T21:09:15.889384+0000","last_clean":"2023-11-28T21:09:15.889384+0000","last_became_active":"2023-11-28T21:09:13.671001+0000","last_became_peered":"2023-11-28T21:09:13.671001+0000","last_unstale":"2023-11-28T21:09:15.889384+0000","last_undegraded":"2023-11-28T21:09:15.889384+0000","last_fullsized":"2023-11-28T21:09:15.889384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:16.093343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835340+0000","last_change":"2023-11-28T21:09:13.658770+0000","last_active":"2023-11-28T21:09:14.835340+0000","last_peered":"2023-11-28T21:09:14.835340+0000","last_clean":"2023-11-28T21:09:14.835340+0000","last_became_active":"2023-11-28T21:09:13.652823+0000","last_became_peered":"2023-11-28T21:09:13.652823+0000","last_unstale":"2023-11-28T21:09:14.835340+0000","last_undegraded":"2023-11-28T21:09:14.835340+0000","last_fullsized":"2023-11-28T21:09:14.835340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:19.774066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891277+0000","last_change":"2023-11-28T21:09:13.670345+0000","last_active":"2023-11-28T21:09:15.891277+0000","last_peered":"2023-11-28T21:09:15.891277+0000","last_clean":"2023-11-28T21:09:15.891277+0000","last_became_active":"2023-11-28T21:09:13.670064+0000","last_became_peered":"2023-11-28T21:09:13.670064+0000","last_unstale":"2023-11-28T21:09:15.891277+0000","last_undegraded":"2023-11-28T21:09:15.891277+0000","last_fullsized":"2023-11-28T21:09:15.891277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:17:23.140185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890726+0000","last_change":"2023-11-28T21:09:13.679495+0000","last_active":"2023-11-28T21:09:15.890726+0000","last_peered":"2023-11-28T21:09:15.890726+0000","last_clean":"2023-11-28T21:09:15.890726+0000","last_became_active":"2023-11-28T21:09:13.679145+0000","last_became_peered":"2023-11-28T21:09:13.679145+0000","last_unstale":"2023-11-28T21:09:15.890726+0000","last_undegraded":"2023-11-28T21:09:15.890726+0000","last_fullsized":"2023-11-28T21:09:15.890726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:43.025045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661388+0000","last_change":"2023-11-28T21:09:13.681445+0000","last_active":"2023-11-28T21:09:14.661388+0000","last_peered":"2023-11-28T21:09:14.661388+0000","last_clean":"2023-11-28T21:09:14.661388+0000","last_became_active":"2023-11-28T21:09:13.681141+0000","last_became_peered":"2023-11-28T21:09:13.681141+0000","last_unstale":"2023-11-28T21:09:14.661388+0000","last_undegraded":"2023-11-28T21:09:14.661388+0000","last_fullsized":"2023-11-28T21:09:14.661388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:19:46.950869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.756875+0000","last_change":"2023-11-28T21:09:13.671992+0000","last_active":"2023-11-28T21:09:15.756875+0000","last_peered":"2023-11-28T21:09:15.756875+0000","last_clean":"2023-11-28T21:09:15.756875+0000","last_became_active":"2023-11-28T21:09:13.671702+0000","last_became_peered":"2023-11-28T21:09:13.671702+0000","last_unstale":"2023-11-28T21:09:15.756875+0000","last_undegraded":"2023-11-28T21:09:15.756875+0000","last_fullsized":"2023-11-28T21:09:15.756875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:25.891136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891334+0000","last_change":"2023-11-28T21:09:13.683081+0000","last_active":"2023-11-28T21:09:15.891334+0000","last_peered":"2023-11-28T21:09:15.891334+0000","last_clean":"2023-11-28T21:09:15.891334+0000","last_became_active":"2023-11-28T21:09:13.682920+0000","last_became_peered":"2023-11-28T21:09:13.682920+0000","last_unstale":"2023-11-28T21:09:15.891334+0000","last_undegraded":"2023-11-28T21:09:15.891334+0000","last_fullsized":"2023-11-28T21:09:15.891334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:48.095666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891180+0000","last_change":"2023-11-28T21:09:13.654835+0000","last_active":"2023-11-28T21:09:15.891180+0000","last_peered":"2023-11-28T21:09:15.891180+0000","last_clean":"2023-11-28T21:09:15.891180+0000","last_became_active":"2023-11-28T21:09:13.654562+0000","last_became_peered":"2023-11-28T21:09:13.654562+0000","last_unstale":"2023-11-28T21:09:15.891180+0000","last_undegraded":"2023-11-28T21:09:15.891180+0000","last_fullsized":"2023-11-28T21:09:15.891180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:17:23.140185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889358+0000","last_change":"2023-11-28T21:09:13.689337+0000","last_active":"2023-11-28T21:09:15.889358+0000","last_peered":"2023-11-28T21:09:15.889358+0000","last_clean":"2023-11-28T21:09:15.889358+0000","last_became_active":"2023-11-28T21:09:13.689045+0000","last_became_peered":"2023-11-28T21:09:13.689045+0000","last_unstale":"2023-11-28T21:09:15.889358+0000","last_undegraded":"2023-11-28T21:09:15.889358+0000","last_fullsized":"2023-11-28T21:09:15.889358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:44.700113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835413+0000","last_change":"2023-11-28T21:09:13.666580+0000","last_active":"2023-11-28T21:09:14.835413+0000","last_peered":"2023-11-28T21:09:14.835413+0000","last_clean":"2023-11-28T21:09:14.835413+0000","last_became_active":"2023-11-28T21:09:13.666310+0000","last_became_peered":"2023-11-28T21:09:13.666310+0000","last_unstale":"2023-11-28T21:09:14.835413+0000","last_undegraded":"2023-11-28T21:09:14.835413+0000","last_fullsized":"2023-11-28T21:09:14.835413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:15.367228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890902+0000","last_change":"2023-11-28T21:09:13.662169+0000","last_active":"2023-11-28T21:09:15.890902+0000","last_peered":"2023-11-28T21:09:15.890902+0000","last_clean":"2023-11-28T21:09:15.890902+0000","last_became_active":"2023-11-28T21:09:13.661894+0000","last_became_peered":"2023-11-28T21:09:13.661894+0000","last_unstale":"2023-11-28T21:09:15.890902+0000","last_undegraded":"2023-11-28T21:09:15.890902+0000","last_fullsized":"2023-11-28T21:09:15.890902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:17:18.754699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891140+0000","last_change":"2023-11-28T21:09:13.674375+0000","last_active":"2023-11-28T21:09:15.891140+0000","last_peered":"2023-11-28T21:09:15.891140+0000","last_clean":"2023-11-28T21:09:15.891140+0000","last_became_active":"2023-11-28T21:09:13.674093+0000","last_became_peered":"2023-11-28T21:09:13.674093+0000","last_unstale":"2023-11-28T21:09:15.891140+0000","last_undegraded":"2023-11-28T21:09:15.891140+0000","last_fullsized":"2023-11-28T21:09:15.891140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:17:18.754699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891919+0000","last_change":"2023-11-28T21:09:13.670080+0000","last_active":"2023-11-28T21:09:15.891919+0000","last_peered":"2023-11-28T21:09:15.891919+0000","last_clean":"2023-11-28T21:09:15.891919+0000","last_became_active":"2023-11-28T21:09:13.669779+0000","last_became_peered":"2023-11-28T21:09:13.669779+0000","last_unstale":"2023-11-28T21:09:15.891919+0000","last_undegraded":"2023-11-28T21:09:15.891919+0000","last_fullsized":"2023-11-28T21:09:15.891919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:13:20.767673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835783+0000","last_change":"2023-11-28T21:09:13.665028+0000","last_active":"2023-11-28T21:09:14.835783+0000","last_peered":"2023-11-28T21:09:14.835783+0000","last_clean":"2023-11-28T21:09:14.835783+0000","last_became_active":"2023-11-28T21:09:13.664691+0000","last_became_peered":"2023-11-28T21:09:13.664691+0000","last_unstale":"2023-11-28T21:09:14.835783+0000","last_undegraded":"2023-11-28T21:09:14.835783+0000","last_fullsized":"2023-11-28T21:09:14.835783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:14.905737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835639+0000","last_change":"2023-11-28T21:09:13.678077+0000","last_active":"2023-11-28T21:09:14.835639+0000","last_peered":"2023-11-28T21:09:14.835639+0000","last_clean":"2023-11-28T21:09:14.835639+0000","last_became_active":"2023-11-28T21:09:13.677787+0000","last_became_peered":"2023-11-28T21:09:13.677787+0000","last_unstale":"2023-11-28T21:09:14.835639+0000","last_undegraded":"2023-11-28T21:09:14.835639+0000","last_fullsized":"2023-11-28T21:09:14.835639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:57.669185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889407+0000","last_change":"2023-11-28T21:09:13.664306+0000","last_active":"2023-11-28T21:09:15.889407+0000","last_peered":"2023-11-28T21:09:15.889407+0000","last_clean":"2023-11-28T21:09:15.889407+0000","last_became_active":"2023-11-28T21:09:13.663795+0000","last_became_peered":"2023-11-28T21:09:13.663795+0000","last_unstale":"2023-11-28T21:09:15.889407+0000","last_undegraded":"2023-11-28T21:09:15.889407+0000","last_fullsized":"2023-11-28T21:09:15.889407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:33.818195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660594+0000","last_change":"2023-11-28T21:09:13.666685+0000","last_active":"2023-11-28T21:09:14.660594+0000","last_peered":"2023-11-28T21:09:14.660594+0000","last_clean":"2023-11-28T21:09:14.660594+0000","last_became_active":"2023-11-28T21:09:13.666279+0000","last_became_peered":"2023-11-28T21:09:13.666279+0000","last_unstale":"2023-11-28T21:09:14.660594+0000","last_undegraded":"2023-11-28T21:09:14.660594+0000","last_fullsized":"2023-11-28T21:09:14.660594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:29:13.186005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660753+0000","last_change":"2023-11-28T21:09:13.671205+0000","last_active":"2023-11-28T21:09:14.660753+0000","last_peered":"2023-11-28T21:09:14.660753+0000","last_clean":"2023-11-28T21:09:14.660753+0000","last_became_active":"2023-11-28T21:09:13.670373+0000","last_became_peered":"2023-11-28T21:09:13.670373+0000","last_unstale":"2023-11-28T21:09:14.660753+0000","last_undegraded":"2023-11-28T21:09:14.660753+0000","last_fullsized":"2023-11-28T21:09:14.660753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:50:06.840676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.656899+0000","last_change":"2023-11-28T21:09:13.668933+0000","last_active":"2023-11-28T21:09:14.656899+0000","last_peered":"2023-11-28T21:09:14.656899+0000","last_clean":"2023-11-28T21:09:14.656899+0000","last_became_active":"2023-11-28T21:09:13.668649+0000","last_became_peered":"2023-11-28T21:09:13.668649+0000","last_unstale":"2023-11-28T21:09:14.656899+0000","last_undegraded":"2023-11-28T21:09:14.656899+0000","last_fullsized":"2023-11-28T21:09:14.656899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:25.375246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891298+0000","last_change":"2023-11-28T21:09:13.667810+0000","last_active":"2023-11-28T21:09:15.891298+0000","last_peered":"2023-11-28T21:09:15.891298+0000","last_clean":"2023-11-28T21:09:15.891298+0000","last_became_active":"2023-11-28T21:09:13.667493+0000","last_became_peered":"2023-11-28T21:09:13.667493+0000","last_unstale":"2023-11-28T21:09:15.891298+0000","last_undegraded":"2023-11-28T21:09:15.891298+0000","last_fullsized":"2023-11-28T21:09:15.891298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:48.095666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757116+0000","last_change":"2023-11-28T21:09:13.671902+0000","last_active":"2023-11-28T21:09:15.757116+0000","last_peered":"2023-11-28T21:09:15.757116+0000","last_clean":"2023-11-28T21:09:15.757116+0000","last_became_active":"2023-11-28T21:09:13.671612+0000","last_became_peered":"2023-11-28T21:09:13.671612+0000","last_unstale":"2023-11-28T21:09:15.757116+0000","last_undegraded":"2023-11-28T21:09:15.757116+0000","last_fullsized":"2023-11-28T21:09:15.757116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:19:46.950869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835837+0000","last_change":"2023-11-28T21:09:13.672767+0000","last_active":"2023-11-28T21:09:14.835837+0000","last_peered":"2023-11-28T21:09:14.835837+0000","last_clean":"2023-11-28T21:09:14.835837+0000","last_became_active":"2023-11-28T21:09:13.672462+0000","last_became_peered":"2023-11-28T21:09:13.672462+0000","last_unstale":"2023-11-28T21:09:14.835837+0000","last_undegraded":"2023-11-28T21:09:14.835837+0000","last_fullsized":"2023-11-28T21:09:14.835837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:03:23.355927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757222+0000","last_change":"2023-11-28T21:09:13.673020+0000","last_active":"2023-11-28T21:09:15.757222+0000","last_peered":"2023-11-28T21:09:15.757222+0000","last_clean":"2023-11-28T21:09:15.757222+0000","last_became_active":"2023-11-28T21:09:13.672578+0000","last_became_peered":"2023-11-28T21:09:13.672578+0000","last_unstale":"2023-11-28T21:09:15.757222+0000","last_undegraded":"2023-11-28T21:09:15.757222+0000","last_fullsized":"2023-11-28T21:09:15.757222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:41:40.417410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891324+0000","last_change":"2023-11-28T21:09:13.659497+0000","last_active":"2023-11-28T21:09:15.891324+0000","last_peered":"2023-11-28T21:09:15.891324+0000","last_clean":"2023-11-28T21:09:15.891324+0000","last_became_active":"2023-11-28T21:09:13.658705+0000","last_became_peered":"2023-11-28T21:09:13.658705+0000","last_unstale":"2023-11-28T21:09:15.891324+0000","last_undegraded":"2023-11-28T21:09:15.891324+0000","last_fullsized":"2023-11-28T21:09:15.891324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:09:17.289660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660754+0000","last_change":"2023-11-28T21:09:13.668037+0000","last_active":"2023-11-28T21:09:14.660754+0000","last_peered":"2023-11-28T21:09:14.660754+0000","last_clean":"2023-11-28T21:09:14.660754+0000","last_became_active":"2023-11-28T21:09:13.667076+0000","last_became_peered":"2023-11-28T21:09:13.667076+0000","last_unstale":"2023-11-28T21:09:14.660754+0000","last_undegraded":"2023-11-28T21:09:14.660754+0000","last_fullsized":"2023-11-28T21:09:14.660754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:59.828467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891515+0000","last_change":"2023-11-28T21:09:13.671745+0000","last_active":"2023-11-28T21:09:15.891515+0000","last_peered":"2023-11-28T21:09:15.891515+0000","last_clean":"2023-11-28T21:09:15.891515+0000","last_became_active":"2023-11-28T21:09:13.671488+0000","last_became_peered":"2023-11-28T21:09:13.671488+0000","last_unstale":"2023-11-28T21:09:15.891515+0000","last_undegraded":"2023-11-28T21:09:15.891515+0000","last_fullsized":"2023-11-28T21:09:15.891515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:49.406077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660231+0000","last_change":"2023-11-28T21:09:13.666375+0000","last_active":"2023-11-28T21:09:14.660231+0000","last_peered":"2023-11-28T21:09:14.660231+0000","last_clean":"2023-11-28T21:09:14.660231+0000","last_became_active":"2023-11-28T21:09:13.665776+0000","last_became_peered":"2023-11-28T21:09:13.665776+0000","last_unstale":"2023-11-28T21:09:14.660231+0000","last_undegraded":"2023-11-28T21:09:14.660231+0000","last_fullsized":"2023-11-28T21:09:14.660231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:57.763678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890791+0000","last_change":"2023-11-28T21:09:13.676240+0000","last_active":"2023-11-28T21:09:15.890791+0000","last_peered":"2023-11-28T21:09:15.890791+0000","last_clean":"2023-11-28T21:09:15.890791+0000","last_became_active":"2023-11-28T21:09:13.675917+0000","last_became_peered":"2023-11-28T21:09:13.675917+0000","last_unstale":"2023-11-28T21:09:15.890791+0000","last_undegraded":"2023-11-28T21:09:15.890791+0000","last_fullsized":"2023-11-28T21:09:15.890791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:22.808855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.657441+0000","last_change":"2023-11-28T21:09:13.679390+0000","last_active":"2023-11-28T21:09:14.657441+0000","last_peered":"2023-11-28T21:09:14.657441+0000","last_clean":"2023-11-28T21:09:14.657441+0000","last_became_active":"2023-11-28T21:09:13.677696+0000","last_became_peered":"2023-11-28T21:09:13.677696+0000","last_unstale":"2023-11-28T21:09:14.657441+0000","last_undegraded":"2023-11-28T21:09:14.657441+0000","last_fullsized":"2023-11-28T21:09:14.657441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:51.407555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.687486+0000","last_change":"2023-11-28T21:09:12.649448+0000","last_active":"2023-11-28T21:09:13.687486+0000","last_peered":"2023-11-28T21:09:13.687486+0000","last_clean":"2023-11-28T21:09:13.687486+0000","last_became_active":"2023-11-28T21:09:12.649106+0000","last_became_peered":"2023-11-28T21:09:12.649106+0000","last_unstale":"2023-11-28T21:09:13.687486+0000","last_undegraded":"2023-11-28T21:09:13.687486+0000","last_fullsized":"2023-11-28T21:09:13.687486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:05.796805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661325+0000","last_change":"2023-11-28T21:09:13.670642+0000","last_active":"2023-11-28T21:09:14.661325+0000","last_peered":"2023-11-28T21:09:14.661325+0000","last_clean":"2023-11-28T21:09:14.661325+0000","last_became_active":"2023-11-28T21:09:13.670354+0000","last_became_peered":"2023-11-28T21:09:13.670354+0000","last_unstale":"2023-11-28T21:09:14.661325+0000","last_undegraded":"2023-11-28T21:09:14.661325+0000","last_fullsized":"2023-11-28T21:09:14.661325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:05.387210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.684423+0000","last_change":"2023-11-28T21:09:12.644836+0000","last_active":"2023-11-28T21:09:13.684423+0000","last_peered":"2023-11-28T21:09:13.684423+0000","last_clean":"2023-11-28T21:09:13.684423+0000","last_became_active":"2023-11-28T21:09:12.644552+0000","last_became_peered":"2023-11-28T21:09:12.644552+0000","last_unstale":"2023-11-28T21:09:13.684423+0000","last_undegraded":"2023-11-28T21:09:13.684423+0000","last_fullsized":"2023-11-28T21:09:13.684423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:49:25.030386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661101+0000","last_change":"2023-11-28T21:09:13.666939+0000","last_active":"2023-11-28T21:09:14.661101+0000","last_peered":"2023-11-28T21:09:14.661101+0000","last_clean":"2023-11-28T21:09:14.661101+0000","last_became_active":"2023-11-28T21:09:13.666577+0000","last_became_peered":"2023-11-28T21:09:13.666577+0000","last_unstale":"2023-11-28T21:09:14.661101+0000","last_undegraded":"2023-11-28T21:09:14.661101+0000","last_fullsized":"2023-11-28T21:09:14.661101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:05.142460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.691779+0000","last_change":"2023-11-28T21:09:12.657651+0000","last_active":"2023-11-28T21:09:13.691779+0000","last_peered":"2023-11-28T21:09:13.691779+0000","last_clean":"2023-11-28T21:09:13.691779+0000","last_became_active":"2023-11-28T21:09:12.656442+0000","last_became_peered":"2023-11-28T21:09:12.656442+0000","last_unstale":"2023-11-28T21:09:13.691779+0000","last_undegraded":"2023-11-28T21:09:13.691779+0000","last_fullsized":"2023-11-28T21:09:13.691779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:54:55.934170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757342+0000","last_change":"2023-11-28T21:09:13.672834+0000","last_active":"2023-11-28T21:09:15.757342+0000","last_peered":"2023-11-28T21:09:15.757342+0000","last_clean":"2023-11-28T21:09:15.757342+0000","last_became_active":"2023-11-28T21:09:13.672212+0000","last_became_peered":"2023-11-28T21:09:13.672212+0000","last_unstale":"2023-11-28T21:09:15.757342+0000","last_undegraded":"2023-11-28T21:09:15.757342+0000","last_fullsized":"2023-11-28T21:09:15.757342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:27.234217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.688865+0000","last_change":"2023-11-28T21:09:12.651372+0000","last_active":"2023-11-28T21:09:13.688865+0000","last_peered":"2023-11-28T21:09:13.688865+0000","last_clean":"2023-11-28T21:09:13.688865+0000","last_became_active":"2023-11-28T21:09:12.651014+0000","last_became_peered":"2023-11-28T21:09:12.651014+0000","last_unstale":"2023-11-28T21:09:13.688865+0000","last_undegraded":"2023-11-28T21:09:13.688865+0000","last_fullsized":"2023-11-28T21:09:13.688865+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:40:36.785608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891516+0000","last_change":"2023-11-28T21:09:13.673945+0000","last_active":"2023-11-28T21:09:15.891516+0000","last_peered":"2023-11-28T21:09:15.891516+0000","last_clean":"2023-11-28T21:09:15.891516+0000","last_became_active":"2023-11-28T21:09:13.673628+0000","last_became_peered":"2023-11-28T21:09:13.673628+0000","last_unstale":"2023-11-28T21:09:15.891516+0000","last_undegraded":"2023-11-28T21:09:15.891516+0000","last_fullsized":"2023-11-28T21:09:15.891516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:46:20.180469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.691264+0000","last_change":"2023-11-28T21:09:12.658946+0000","last_active":"2023-11-28T21:09:13.691264+0000","last_peered":"2023-11-28T21:09:13.691264+0000","last_clean":"2023-11-28T21:09:13.691264+0000","last_became_active":"2023-11-28T21:09:12.658480+0000","last_became_peered":"2023-11-28T21:09:12.658480+0000","last_unstale":"2023-11-28T21:09:13.691264+0000","last_undegraded":"2023-11-28T21:09:13.691264+0000","last_fullsized":"2023-11-28T21:09:13.691264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:32.807382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890789+0000","last_change":"2023-11-28T21:09:13.663480+0000","last_active":"2023-11-28T21:09:15.890789+0000","last_peered":"2023-11-28T21:09:15.890789+0000","last_clean":"2023-11-28T21:09:15.890789+0000","last_became_active":"2023-11-28T21:09:13.663174+0000","last_became_peered":"2023-11-28T21:09:13.663174+0000","last_unstale":"2023-11-28T21:09:15.890789+0000","last_undegraded":"2023-11-28T21:09:15.890789+0000","last_fullsized":"2023-11-28T21:09:15.890789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:57.959074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.691241+0000","last_change":"2023-11-28T21:09:12.656711+0000","last_active":"2023-11-28T21:09:13.691241+0000","last_peered":"2023-11-28T21:09:13.691241+0000","last_clean":"2023-11-28T21:09:13.691241+0000","last_became_active":"2023-11-28T21:09:12.656379+0000","last_became_peered":"2023-11-28T21:09:12.656379+0000","last_unstale":"2023-11-28T21:09:13.691241+0000","last_undegraded":"2023-11-28T21:09:13.691241+0000","last_fullsized":"2023-11-28T21:09:13.691241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:07.636914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660163+0000","last_change":"2023-11-28T21:09:13.669711+0000","last_active":"2023-11-28T21:09:14.660163+0000","last_peered":"2023-11-28T21:09:14.660163+0000","last_clean":"2023-11-28T21:09:14.660163+0000","last_became_active":"2023-11-28T21:09:13.667887+0000","last_became_peered":"2023-11-28T21:09:13.667887+0000","last_unstale":"2023-11-28T21:09:14.660163+0000","last_undegraded":"2023-11-28T21:09:14.660163+0000","last_fullsized":"2023-11-28T21:09:14.660163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:53.222971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.643623+0000","last_change":"2023-11-28T21:09:12.648813+0000","last_active":"2023-11-28T21:09:13.643623+0000","last_peered":"2023-11-28T21:09:13.643623+0000","last_clean":"2023-11-28T21:09:13.643623+0000","last_became_active":"2023-11-28T21:09:12.648505+0000","last_became_peered":"2023-11-28T21:09:12.648505+0000","last_unstale":"2023-11-28T21:09:13.643623+0000","last_undegraded":"2023-11-28T21:09:13.643623+0000","last_fullsized":"2023-11-28T21:09:13.643623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:00:33.370055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.756762+0000","last_change":"2023-11-28T21:09:13.676364+0000","last_active":"2023-11-28T21:09:15.756762+0000","last_peered":"2023-11-28T21:09:15.756762+0000","last_clean":"2023-11-28T21:09:15.756762+0000","last_became_active":"2023-11-28T21:09:13.674308+0000","last_became_peered":"2023-11-28T21:09:13.674308+0000","last_unstale":"2023-11-28T21:09:15.756762+0000","last_undegraded":"2023-11-28T21:09:15.756762+0000","last_fullsized":"2023-11-28T21:09:15.756762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:59.828467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.655274+0000","last_change":"2023-11-28T21:09:12.646807+0000","last_active":"2023-11-28T21:09:13.655274+0000","last_peered":"2023-11-28T21:09:13.655274+0000","last_clean":"2023-11-28T21:09:13.655274+0000","last_became_active":"2023-11-28T21:09:12.646520+0000","last_became_peered":"2023-11-28T21:09:12.646520+0000","last_unstale":"2023-11-28T21:09:13.655274+0000","last_undegraded":"2023-11-28T21:09:13.655274+0000","last_fullsized":"2023-11-28T21:09:13.655274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:15.082530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891769+0000","last_change":"2023-11-28T21:09:13.654174+0000","last_active":"2023-11-28T21:09:15.891769+0000","last_peered":"2023-11-28T21:09:15.891769+0000","last_clean":"2023-11-28T21:09:15.891769+0000","last_became_active":"2023-11-28T21:09:13.653887+0000","last_became_peered":"2023-11-28T21:09:13.653887+0000","last_unstale":"2023-11-28T21:09:15.891769+0000","last_undegraded":"2023-11-28T21:09:15.891769+0000","last_fullsized":"2023-11-28T21:09:15.891769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:46:20.180469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.644893+0000","last_change":"2023-11-28T21:09:12.658693+0000","last_active":"2023-11-28T21:09:13.644893+0000","last_peered":"2023-11-28T21:09:13.644893+0000","last_clean":"2023-11-28T21:09:13.644893+0000","last_became_active":"2023-11-28T21:09:12.656392+0000","last_became_peered":"2023-11-28T21:09:12.656392+0000","last_unstale":"2023-11-28T21:09:13.644893+0000","last_undegraded":"2023-11-28T21:09:13.644893+0000","last_fullsized":"2023-11-28T21:09:13.644893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:56:17.492379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835738+0000","last_change":"2023-11-28T21:09:13.672578+0000","last_active":"2023-11-28T21:09:14.835738+0000","last_peered":"2023-11-28T21:09:14.835738+0000","last_clean":"2023-11-28T21:09:14.835738+0000","last_became_active":"2023-11-28T21:09:13.672304+0000","last_became_peered":"2023-11-28T21:09:13.672304+0000","last_unstale":"2023-11-28T21:09:14.835738+0000","last_undegraded":"2023-11-28T21:09:14.835738+0000","last_fullsized":"2023-11-28T21:09:14.835738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:50.155119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.651996+0000","last_change":"2023-11-28T21:09:12.658670+0000","last_active":"2023-11-28T21:09:13.651996+0000","last_peered":"2023-11-28T21:09:13.651996+0000","last_clean":"2023-11-28T21:09:13.651996+0000","last_became_active":"2023-11-28T21:09:12.658340+0000","last_became_peered":"2023-11-28T21:09:12.658340+0000","last_unstale":"2023-11-28T21:09:13.651996+0000","last_undegraded":"2023-11-28T21:09:13.651996+0000","last_fullsized":"2023-11-28T21:09:13.651996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:09:03.644817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835652+0000","last_change":"2023-11-28T21:09:13.665675+0000","last_active":"2023-11-28T21:09:14.835652+0000","last_peered":"2023-11-28T21:09:14.835652+0000","last_clean":"2023-11-28T21:09:14.835652+0000","last_became_active":"2023-11-28T21:09:13.664487+0000","last_became_peered":"2023-11-28T21:09:13.664487+0000","last_unstale":"2023-11-28T21:09:14.835652+0000","last_undegraded":"2023-11-28T21:09:14.835652+0000","last_fullsized":"2023-11-28T21:09:14.835652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:10.555790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.680925+0000","last_change":"2023-11-28T21:09:12.651865+0000","last_active":"2023-11-28T21:09:13.680925+0000","last_peered":"2023-11-28T21:09:13.680925+0000","last_clean":"2023-11-28T21:09:13.680925+0000","last_became_active":"2023-11-28T21:09:12.651478+0000","last_became_peered":"2023-11-28T21:09:12.651478+0000","last_unstale":"2023-11-28T21:09:13.680925+0000","last_undegraded":"2023-11-28T21:09:13.680925+0000","last_fullsized":"2023-11-28T21:09:13.680925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:42.014232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890877+0000","last_change":"2023-11-28T21:09:13.673060+0000","last_active":"2023-11-28T21:09:15.890877+0000","last_peered":"2023-11-28T21:09:15.890877+0000","last_clean":"2023-11-28T21:09:15.890877+0000","last_became_active":"2023-11-28T21:09:13.672735+0000","last_became_peered":"2023-11-28T21:09:13.672735+0000","last_unstale":"2023-11-28T21:09:15.890877+0000","last_undegraded":"2023-11-28T21:09:15.890877+0000","last_fullsized":"2023-11-28T21:09:15.890877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:08.599206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.694401+0000","last_change":"2023-11-28T21:09:12.657122+0000","last_active":"2023-11-28T21:09:13.694401+0000","last_peered":"2023-11-28T21:09:13.694401+0000","last_clean":"2023-11-28T21:09:13.694401+0000","last_became_active":"2023-11-28T21:09:12.656848+0000","last_became_peered":"2023-11-28T21:09:12.656848+0000","last_unstale":"2023-11-28T21:09:13.694401+0000","last_undegraded":"2023-11-28T21:09:13.694401+0000","last_fullsized":"2023-11-28T21:09:13.694401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:51.542697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.756784+0000","last_change":"2023-11-28T21:09:13.676811+0000","last_active":"2023-11-28T21:09:15.756784+0000","last_peered":"2023-11-28T21:09:15.756784+0000","last_clean":"2023-11-28T21:09:15.756784+0000","last_became_active":"2023-11-28T21:09:13.674862+0000","last_became_peered":"2023-11-28T21:09:13.674862+0000","last_unstale":"2023-11-28T21:09:15.756784+0000","last_undegraded":"2023-11-28T21:09:15.756784+0000","last_fullsized":"2023-11-28T21:09:15.756784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:05.142460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.686619+0000","last_change":"2023-11-28T21:09:12.646329+0000","last_active":"2023-11-28T21:09:13.686619+0000","last_peered":"2023-11-28T21:09:13.686619+0000","last_clean":"2023-11-28T21:09:13.686619+0000","last_became_active":"2023-11-28T21:09:12.646002+0000","last_became_peered":"2023-11-28T21:09:12.646002+0000","last_unstale":"2023-11-28T21:09:13.686619+0000","last_undegraded":"2023-11-28T21:09:13.686619+0000","last_fullsized":"2023-11-28T21:09:13.686619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:05.796805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835650+0000","last_change":"2023-11-28T21:09:13.659699+0000","last_active":"2023-11-28T21:09:14.835650+0000","last_peered":"2023-11-28T21:09:14.835650+0000","last_clean":"2023-11-28T21:09:14.835650+0000","last_became_active":"2023-11-28T21:09:13.659369+0000","last_became_peered":"2023-11-28T21:09:13.659369+0000","last_unstale":"2023-11-28T21:09:14.835650+0000","last_undegraded":"2023-11-28T21:09:14.835650+0000","last_fullsized":"2023-11-28T21:09:14.835650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:59:35.141172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.677093+0000","last_change":"2023-11-28T21:09:12.647560+0000","last_active":"2023-11-28T21:09:13.677093+0000","last_peered":"2023-11-28T21:09:13.677093+0000","last_clean":"2023-11-28T21:09:13.677093+0000","last_became_active":"2023-11-28T21:09:12.647217+0000","last_became_peered":"2023-11-28T21:09:12.647217+0000","last_unstale":"2023-11-28T21:09:13.677093+0000","last_undegraded":"2023-11-28T21:09:13.677093+0000","last_fullsized":"2023-11-28T21:09:13.677093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:29.233767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890947+0000","last_change":"2023-11-28T21:09:13.673945+0000","last_active":"2023-11-28T21:09:15.890947+0000","last_peered":"2023-11-28T21:09:15.890947+0000","last_clean":"2023-11-28T21:09:15.890947+0000","last_became_active":"2023-11-28T21:09:13.673608+0000","last_became_peered":"2023-11-28T21:09:13.673608+0000","last_unstale":"2023-11-28T21:09:15.890947+0000","last_undegraded":"2023-11-28T21:09:15.890947+0000","last_fullsized":"2023-11-28T21:09:15.890947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:57.959074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.642770+0000","last_change":"2023-11-28T21:09:12.648568+0000","last_active":"2023-11-28T21:09:13.642770+0000","last_peered":"2023-11-28T21:09:13.642770+0000","last_clean":"2023-11-28T21:09:13.642770+0000","last_became_active":"2023-11-28T21:09:12.648273+0000","last_became_peered":"2023-11-28T21:09:12.648273+0000","last_unstale":"2023-11-28T21:09:13.642770+0000","last_undegraded":"2023-11-28T21:09:13.642770+0000","last_fullsized":"2023-11-28T21:09:13.642770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:53:25.602316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660641+0000","last_change":"2023-11-28T21:09:13.669729+0000","last_active":"2023-11-28T21:09:14.660641+0000","last_peered":"2023-11-28T21:09:14.660641+0000","last_clean":"2023-11-28T21:09:14.660641+0000","last_became_active":"2023-11-28T21:09:13.669296+0000","last_became_peered":"2023-11-28T21:09:13.669296+0000","last_unstale":"2023-11-28T21:09:14.660641+0000","last_undegraded":"2023-11-28T21:09:14.660641+0000","last_fullsized":"2023-11-28T21:09:14.660641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:21.899588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.693198+0000","last_change":"2023-11-28T21:09:12.653405+0000","last_active":"2023-11-28T21:09:13.693198+0000","last_peered":"2023-11-28T21:09:13.693198+0000","last_clean":"2023-11-28T21:09:13.693198+0000","last_became_active":"2023-11-28T21:09:12.653137+0000","last_became_peered":"2023-11-28T21:09:12.653137+0000","last_unstale":"2023-11-28T21:09:13.693198+0000","last_undegraded":"2023-11-28T21:09:13.693198+0000","last_fullsized":"2023-11-28T21:09:13.693198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:49:25.030386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661326+0000","last_change":"2023-11-28T21:09:13.668871+0000","last_active":"2023-11-28T21:09:14.661326+0000","last_peered":"2023-11-28T21:09:14.661326+0000","last_clean":"2023-11-28T21:09:14.661326+0000","last_became_active":"2023-11-28T21:09:13.668515+0000","last_became_peered":"2023-11-28T21:09:13.668515+0000","last_unstale":"2023-11-28T21:09:14.661326+0000","last_undegraded":"2023-11-28T21:09:14.661326+0000","last_fullsized":"2023-11-28T21:09:14.661326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:25.891136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.690663+0000","last_change":"2023-11-28T21:09:12.660005+0000","last_active":"2023-11-28T21:09:13.690663+0000","last_peered":"2023-11-28T21:09:13.690663+0000","last_clean":"2023-11-28T21:09:13.690663+0000","last_became_active":"2023-11-28T21:09:12.659801+0000","last_became_peered":"2023-11-28T21:09:12.659801+0000","last_unstale":"2023-11-28T21:09:13.690663+0000","last_undegraded":"2023-11-28T21:09:13.690663+0000","last_fullsized":"2023-11-28T21:09:13.690663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:29:12.175192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891861+0000","last_change":"2023-11-28T21:09:13.668203+0000","last_active":"2023-11-28T21:09:15.891861+0000","last_peered":"2023-11-28T21:09:15.891861+0000","last_clean":"2023-11-28T21:09:15.891861+0000","last_became_active":"2023-11-28T21:09:13.667919+0000","last_became_peered":"2023-11-28T21:09:13.667919+0000","last_unstale":"2023-11-28T21:09:15.891861+0000","last_undegraded":"2023-11-28T21:09:15.891861+0000","last_fullsized":"2023-11-28T21:09:15.891861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:13:20.767673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.686510+0000","last_change":"2023-11-28T21:09:12.646449+0000","last_active":"2023-11-28T21:09:13.686510+0000","last_peered":"2023-11-28T21:09:13.686510+0000","last_clean":"2023-11-28T21:09:13.686510+0000","last_became_active":"2023-11-28T21:09:12.645943+0000","last_became_peered":"2023-11-28T21:09:12.645943+0000","last_unstale":"2023-11-28T21:09:13.686510+0000","last_undegraded":"2023-11-28T21:09:13.686510+0000","last_fullsized":"2023-11-28T21:09:13.686510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:20.888775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757536+0000","last_change":"2023-11-28T21:09:13.667162+0000","last_active":"2023-11-28T21:09:15.757536+0000","last_peered":"2023-11-28T21:09:15.757536+0000","last_clean":"2023-11-28T21:09:15.757536+0000","last_became_active":"2023-11-28T21:09:13.666842+0000","last_became_peered":"2023-11-28T21:09:13.666842+0000","last_unstale":"2023-11-28T21:09:15.757536+0000","last_undegraded":"2023-11-28T21:09:15.757536+0000","last_fullsized":"2023-11-28T21:09:15.757536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:56.044971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.687667+0000","last_change":"2023-11-28T21:09:12.645973+0000","last_active":"2023-11-28T21:09:13.687667+0000","last_peered":"2023-11-28T21:09:13.687667+0000","last_clean":"2023-11-28T21:09:13.687667+0000","last_became_active":"2023-11-28T21:09:12.645659+0000","last_became_peered":"2023-11-28T21:09:12.645659+0000","last_unstale":"2023-11-28T21:09:13.687667+0000","last_undegraded":"2023-11-28T21:09:13.687667+0000","last_fullsized":"2023-11-28T21:09:13.687667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:29.233767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889558+0000","last_change":"2023-11-28T21:09:13.676055+0000","last_active":"2023-11-28T21:09:15.889558+0000","last_peered":"2023-11-28T21:09:15.889558+0000","last_clean":"2023-11-28T21:09:15.889558+0000","last_became_active":"2023-11-28T21:09:13.675785+0000","last_became_peered":"2023-11-28T21:09:13.675785+0000","last_unstale":"2023-11-28T21:09:15.889558+0000","last_undegraded":"2023-11-28T21:09:15.889558+0000","last_fullsized":"2023-11-28T21:09:15.889558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:08.647727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.657209+0000","last_change":"2023-11-28T21:09:12.658797+0000","last_active":"2023-11-28T21:09:13.657209+0000","last_peered":"2023-11-28T21:09:13.657209+0000","last_clean":"2023-11-28T21:09:13.657209+0000","last_became_active":"2023-11-28T21:09:12.658507+0000","last_became_peered":"2023-11-28T21:09:12.658507+0000","last_unstale":"2023-11-28T21:09:13.657209+0000","last_undegraded":"2023-11-28T21:09:13.657209+0000","last_fullsized":"2023-11-28T21:09:13.657209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.752865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889323+0000","last_change":"2023-11-28T21:09:13.668191+0000","last_active":"2023-11-28T21:09:15.889323+0000","last_peered":"2023-11-28T21:09:15.889323+0000","last_clean":"2023-11-28T21:09:15.889323+0000","last_became_active":"2023-11-28T21:09:13.667787+0000","last_became_peered":"2023-11-28T21:09:13.667787+0000","last_unstale":"2023-11-28T21:09:15.889323+0000","last_undegraded":"2023-11-28T21:09:15.889323+0000","last_fullsized":"2023-11-28T21:09:15.889323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:57:38.881223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.688457+0000","last_change":"2023-11-28T21:09:12.642446+0000","last_active":"2023-11-28T21:09:13.688457+0000","last_peered":"2023-11-28T21:09:13.688457+0000","last_clean":"2023-11-28T21:09:13.688457+0000","last_became_active":"2023-11-28T21:09:12.642124+0000","last_became_peered":"2023-11-28T21:09:12.642124+0000","last_unstale":"2023-11-28T21:09:13.688457+0000","last_undegraded":"2023-11-28T21:09:13.688457+0000","last_fullsized":"2023-11-28T21:09:13.688457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:57.756173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889498+0000","last_change":"2023-11-28T21:09:13.666241+0000","last_active":"2023-11-28T21:09:15.889498+0000","last_peered":"2023-11-28T21:09:15.889498+0000","last_clean":"2023-11-28T21:09:15.889498+0000","last_became_active":"2023-11-28T21:09:13.665979+0000","last_became_peered":"2023-11-28T21:09:13.665979+0000","last_unstale":"2023-11-28T21:09:15.889498+0000","last_undegraded":"2023-11-28T21:09:15.889498+0000","last_fullsized":"2023-11-28T21:09:15.889498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:06.807618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.650673+0000","last_change":"2023-11-28T21:09:12.647997+0000","last_active":"2023-11-28T21:09:13.650673+0000","last_peered":"2023-11-28T21:09:13.650673+0000","last_clean":"2023-11-28T21:09:13.650673+0000","last_became_active":"2023-11-28T21:09:12.647711+0000","last_became_peered":"2023-11-28T21:09:12.647711+0000","last_unstale":"2023-11-28T21:09:13.650673+0000","last_undegraded":"2023-11-28T21:09:13.650673+0000","last_fullsized":"2023-11-28T21:09:13.650673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:07.636914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889230+0000","last_change":"2023-11-28T21:09:13.659683+0000","last_active":"2023-11-28T21:09:15.889230+0000","last_peered":"2023-11-28T21:09:15.889230+0000","last_clean":"2023-11-28T21:09:15.889230+0000","last_became_active":"2023-11-28T21:09:13.659389+0000","last_became_peered":"2023-11-28T21:09:13.659389+0000","last_unstale":"2023-11-28T21:09:15.889230+0000","last_undegraded":"2023-11-28T21:09:15.889230+0000","last_fullsized":"2023-11-28T21:09:15.889230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:01:11.150251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.655913+0000","last_change":"2023-11-28T21:09:12.640178+0000","last_active":"2023-11-28T21:09:13.655913+0000","last_peered":"2023-11-28T21:09:13.655913+0000","last_clean":"2023-11-28T21:09:13.655913+0000","last_became_active":"2023-11-28T21:09:12.639755+0000","last_became_peered":"2023-11-28T21:09:12.639755+0000","last_unstale":"2023-11-28T21:09:13.655913+0000","last_undegraded":"2023-11-28T21:09:13.655913+0000","last_fullsized":"2023-11-28T21:09:13.655913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:19:49.738021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891120+0000","last_change":"2023-11-28T21:09:13.669785+0000","last_active":"2023-11-28T21:09:15.891120+0000","last_peered":"2023-11-28T21:09:15.891120+0000","last_clean":"2023-11-28T21:09:15.891120+0000","last_became_active":"2023-11-28T21:09:13.669219+0000","last_became_peered":"2023-11-28T21:09:13.669219+0000","last_unstale":"2023-11-28T21:09:15.891120+0000","last_undegraded":"2023-11-28T21:09:15.891120+0000","last_fullsized":"2023-11-28T21:09:15.891120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:08.599206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.648665+0000","last_change":"2023-11-28T21:09:12.652318+0000","last_active":"2023-11-28T21:09:13.648665+0000","last_peered":"2023-11-28T21:09:13.648665+0000","last_clean":"2023-11-28T21:09:13.648665+0000","last_became_active":"2023-11-28T21:09:12.651417+0000","last_became_peered":"2023-11-28T21:09:12.651417+0000","last_unstale":"2023-11-28T21:09:13.648665+0000","last_undegraded":"2023-11-28T21:09:13.648665+0000","last_fullsized":"2023-11-28T21:09:13.648665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:31.670556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889557+0000","last_change":"2023-11-28T21:09:13.665155+0000","last_active":"2023-11-28T21:09:15.889557+0000","last_peered":"2023-11-28T21:09:15.889557+0000","last_clean":"2023-11-28T21:09:15.889557+0000","last_became_active":"2023-11-28T21:09:13.664878+0000","last_became_peered":"2023-11-28T21:09:13.664878+0000","last_unstale":"2023-11-28T21:09:15.889557+0000","last_undegraded":"2023-11-28T21:09:15.889557+0000","last_fullsized":"2023-11-28T21:09:15.889557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:19:50.748834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.689520+0000","last_change":"2023-11-28T21:09:12.648459+0000","last_active":"2023-11-28T21:09:13.689520+0000","last_peered":"2023-11-28T21:09:13.689520+0000","last_clean":"2023-11-28T21:09:13.689520+0000","last_became_active":"2023-11-28T21:09:12.648238+0000","last_became_peered":"2023-11-28T21:09:12.648238+0000","last_unstale":"2023-11-28T21:09:13.689520+0000","last_undegraded":"2023-11-28T21:09:13.689520+0000","last_fullsized":"2023-11-28T21:09:13.689520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:50:05.829863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891887+0000","last_change":"2023-11-28T21:09:13.684224+0000","last_active":"2023-11-28T21:09:15.891887+0000","last_peered":"2023-11-28T21:09:15.891887+0000","last_clean":"2023-11-28T21:09:15.891887+0000","last_became_active":"2023-11-28T21:09:13.681010+0000","last_became_peered":"2023-11-28T21:09:13.681010+0000","last_unstale":"2023-11-28T21:09:15.891887+0000","last_undegraded":"2023-11-28T21:09:15.891887+0000","last_fullsized":"2023-11-28T21:09:15.891887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:36:10.608962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.657523+0000","last_change":"2023-11-28T21:09:12.644229+0000","last_active":"2023-11-28T21:09:14.657523+0000","last_peered":"2023-11-28T21:09:14.657523+0000","last_clean":"2023-11-28T21:09:14.657523+0000","last_became_active":"2023-11-28T21:09:12.643754+0000","last_became_peered":"2023-11-28T21:09:12.643754+0000","last_unstale":"2023-11-28T21:09:14.657523+0000","last_undegraded":"2023-11-28T21:09:14.657523+0000","last_fullsized":"2023-11-28T21:09:14.657523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:53:25.602316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.657146+0000","last_change":"2023-11-28T21:09:13.684023+0000","last_active":"2023-11-28T21:09:14.657146+0000","last_peered":"2023-11-28T21:09:14.657146+0000","last_clean":"2023-11-28T21:09:14.657146+0000","last_became_active":"2023-11-28T21:09:13.683693+0000","last_became_peered":"2023-11-28T21:09:13.683693+0000","last_unstale":"2023-11-28T21:09:14.657146+0000","last_undegraded":"2023-11-28T21:09:14.657146+0000","last_fullsized":"2023-11-28T21:09:14.657146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:52.553510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.677670+0000","last_change":"2023-11-28T21:09:12.652297+0000","last_active":"2023-11-28T21:09:13.677670+0000","last_peered":"2023-11-28T21:09:13.677670+0000","last_clean":"2023-11-28T21:09:13.677670+0000","last_became_active":"2023-11-28T21:09:12.651956+0000","last_became_peered":"2023-11-28T21:09:12.651956+0000","last_unstale":"2023-11-28T21:09:13.677670+0000","last_undegraded":"2023-11-28T21:09:13.677670+0000","last_fullsized":"2023-11-28T21:09:13.677670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:04.376397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660795+0000","last_change":"2023-11-28T21:09:13.660549+0000","last_active":"2023-11-28T21:09:14.660795+0000","last_peered":"2023-11-28T21:09:14.660795+0000","last_clean":"2023-11-28T21:09:14.660795+0000","last_became_active":"2023-11-28T21:09:13.659999+0000","last_became_peered":"2023-11-28T21:09:13.659999+0000","last_unstale":"2023-11-28T21:09:14.660795+0000","last_undegraded":"2023-11-28T21:09:14.660795+0000","last_fullsized":"2023-11-28T21:09:14.660795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:30.244580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.650920+0000","last_change":"2023-11-28T21:09:12.646351+0000","last_active":"2023-11-28T21:09:13.650920+0000","last_peered":"2023-11-28T21:09:13.650920+0000","last_clean":"2023-11-28T21:09:13.650920+0000","last_became_active":"2023-11-28T21:09:12.646053+0000","last_became_peered":"2023-11-28T21:09:12.646053+0000","last_unstale":"2023-11-28T21:09:13.650920+0000","last_undegraded":"2023-11-28T21:09:13.650920+0000","last_fullsized":"2023-11-28T21:09:13.650920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:00:21.201294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.657144+0000","last_change":"2023-11-28T21:09:13.662668+0000","last_active":"2023-11-28T21:09:14.657144+0000","last_peered":"2023-11-28T21:09:14.657144+0000","last_clean":"2023-11-28T21:09:14.657144+0000","last_became_active":"2023-11-28T21:09:13.662391+0000","last_became_peered":"2023-11-28T21:09:13.662391+0000","last_unstale":"2023-11-28T21:09:14.657144+0000","last_undegraded":"2023-11-28T21:09:14.657144+0000","last_fullsized":"2023-11-28T21:09:14.657144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:43.249171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.677225+0000","last_change":"2023-11-28T21:09:12.647939+0000","last_active":"2023-11-28T21:09:13.677225+0000","last_peered":"2023-11-28T21:09:13.677225+0000","last_clean":"2023-11-28T21:09:13.677225+0000","last_became_active":"2023-11-28T21:09:12.647634+0000","last_became_peered":"2023-11-28T21:09:12.647634+0000","last_unstale":"2023-11-28T21:09:13.677225+0000","last_undegraded":"2023-11-28T21:09:13.677225+0000","last_fullsized":"2023-11-28T21:09:13.677225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:52.212158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835334+0000","last_change":"2023-11-28T21:09:13.664473+0000","last_active":"2023-11-28T21:09:14.835334+0000","last_peered":"2023-11-28T21:09:14.835334+0000","last_clean":"2023-11-28T21:09:14.835334+0000","last_became_active":"2023-11-28T21:09:13.662153+0000","last_became_peered":"2023-11-28T21:09:13.662153+0000","last_unstale":"2023-11-28T21:09:14.835334+0000","last_undegraded":"2023-11-28T21:09:14.835334+0000","last_fullsized":"2023-11-28T21:09:14.835334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:45:10.064647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.656200+0000","last_change":"2023-11-28T21:09:12.644889+0000","last_active":"2023-11-28T21:09:13.656200+0000","last_peered":"2023-11-28T21:09:13.656200+0000","last_clean":"2023-11-28T21:09:13.656200+0000","last_became_active":"2023-11-28T21:09:12.644463+0000","last_became_peered":"2023-11-28T21:09:12.644463+0000","last_unstale":"2023-11-28T21:09:13.656200+0000","last_undegraded":"2023-11-28T21:09:13.656200+0000","last_fullsized":"2023-11-28T21:09:13.656200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:34:03.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660457+0000","last_change":"2023-11-28T21:09:13.672086+0000","last_active":"2023-11-28T21:09:14.660457+0000","last_peered":"2023-11-28T21:09:14.660457+0000","last_clean":"2023-11-28T21:09:14.660457+0000","last_became_active":"2023-11-28T21:09:13.670058+0000","last_became_peered":"2023-11-28T21:09:13.670058+0000","last_unstale":"2023-11-28T21:09:14.660457+0000","last_undegraded":"2023-11-28T21:09:14.660457+0000","last_fullsized":"2023-11-28T21:09:14.660457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:05.387210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.642768+0000","last_change":"2023-11-28T21:09:12.655138+0000","last_active":"2023-11-28T21:09:13.642768+0000","last_peered":"2023-11-28T21:09:13.642768+0000","last_clean":"2023-11-28T21:09:13.642768+0000","last_became_active":"2023-11-28T21:09:12.651291+0000","last_became_peered":"2023-11-28T21:09:12.651291+0000","last_unstale":"2023-11-28T21:09:13.642768+0000","last_undegraded":"2023-11-28T21:09:13.642768+0000","last_fullsized":"2023-11-28T21:09:13.642768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:09:03.644817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891320+0000","last_change":"2023-11-28T21:09:13.685933+0000","last_active":"2023-11-28T21:09:15.891320+0000","last_peered":"2023-11-28T21:09:15.891320+0000","last_clean":"2023-11-28T21:09:15.891320+0000","last_became_active":"2023-11-28T21:09:13.684976+0000","last_became_peered":"2023-11-28T21:09:13.684976+0000","last_unstale":"2023-11-28T21:09:15.891320+0000","last_undegraded":"2023-11-28T21:09:15.891320+0000","last_fullsized":"2023-11-28T21:09:15.891320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:09:17.289660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.650709+0000","last_change":"2023-11-28T21:09:12.646304+0000","last_active":"2023-11-28T21:09:13.650709+0000","last_peered":"2023-11-28T21:09:13.650709+0000","last_clean":"2023-11-28T21:09:13.650709+0000","last_became_active":"2023-11-28T21:09:12.645620+0000","last_became_peered":"2023-11-28T21:09:12.645620+0000","last_unstale":"2023-11-28T21:09:13.650709+0000","last_undegraded":"2023-11-28T21:09:13.650709+0000","last_fullsized":"2023-11-28T21:09:13.650709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:34:03.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.659880+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-28T21:09:13.659880+0000","last_peered":"2023-11-28T21:09:13.659880+0000","last_clean":"2023-11-28T21:09:13.659880+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-28T21:09:13.659880+0000","last_undegraded":"2023-11-28T21:09:13.659880+0000","last_fullsized":"2023-11-28T21:09:13.659880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":974848,"data_stored":738347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.72699999999999998}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.745},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85299999999999998}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66500000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.872}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.82799999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68400000000000005}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.60099999999999998}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.70799999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.624}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.55200000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.76600000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":147993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.624}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.68500000000000005}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.73699999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.75800000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.93200000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.4930000000000003,"5min":4.4930000000000003,"15min":4.4930000000000003},"last":0.47599999999999998}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":6.4770000000000003,"5min":6.4770000000000003,"15min":6.4770000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.63500000000000001}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.0789999999999997,"5min":5.0789999999999997,"15min":5.0789999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":0.93799999999999994}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.7190000000000003,"5min":6.7190000000000003,"15min":6.7190000000000003},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.86599999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.7350000000000003,"5min":4.7350000000000003,"15min":4.7350000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.91400000000000003}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.4640000000000004,"5min":4.4640000000000004,"15min":4.4640000000000004},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.7910000000000004,"5min":4.7910000000000004,"15min":4.7910000000000004},"last":0.88400000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":149523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":6.8869999999999996,"5min":6.8869999999999996,"15min":6.8869999999999996},"last":0.47699999999999998}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":7.0759999999999996,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.34999999999999998}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":6.9359999999999999,"5min":6.9359999999999999,"15min":6.9359999999999999},"last":0.495},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.442}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.2589999999999999,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.3290000000000002,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.84199999999999997}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":0.752}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.496,"5min":3.496,"15min":3.496},"last":0.80700000000000005}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.177,"5min":3.177,"15min":3.177},"last":0.71699999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":149523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.29799999999999999}]},{"osd":2,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.314},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.38}]},{"osd":3,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.745}]},{"osd":6,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.70999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":738257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.497}]},{"osd":2,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.65200000000000002}]},{"osd":3,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":0.59099999999999997}]},{"osd":6,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.628}]},{"osd":7,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:09:22.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T21:09:22.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a9b51d640 1 Processor -- start 2023-11-28T21:09:22.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a9b51d640 1 -- start start 2023-11-28T21:09:22.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a9b51d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a9413e090 0x7f7a940cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a9b51d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a940cea50 con 0x7f7a9415c250 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a9b51d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a940ce1b0 con 0x7f7a94140e90 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a9b51d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9413e470 con 0x7f7a9413e090 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a98ab8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7a9415c250 0x7f7a94140780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34594/0 (socket says 172.21.15.6:34594) 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a98ab8640 1 -- 172.21.15.6:0/2108715544 learned_addr learned my addr 172.21.15.6:0/2108715544 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a992b9640 1 --2- 172.21.15.6:0/2108715544 >> v2:172.21.15.31:3300/0 conn(0x7f7a9413e090 0x7f7a940cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a8bfff640 1 -- 172.21.15.6:0/2108715544 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780246789 0 0) 0x7f7a940cea50 con 0x7f7a9415c250 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.502+0000 7f7a8bfff640 1 -- 172.21.15.6:0/2108715544 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a80003530 con 0x7f7a9415c250 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.506+0000 7f7a992b9640 1 -- 172.21.15.6:0/2108715544 >> v1:172.21.15.31:6789/0 conn(0x7f7a94140e90 legacy=0x7f7a9406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.506+0000 7f7a992b9640 1 -- 172.21.15.6:0/2108715544 >> v1:172.21.15.6:6789/0 conn(0x7f7a9415c250 legacy=0x7f7a94140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.506+0000 7f7a992b9640 1 -- 172.21.15.6:0/2108715544 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a940ce490 con 0x7f7a9413e090 2023-11-28T21:09:22.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.506+0000 7f7a992b9640 1 --2- 172.21.15.6:0/2108715544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a9413e090 0x7f7a940cd740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7a900097c0 tx=0x7f7a9001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1e1c44bd2df917 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:22.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.506+0000 7f7a8bfff640 1 -- 172.21.15.6:0/2108715544 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900ac620 con 0x7f7a9413e090 2023-11-28T21:09:22.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.506+0000 7f7a8bfff640 1 -- 172.21.15.6:0/2108715544 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a900ac780 con 0x7f7a9413e090 2023-11-28T21:09:22.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.506+0000 7f7a8bfff640 1 -- 172.21.15.6:0/2108715544 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900acb10 con 0x7f7a9413e090 2023-11-28T21:09:22.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.506+0000 7f7a9b51d640 1 -- 172.21.15.6:0/2108715544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a9413e090 msgr2=0x7f7a940cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.506+0000 7f7a9b51d640 1 --2- 172.21.15.6:0/2108715544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a9413e090 0x7f7a940cd740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7a900097c0 tx=0x7f7a9001c3c0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 -- 172.21.15.6:0/2108715544 shutdown_connections 2023-11-28T21:09:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 --2- 172.21.15.6:0/2108715544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a9413e090 0x7f7a940cd740 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 -- 172.21.15.6:0/2108715544 >> 172.21.15.6:0/2108715544 conn(0x7f7a9406ab80 msgr2=0x7f7a940b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 -- 172.21.15.6:0/2108715544 shutdown_connections 2023-11-28T21:09:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 -- 172.21.15.6:0/2108715544 wait complete. 2023-11-28T21:09:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 Processor -- start 2023-11-28T21:09:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 -- start start 2023-11-28T21:09:22.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a9413e090 0x7f7a94154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a94140e90 0x7f7a940af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a9415c250 0x7f7a940aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941f6510 con 0x7f7a9413e090 2023-11-28T21:09:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941f6720 con 0x7f7a94140e90 2023-11-28T21:09:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a9b51d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a941f6a00 con 0x7f7a9415c250 2023-11-28T21:09:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a992b9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a9413e090 0x7f7a94154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a992b9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a9413e090 0x7f7a94154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40202/0 (socket says 172.21.15.6:40202) 2023-11-28T21:09:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a992b9640 1 -- 172.21.15.6:0/1043122036 learned_addr learned my addr 172.21.15.6:0/1043122036 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a98ab8640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a94140e90 0x7f7a940af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a99aba640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a9415c250 0x7f7a940aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a992b9640 1 -- 172.21.15.6:0/1043122036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a9415c250 msgr2=0x7f7a940aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a992b9640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a9415c250 0x7f7a940aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a992b9640 1 -- 172.21.15.6:0/1043122036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a94140e90 msgr2=0x7f7a940af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a992b9640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a94140e90 0x7f7a940af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.510+0000 7f7a992b9640 1 -- 172.21.15.6:0/1043122036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a90009420 con 0x7f7a9413e090 2023-11-28T21:09:22.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a992b9640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a9413e090 0x7f7a94154ba0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7a90018fd0 tx=0x7f7a90019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:22.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a89ffb640 1 -- 172.21.15.6:0/1043122036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900b5410 con 0x7f7a9413e090 2023-11-28T21:09:22.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a89ffb640 1 -- 172.21.15.6:0/1043122036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a900b5590 con 0x7f7a9413e090 2023-11-28T21:09:22.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a89ffb640 1 -- 172.21.15.6:0/1043122036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900b5940 con 0x7f7a9413e090 2023-11-28T21:09:22.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a941f6ce0 con 0x7f7a9413e090 2023-11-28T21:09:22.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a941f72a0 con 0x7f7a9413e090 2023-11-28T21:09:22.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a941f6b40 con 0x7f7a9413e090 2023-11-28T21:09:22.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a89ffb640 1 -- 172.21.15.6:0/1043122036 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a900b3040 con 0x7f7a9413e090 2023-11-28T21:09:22.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a89ffb640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7a78066470 0x7f7a78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.514+0000 7f7a89ffb640 1 -- 172.21.15.6:0/1043122036 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a9011d960 con 0x7f7a9413e090 2023-11-28T21:09:22.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.518+0000 7f7a98ab8640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7a78066470 0x7f7a78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.518+0000 7f7a98ab8640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7a78066470 0x7f7a78068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a840011f0 tx=0x7f7a84007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:22.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.518+0000 7f7a89ffb640 1 -- 172.21.15.6:0/1043122036 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7a941f6b40 con 0x7f7a9413e090 2023-11-28T21:09:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.674+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a94168f20 con 0x7f7a78066470 2023-11-28T21:09:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.682+0000 7f7a89ffb640 1 -- 172.21.15.6:0/1043122036 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289155 (secure 0 0 0) 0x7f7a84005860 con 0x7f7a78066470 2023-11-28T21:09:22.691 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:22.692 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-28T21:09:22.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7a78066470 msgr2=0x7f7a78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7a78066470 0x7f7a78068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a840011f0 tx=0x7f7a84007d40 comp rx=0 tx=0).stop 2023-11-28T21:09:22.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a9413e090 msgr2=0x7f7a94154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a9413e090 0x7f7a94154ba0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7a90018fd0 tx=0x7f7a90019160 comp rx=0 tx=0).stop 2023-11-28T21:09:22.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 shutdown_connections 2023-11-28T21:09:22.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7a78066470 0x7f7a78068930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a9415c250 0x7f7a940aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a94140e90 0x7f7a940af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 --2- 172.21.15.6:0/1043122036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a9413e090 0x7f7a94154ba0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 >> 172.21.15.6:0/1043122036 conn(0x7f7a9406ab80 msgr2=0x7f7a9413d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:22.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 shutdown_connections 2023-11-28T21:09:22.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.686+0000 7f7a9b51d640 1 -- 172.21.15.6:0/1043122036 wait complete. 2023-11-28T21:09:22.711 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-11-28T21:09:22.671611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220336,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754384,"statfs":{"total":773094113280,"available":772868489216,"internally_reserved":0,"allocated":4268032,"data_stored":2368668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.031536"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661266+0000","last_change":"2023-11-28T21:09:13.660274+0000","last_active":"2023-11-28T21:09:14.661266+0000","last_peered":"2023-11-28T21:09:14.661266+0000","last_clean":"2023-11-28T21:09:14.661266+0000","last_became_active":"2023-11-28T21:09:13.659569+0000","last_became_peered":"2023-11-28T21:09:13.659569+0000","last_unstale":"2023-11-28T21:09:14.661266+0000","last_undegraded":"2023-11-28T21:09:14.661266+0000","last_fullsized":"2023-11-28T21:09:14.661266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:53.222971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835726+0000","last_change":"2023-11-28T21:09:13.660581+0000","last_active":"2023-11-28T21:09:14.835726+0000","last_peered":"2023-11-28T21:09:14.835726+0000","last_clean":"2023-11-28T21:09:14.835726+0000","last_became_active":"2023-11-28T21:09:13.660304+0000","last_became_peered":"2023-11-28T21:09:13.660304+0000","last_unstale":"2023-11-28T21:09:14.835726+0000","last_undegraded":"2023-11-28T21:09:14.835726+0000","last_fullsized":"2023-11-28T21:09:14.835726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:37.204251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891686+0000","last_change":"2023-11-28T21:09:13.672515+0000","last_active":"2023-11-28T21:09:15.891686+0000","last_peered":"2023-11-28T21:09:15.891686+0000","last_clean":"2023-11-28T21:09:15.891686+0000","last_became_active":"2023-11-28T21:09:13.672101+0000","last_became_peered":"2023-11-28T21:09:13.672101+0000","last_unstale":"2023-11-28T21:09:15.891686+0000","last_undegraded":"2023-11-28T21:09:15.891686+0000","last_fullsized":"2023-11-28T21:09:15.891686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:49.406077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757557+0000","last_change":"2023-11-28T21:09:13.671866+0000","last_active":"2023-11-28T21:09:15.757557+0000","last_peered":"2023-11-28T21:09:15.757557+0000","last_clean":"2023-11-28T21:09:15.757557+0000","last_became_active":"2023-11-28T21:09:13.671575+0000","last_became_peered":"2023-11-28T21:09:13.671575+0000","last_unstale":"2023-11-28T21:09:15.757557+0000","last_undegraded":"2023-11-28T21:09:15.757557+0000","last_fullsized":"2023-11-28T21:09:15.757557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:32.681369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889384+0000","last_change":"2023-11-28T21:09:13.671317+0000","last_active":"2023-11-28T21:09:15.889384+0000","last_peered":"2023-11-28T21:09:15.889384+0000","last_clean":"2023-11-28T21:09:15.889384+0000","last_became_active":"2023-11-28T21:09:13.671001+0000","last_became_peered":"2023-11-28T21:09:13.671001+0000","last_unstale":"2023-11-28T21:09:15.889384+0000","last_undegraded":"2023-11-28T21:09:15.889384+0000","last_fullsized":"2023-11-28T21:09:15.889384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:16.093343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835340+0000","last_change":"2023-11-28T21:09:13.658770+0000","last_active":"2023-11-28T21:09:14.835340+0000","last_peered":"2023-11-28T21:09:14.835340+0000","last_clean":"2023-11-28T21:09:14.835340+0000","last_became_active":"2023-11-28T21:09:13.652823+0000","last_became_peered":"2023-11-28T21:09:13.652823+0000","last_unstale":"2023-11-28T21:09:14.835340+0000","last_undegraded":"2023-11-28T21:09:14.835340+0000","last_fullsized":"2023-11-28T21:09:14.835340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:18:19.774066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891277+0000","last_change":"2023-11-28T21:09:13.670345+0000","last_active":"2023-11-28T21:09:15.891277+0000","last_peered":"2023-11-28T21:09:15.891277+0000","last_clean":"2023-11-28T21:09:15.891277+0000","last_became_active":"2023-11-28T21:09:13.670064+0000","last_became_peered":"2023-11-28T21:09:13.670064+0000","last_unstale":"2023-11-28T21:09:15.891277+0000","last_undegraded":"2023-11-28T21:09:15.891277+0000","last_fullsized":"2023-11-28T21:09:15.891277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:17:23.140185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890726+0000","last_change":"2023-11-28T21:09:13.679495+0000","last_active":"2023-11-28T21:09:15.890726+0000","last_peered":"2023-11-28T21:09:15.890726+0000","last_clean":"2023-11-28T21:09:15.890726+0000","last_became_active":"2023-11-28T21:09:13.679145+0000","last_became_peered":"2023-11-28T21:09:13.679145+0000","last_unstale":"2023-11-28T21:09:15.890726+0000","last_undegraded":"2023-11-28T21:09:15.890726+0000","last_fullsized":"2023-11-28T21:09:15.890726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:43.025045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661388+0000","last_change":"2023-11-28T21:09:13.681445+0000","last_active":"2023-11-28T21:09:14.661388+0000","last_peered":"2023-11-28T21:09:14.661388+0000","last_clean":"2023-11-28T21:09:14.661388+0000","last_became_active":"2023-11-28T21:09:13.681141+0000","last_became_peered":"2023-11-28T21:09:13.681141+0000","last_unstale":"2023-11-28T21:09:14.661388+0000","last_undegraded":"2023-11-28T21:09:14.661388+0000","last_fullsized":"2023-11-28T21:09:14.661388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:19:46.950869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.756875+0000","last_change":"2023-11-28T21:09:13.671992+0000","last_active":"2023-11-28T21:09:15.756875+0000","last_peered":"2023-11-28T21:09:15.756875+0000","last_clean":"2023-11-28T21:09:15.756875+0000","last_became_active":"2023-11-28T21:09:13.671702+0000","last_became_peered":"2023-11-28T21:09:13.671702+0000","last_unstale":"2023-11-28T21:09:15.756875+0000","last_undegraded":"2023-11-28T21:09:15.756875+0000","last_fullsized":"2023-11-28T21:09:15.756875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:25.891136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891334+0000","last_change":"2023-11-28T21:09:13.683081+0000","last_active":"2023-11-28T21:09:15.891334+0000","last_peered":"2023-11-28T21:09:15.891334+0000","last_clean":"2023-11-28T21:09:15.891334+0000","last_became_active":"2023-11-28T21:09:13.682920+0000","last_became_peered":"2023-11-28T21:09:13.682920+0000","last_unstale":"2023-11-28T21:09:15.891334+0000","last_undegraded":"2023-11-28T21:09:15.891334+0000","last_fullsized":"2023-11-28T21:09:15.891334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:48.095666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891180+0000","last_change":"2023-11-28T21:09:13.654835+0000","last_active":"2023-11-28T21:09:15.891180+0000","last_peered":"2023-11-28T21:09:15.891180+0000","last_clean":"2023-11-28T21:09:15.891180+0000","last_became_active":"2023-11-28T21:09:13.654562+0000","last_became_peered":"2023-11-28T21:09:13.654562+0000","last_unstale":"2023-11-28T21:09:15.891180+0000","last_undegraded":"2023-11-28T21:09:15.891180+0000","last_fullsized":"2023-11-28T21:09:15.891180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:17:23.140185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889358+0000","last_change":"2023-11-28T21:09:13.689337+0000","last_active":"2023-11-28T21:09:15.889358+0000","last_peered":"2023-11-28T21:09:15.889358+0000","last_clean":"2023-11-28T21:09:15.889358+0000","last_became_active":"2023-11-28T21:09:13.689045+0000","last_became_peered":"2023-11-28T21:09:13.689045+0000","last_unstale":"2023-11-28T21:09:15.889358+0000","last_undegraded":"2023-11-28T21:09:15.889358+0000","last_fullsized":"2023-11-28T21:09:15.889358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:00:44.700113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835413+0000","last_change":"2023-11-28T21:09:13.666580+0000","last_active":"2023-11-28T21:09:14.835413+0000","last_peered":"2023-11-28T21:09:14.835413+0000","last_clean":"2023-11-28T21:09:14.835413+0000","last_became_active":"2023-11-28T21:09:13.666310+0000","last_became_peered":"2023-11-28T21:09:13.666310+0000","last_unstale":"2023-11-28T21:09:14.835413+0000","last_undegraded":"2023-11-28T21:09:14.835413+0000","last_fullsized":"2023-11-28T21:09:14.835413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:21:15.367228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890902+0000","last_change":"2023-11-28T21:09:13.662169+0000","last_active":"2023-11-28T21:09:15.890902+0000","last_peered":"2023-11-28T21:09:15.890902+0000","last_clean":"2023-11-28T21:09:15.890902+0000","last_became_active":"2023-11-28T21:09:13.661894+0000","last_became_peered":"2023-11-28T21:09:13.661894+0000","last_unstale":"2023-11-28T21:09:15.890902+0000","last_undegraded":"2023-11-28T21:09:15.890902+0000","last_fullsized":"2023-11-28T21:09:15.890902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:17:18.754699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891140+0000","last_change":"2023-11-28T21:09:13.674375+0000","last_active":"2023-11-28T21:09:15.891140+0000","last_peered":"2023-11-28T21:09:15.891140+0000","last_clean":"2023-11-28T21:09:15.891140+0000","last_became_active":"2023-11-28T21:09:13.674093+0000","last_became_peered":"2023-11-28T21:09:13.674093+0000","last_unstale":"2023-11-28T21:09:15.891140+0000","last_undegraded":"2023-11-28T21:09:15.891140+0000","last_fullsized":"2023-11-28T21:09:15.891140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:17:18.754699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891919+0000","last_change":"2023-11-28T21:09:13.670080+0000","last_active":"2023-11-28T21:09:15.891919+0000","last_peered":"2023-11-28T21:09:15.891919+0000","last_clean":"2023-11-28T21:09:15.891919+0000","last_became_active":"2023-11-28T21:09:13.669779+0000","last_became_peered":"2023-11-28T21:09:13.669779+0000","last_unstale":"2023-11-28T21:09:15.891919+0000","last_undegraded":"2023-11-28T21:09:15.891919+0000","last_fullsized":"2023-11-28T21:09:15.891919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:13:20.767673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835783+0000","last_change":"2023-11-28T21:09:13.665028+0000","last_active":"2023-11-28T21:09:14.835783+0000","last_peered":"2023-11-28T21:09:14.835783+0000","last_clean":"2023-11-28T21:09:14.835783+0000","last_became_active":"2023-11-28T21:09:13.664691+0000","last_became_peered":"2023-11-28T21:09:13.664691+0000","last_unstale":"2023-11-28T21:09:14.835783+0000","last_undegraded":"2023-11-28T21:09:14.835783+0000","last_fullsized":"2023-11-28T21:09:14.835783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:52:14.905737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835639+0000","last_change":"2023-11-28T21:09:13.678077+0000","last_active":"2023-11-28T21:09:14.835639+0000","last_peered":"2023-11-28T21:09:14.835639+0000","last_clean":"2023-11-28T21:09:14.835639+0000","last_became_active":"2023-11-28T21:09:13.677787+0000","last_became_peered":"2023-11-28T21:09:13.677787+0000","last_unstale":"2023-11-28T21:09:14.835639+0000","last_undegraded":"2023-11-28T21:09:14.835639+0000","last_fullsized":"2023-11-28T21:09:14.835639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:49:57.669185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889407+0000","last_change":"2023-11-28T21:09:13.664306+0000","last_active":"2023-11-28T21:09:15.889407+0000","last_peered":"2023-11-28T21:09:15.889407+0000","last_clean":"2023-11-28T21:09:15.889407+0000","last_became_active":"2023-11-28T21:09:13.663795+0000","last_became_peered":"2023-11-28T21:09:13.663795+0000","last_unstale":"2023-11-28T21:09:15.889407+0000","last_undegraded":"2023-11-28T21:09:15.889407+0000","last_fullsized":"2023-11-28T21:09:15.889407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:33.818195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660594+0000","last_change":"2023-11-28T21:09:13.666685+0000","last_active":"2023-11-28T21:09:14.660594+0000","last_peered":"2023-11-28T21:09:14.660594+0000","last_clean":"2023-11-28T21:09:14.660594+0000","last_became_active":"2023-11-28T21:09:13.666279+0000","last_became_peered":"2023-11-28T21:09:13.666279+0000","last_unstale":"2023-11-28T21:09:14.660594+0000","last_undegraded":"2023-11-28T21:09:14.660594+0000","last_fullsized":"2023-11-28T21:09:14.660594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:29:13.186005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660753+0000","last_change":"2023-11-28T21:09:13.671205+0000","last_active":"2023-11-28T21:09:14.660753+0000","last_peered":"2023-11-28T21:09:14.660753+0000","last_clean":"2023-11-28T21:09:14.660753+0000","last_became_active":"2023-11-28T21:09:13.670373+0000","last_became_peered":"2023-11-28T21:09:13.670373+0000","last_unstale":"2023-11-28T21:09:14.660753+0000","last_undegraded":"2023-11-28T21:09:14.660753+0000","last_fullsized":"2023-11-28T21:09:14.660753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:50:06.840676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.656899+0000","last_change":"2023-11-28T21:09:13.668933+0000","last_active":"2023-11-28T21:09:14.656899+0000","last_peered":"2023-11-28T21:09:14.656899+0000","last_clean":"2023-11-28T21:09:14.656899+0000","last_became_active":"2023-11-28T21:09:13.668649+0000","last_became_peered":"2023-11-28T21:09:13.668649+0000","last_unstale":"2023-11-28T21:09:14.656899+0000","last_undegraded":"2023-11-28T21:09:14.656899+0000","last_fullsized":"2023-11-28T21:09:14.656899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:25.375246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891298+0000","last_change":"2023-11-28T21:09:13.667810+0000","last_active":"2023-11-28T21:09:15.891298+0000","last_peered":"2023-11-28T21:09:15.891298+0000","last_clean":"2023-11-28T21:09:15.891298+0000","last_became_active":"2023-11-28T21:09:13.667493+0000","last_became_peered":"2023-11-28T21:09:13.667493+0000","last_unstale":"2023-11-28T21:09:15.891298+0000","last_undegraded":"2023-11-28T21:09:15.891298+0000","last_fullsized":"2023-11-28T21:09:15.891298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:54:48.095666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757116+0000","last_change":"2023-11-28T21:09:13.671902+0000","last_active":"2023-11-28T21:09:15.757116+0000","last_peered":"2023-11-28T21:09:15.757116+0000","last_clean":"2023-11-28T21:09:15.757116+0000","last_became_active":"2023-11-28T21:09:13.671612+0000","last_became_peered":"2023-11-28T21:09:13.671612+0000","last_unstale":"2023-11-28T21:09:15.757116+0000","last_undegraded":"2023-11-28T21:09:15.757116+0000","last_fullsized":"2023-11-28T21:09:15.757116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:19:46.950869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835837+0000","last_change":"2023-11-28T21:09:13.672767+0000","last_active":"2023-11-28T21:09:14.835837+0000","last_peered":"2023-11-28T21:09:14.835837+0000","last_clean":"2023-11-28T21:09:14.835837+0000","last_became_active":"2023-11-28T21:09:13.672462+0000","last_became_peered":"2023-11-28T21:09:13.672462+0000","last_unstale":"2023-11-28T21:09:14.835837+0000","last_undegraded":"2023-11-28T21:09:14.835837+0000","last_fullsized":"2023-11-28T21:09:14.835837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:03:23.355927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757222+0000","last_change":"2023-11-28T21:09:13.673020+0000","last_active":"2023-11-28T21:09:15.757222+0000","last_peered":"2023-11-28T21:09:15.757222+0000","last_clean":"2023-11-28T21:09:15.757222+0000","last_became_active":"2023-11-28T21:09:13.672578+0000","last_became_peered":"2023-11-28T21:09:13.672578+0000","last_unstale":"2023-11-28T21:09:15.757222+0000","last_undegraded":"2023-11-28T21:09:15.757222+0000","last_fullsized":"2023-11-28T21:09:15.757222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:41:40.417410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891324+0000","last_change":"2023-11-28T21:09:13.659497+0000","last_active":"2023-11-28T21:09:15.891324+0000","last_peered":"2023-11-28T21:09:15.891324+0000","last_clean":"2023-11-28T21:09:15.891324+0000","last_became_active":"2023-11-28T21:09:13.658705+0000","last_became_peered":"2023-11-28T21:09:13.658705+0000","last_unstale":"2023-11-28T21:09:15.891324+0000","last_undegraded":"2023-11-28T21:09:15.891324+0000","last_fullsized":"2023-11-28T21:09:15.891324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:09:17.289660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660754+0000","last_change":"2023-11-28T21:09:13.668037+0000","last_active":"2023-11-28T21:09:14.660754+0000","last_peered":"2023-11-28T21:09:14.660754+0000","last_clean":"2023-11-28T21:09:14.660754+0000","last_became_active":"2023-11-28T21:09:13.667076+0000","last_became_peered":"2023-11-28T21:09:13.667076+0000","last_unstale":"2023-11-28T21:09:14.660754+0000","last_undegraded":"2023-11-28T21:09:14.660754+0000","last_fullsized":"2023-11-28T21:09:14.660754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:59.828467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891515+0000","last_change":"2023-11-28T21:09:13.671745+0000","last_active":"2023-11-28T21:09:15.891515+0000","last_peered":"2023-11-28T21:09:15.891515+0000","last_clean":"2023-11-28T21:09:15.891515+0000","last_became_active":"2023-11-28T21:09:13.671488+0000","last_became_peered":"2023-11-28T21:09:13.671488+0000","last_unstale":"2023-11-28T21:09:15.891515+0000","last_undegraded":"2023-11-28T21:09:15.891515+0000","last_fullsized":"2023-11-28T21:09:15.891515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:49.406077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660231+0000","last_change":"2023-11-28T21:09:13.666375+0000","last_active":"2023-11-28T21:09:14.660231+0000","last_peered":"2023-11-28T21:09:14.660231+0000","last_clean":"2023-11-28T21:09:14.660231+0000","last_became_active":"2023-11-28T21:09:13.665776+0000","last_became_peered":"2023-11-28T21:09:13.665776+0000","last_unstale":"2023-11-28T21:09:14.660231+0000","last_undegraded":"2023-11-28T21:09:14.660231+0000","last_fullsized":"2023-11-28T21:09:14.660231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:57.763678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890791+0000","last_change":"2023-11-28T21:09:13.676240+0000","last_active":"2023-11-28T21:09:15.890791+0000","last_peered":"2023-11-28T21:09:15.890791+0000","last_clean":"2023-11-28T21:09:15.890791+0000","last_became_active":"2023-11-28T21:09:13.675917+0000","last_became_peered":"2023-11-28T21:09:13.675917+0000","last_unstale":"2023-11-28T21:09:15.890791+0000","last_undegraded":"2023-11-28T21:09:15.890791+0000","last_fullsized":"2023-11-28T21:09:15.890791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:22.808855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.657441+0000","last_change":"2023-11-28T21:09:13.679390+0000","last_active":"2023-11-28T21:09:14.657441+0000","last_peered":"2023-11-28T21:09:14.657441+0000","last_clean":"2023-11-28T21:09:14.657441+0000","last_became_active":"2023-11-28T21:09:13.677696+0000","last_became_peered":"2023-11-28T21:09:13.677696+0000","last_unstale":"2023-11-28T21:09:14.657441+0000","last_undegraded":"2023-11-28T21:09:14.657441+0000","last_fullsized":"2023-11-28T21:09:14.657441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:05:51.407555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.687486+0000","last_change":"2023-11-28T21:09:12.649448+0000","last_active":"2023-11-28T21:09:13.687486+0000","last_peered":"2023-11-28T21:09:13.687486+0000","last_clean":"2023-11-28T21:09:13.687486+0000","last_became_active":"2023-11-28T21:09:12.649106+0000","last_became_peered":"2023-11-28T21:09:12.649106+0000","last_unstale":"2023-11-28T21:09:13.687486+0000","last_undegraded":"2023-11-28T21:09:13.687486+0000","last_fullsized":"2023-11-28T21:09:13.687486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:05.796805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661325+0000","last_change":"2023-11-28T21:09:13.670642+0000","last_active":"2023-11-28T21:09:14.661325+0000","last_peered":"2023-11-28T21:09:14.661325+0000","last_clean":"2023-11-28T21:09:14.661325+0000","last_became_active":"2023-11-28T21:09:13.670354+0000","last_became_peered":"2023-11-28T21:09:13.670354+0000","last_unstale":"2023-11-28T21:09:14.661325+0000","last_undegraded":"2023-11-28T21:09:14.661325+0000","last_fullsized":"2023-11-28T21:09:14.661325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:05.387210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.684423+0000","last_change":"2023-11-28T21:09:12.644836+0000","last_active":"2023-11-28T21:09:13.684423+0000","last_peered":"2023-11-28T21:09:13.684423+0000","last_clean":"2023-11-28T21:09:13.684423+0000","last_became_active":"2023-11-28T21:09:12.644552+0000","last_became_peered":"2023-11-28T21:09:12.644552+0000","last_unstale":"2023-11-28T21:09:13.684423+0000","last_undegraded":"2023-11-28T21:09:13.684423+0000","last_fullsized":"2023-11-28T21:09:13.684423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:49:25.030386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661101+0000","last_change":"2023-11-28T21:09:13.666939+0000","last_active":"2023-11-28T21:09:14.661101+0000","last_peered":"2023-11-28T21:09:14.661101+0000","last_clean":"2023-11-28T21:09:14.661101+0000","last_became_active":"2023-11-28T21:09:13.666577+0000","last_became_peered":"2023-11-28T21:09:13.666577+0000","last_unstale":"2023-11-28T21:09:14.661101+0000","last_undegraded":"2023-11-28T21:09:14.661101+0000","last_fullsized":"2023-11-28T21:09:14.661101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:05.142460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.691779+0000","last_change":"2023-11-28T21:09:12.657651+0000","last_active":"2023-11-28T21:09:13.691779+0000","last_peered":"2023-11-28T21:09:13.691779+0000","last_clean":"2023-11-28T21:09:13.691779+0000","last_became_active":"2023-11-28T21:09:12.656442+0000","last_became_peered":"2023-11-28T21:09:12.656442+0000","last_unstale":"2023-11-28T21:09:13.691779+0000","last_undegraded":"2023-11-28T21:09:13.691779+0000","last_fullsized":"2023-11-28T21:09:13.691779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:54:55.934170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757342+0000","last_change":"2023-11-28T21:09:13.672834+0000","last_active":"2023-11-28T21:09:15.757342+0000","last_peered":"2023-11-28T21:09:15.757342+0000","last_clean":"2023-11-28T21:09:15.757342+0000","last_became_active":"2023-11-28T21:09:13.672212+0000","last_became_peered":"2023-11-28T21:09:13.672212+0000","last_unstale":"2023-11-28T21:09:15.757342+0000","last_undegraded":"2023-11-28T21:09:15.757342+0000","last_fullsized":"2023-11-28T21:09:15.757342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:38:27.234217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.688865+0000","last_change":"2023-11-28T21:09:12.651372+0000","last_active":"2023-11-28T21:09:13.688865+0000","last_peered":"2023-11-28T21:09:13.688865+0000","last_clean":"2023-11-28T21:09:13.688865+0000","last_became_active":"2023-11-28T21:09:12.651014+0000","last_became_peered":"2023-11-28T21:09:12.651014+0000","last_unstale":"2023-11-28T21:09:13.688865+0000","last_undegraded":"2023-11-28T21:09:13.688865+0000","last_fullsized":"2023-11-28T21:09:13.688865+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:40:36.785608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891516+0000","last_change":"2023-11-28T21:09:13.673945+0000","last_active":"2023-11-28T21:09:15.891516+0000","last_peered":"2023-11-28T21:09:15.891516+0000","last_clean":"2023-11-28T21:09:15.891516+0000","last_became_active":"2023-11-28T21:09:13.673628+0000","last_became_peered":"2023-11-28T21:09:13.673628+0000","last_unstale":"2023-11-28T21:09:15.891516+0000","last_undegraded":"2023-11-28T21:09:15.891516+0000","last_fullsized":"2023-11-28T21:09:15.891516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:46:20.180469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.691264+0000","last_change":"2023-11-28T21:09:12.658946+0000","last_active":"2023-11-28T21:09:13.691264+0000","last_peered":"2023-11-28T21:09:13.691264+0000","last_clean":"2023-11-28T21:09:13.691264+0000","last_became_active":"2023-11-28T21:09:12.658480+0000","last_became_peered":"2023-11-28T21:09:12.658480+0000","last_unstale":"2023-11-28T21:09:13.691264+0000","last_undegraded":"2023-11-28T21:09:13.691264+0000","last_fullsized":"2023-11-28T21:09:13.691264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:39:32.807382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890789+0000","last_change":"2023-11-28T21:09:13.663480+0000","last_active":"2023-11-28T21:09:15.890789+0000","last_peered":"2023-11-28T21:09:15.890789+0000","last_clean":"2023-11-28T21:09:15.890789+0000","last_became_active":"2023-11-28T21:09:13.663174+0000","last_became_peered":"2023-11-28T21:09:13.663174+0000","last_unstale":"2023-11-28T21:09:15.890789+0000","last_undegraded":"2023-11-28T21:09:15.890789+0000","last_fullsized":"2023-11-28T21:09:15.890789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:57.959074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.691241+0000","last_change":"2023-11-28T21:09:12.656711+0000","last_active":"2023-11-28T21:09:13.691241+0000","last_peered":"2023-11-28T21:09:13.691241+0000","last_clean":"2023-11-28T21:09:13.691241+0000","last_became_active":"2023-11-28T21:09:12.656379+0000","last_became_peered":"2023-11-28T21:09:12.656379+0000","last_unstale":"2023-11-28T21:09:13.691241+0000","last_undegraded":"2023-11-28T21:09:13.691241+0000","last_fullsized":"2023-11-28T21:09:13.691241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:07.636914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660163+0000","last_change":"2023-11-28T21:09:13.669711+0000","last_active":"2023-11-28T21:09:14.660163+0000","last_peered":"2023-11-28T21:09:14.660163+0000","last_clean":"2023-11-28T21:09:14.660163+0000","last_became_active":"2023-11-28T21:09:13.667887+0000","last_became_peered":"2023-11-28T21:09:13.667887+0000","last_unstale":"2023-11-28T21:09:14.660163+0000","last_undegraded":"2023-11-28T21:09:14.660163+0000","last_fullsized":"2023-11-28T21:09:14.660163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:53.222971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.643623+0000","last_change":"2023-11-28T21:09:12.648813+0000","last_active":"2023-11-28T21:09:13.643623+0000","last_peered":"2023-11-28T21:09:13.643623+0000","last_clean":"2023-11-28T21:09:13.643623+0000","last_became_active":"2023-11-28T21:09:12.648505+0000","last_became_peered":"2023-11-28T21:09:12.648505+0000","last_unstale":"2023-11-28T21:09:13.643623+0000","last_undegraded":"2023-11-28T21:09:13.643623+0000","last_fullsized":"2023-11-28T21:09:13.643623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:00:33.370055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.756762+0000","last_change":"2023-11-28T21:09:13.676364+0000","last_active":"2023-11-28T21:09:15.756762+0000","last_peered":"2023-11-28T21:09:15.756762+0000","last_clean":"2023-11-28T21:09:15.756762+0000","last_became_active":"2023-11-28T21:09:13.674308+0000","last_became_peered":"2023-11-28T21:09:13.674308+0000","last_unstale":"2023-11-28T21:09:15.756762+0000","last_undegraded":"2023-11-28T21:09:15.756762+0000","last_fullsized":"2023-11-28T21:09:15.756762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:54:59.828467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.655274+0000","last_change":"2023-11-28T21:09:12.646807+0000","last_active":"2023-11-28T21:09:13.655274+0000","last_peered":"2023-11-28T21:09:13.655274+0000","last_clean":"2023-11-28T21:09:13.655274+0000","last_became_active":"2023-11-28T21:09:12.646520+0000","last_became_peered":"2023-11-28T21:09:12.646520+0000","last_unstale":"2023-11-28T21:09:13.655274+0000","last_undegraded":"2023-11-28T21:09:13.655274+0000","last_fullsized":"2023-11-28T21:09:13.655274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:13:15.082530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891769+0000","last_change":"2023-11-28T21:09:13.654174+0000","last_active":"2023-11-28T21:09:15.891769+0000","last_peered":"2023-11-28T21:09:15.891769+0000","last_clean":"2023-11-28T21:09:15.891769+0000","last_became_active":"2023-11-28T21:09:13.653887+0000","last_became_peered":"2023-11-28T21:09:13.653887+0000","last_unstale":"2023-11-28T21:09:15.891769+0000","last_undegraded":"2023-11-28T21:09:15.891769+0000","last_fullsized":"2023-11-28T21:09:15.891769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:46:20.180469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.644893+0000","last_change":"2023-11-28T21:09:12.658693+0000","last_active":"2023-11-28T21:09:13.644893+0000","last_peered":"2023-11-28T21:09:13.644893+0000","last_clean":"2023-11-28T21:09:13.644893+0000","last_became_active":"2023-11-28T21:09:12.656392+0000","last_became_peered":"2023-11-28T21:09:12.656392+0000","last_unstale":"2023-11-28T21:09:13.644893+0000","last_undegraded":"2023-11-28T21:09:13.644893+0000","last_fullsized":"2023-11-28T21:09:13.644893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:56:17.492379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835738+0000","last_change":"2023-11-28T21:09:13.672578+0000","last_active":"2023-11-28T21:09:14.835738+0000","last_peered":"2023-11-28T21:09:14.835738+0000","last_clean":"2023-11-28T21:09:14.835738+0000","last_became_active":"2023-11-28T21:09:13.672304+0000","last_became_peered":"2023-11-28T21:09:13.672304+0000","last_unstale":"2023-11-28T21:09:14.835738+0000","last_undegraded":"2023-11-28T21:09:14.835738+0000","last_fullsized":"2023-11-28T21:09:14.835738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:31:50.155119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.651996+0000","last_change":"2023-11-28T21:09:12.658670+0000","last_active":"2023-11-28T21:09:13.651996+0000","last_peered":"2023-11-28T21:09:13.651996+0000","last_clean":"2023-11-28T21:09:13.651996+0000","last_became_active":"2023-11-28T21:09:12.658340+0000","last_became_peered":"2023-11-28T21:09:12.658340+0000","last_unstale":"2023-11-28T21:09:13.651996+0000","last_undegraded":"2023-11-28T21:09:13.651996+0000","last_fullsized":"2023-11-28T21:09:13.651996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:09:03.644817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835652+0000","last_change":"2023-11-28T21:09:13.665675+0000","last_active":"2023-11-28T21:09:14.835652+0000","last_peered":"2023-11-28T21:09:14.835652+0000","last_clean":"2023-11-28T21:09:14.835652+0000","last_became_active":"2023-11-28T21:09:13.664487+0000","last_became_peered":"2023-11-28T21:09:13.664487+0000","last_unstale":"2023-11-28T21:09:14.835652+0000","last_undegraded":"2023-11-28T21:09:14.835652+0000","last_fullsized":"2023-11-28T21:09:14.835652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:06:10.555790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.680925+0000","last_change":"2023-11-28T21:09:12.651865+0000","last_active":"2023-11-28T21:09:13.680925+0000","last_peered":"2023-11-28T21:09:13.680925+0000","last_clean":"2023-11-28T21:09:13.680925+0000","last_became_active":"2023-11-28T21:09:12.651478+0000","last_became_peered":"2023-11-28T21:09:12.651478+0000","last_unstale":"2023-11-28T21:09:13.680925+0000","last_undegraded":"2023-11-28T21:09:13.680925+0000","last_fullsized":"2023-11-28T21:09:13.680925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:42.014232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890877+0000","last_change":"2023-11-28T21:09:13.673060+0000","last_active":"2023-11-28T21:09:15.890877+0000","last_peered":"2023-11-28T21:09:15.890877+0000","last_clean":"2023-11-28T21:09:15.890877+0000","last_became_active":"2023-11-28T21:09:13.672735+0000","last_became_peered":"2023-11-28T21:09:13.672735+0000","last_unstale":"2023-11-28T21:09:15.890877+0000","last_undegraded":"2023-11-28T21:09:15.890877+0000","last_fullsized":"2023-11-28T21:09:15.890877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:08.599206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.694401+0000","last_change":"2023-11-28T21:09:12.657122+0000","last_active":"2023-11-28T21:09:13.694401+0000","last_peered":"2023-11-28T21:09:13.694401+0000","last_clean":"2023-11-28T21:09:13.694401+0000","last_became_active":"2023-11-28T21:09:12.656848+0000","last_became_peered":"2023-11-28T21:09:12.656848+0000","last_unstale":"2023-11-28T21:09:13.694401+0000","last_undegraded":"2023-11-28T21:09:13.694401+0000","last_fullsized":"2023-11-28T21:09:13.694401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:51.542697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.756784+0000","last_change":"2023-11-28T21:09:13.676811+0000","last_active":"2023-11-28T21:09:15.756784+0000","last_peered":"2023-11-28T21:09:15.756784+0000","last_clean":"2023-11-28T21:09:15.756784+0000","last_became_active":"2023-11-28T21:09:13.674862+0000","last_became_peered":"2023-11-28T21:09:13.674862+0000","last_unstale":"2023-11-28T21:09:15.756784+0000","last_undegraded":"2023-11-28T21:09:15.756784+0000","last_fullsized":"2023-11-28T21:09:15.756784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:05.142460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.686619+0000","last_change":"2023-11-28T21:09:12.646329+0000","last_active":"2023-11-28T21:09:13.686619+0000","last_peered":"2023-11-28T21:09:13.686619+0000","last_clean":"2023-11-28T21:09:13.686619+0000","last_became_active":"2023-11-28T21:09:12.646002+0000","last_became_peered":"2023-11-28T21:09:12.646002+0000","last_unstale":"2023-11-28T21:09:13.686619+0000","last_undegraded":"2023-11-28T21:09:13.686619+0000","last_fullsized":"2023-11-28T21:09:13.686619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:05.796805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835650+0000","last_change":"2023-11-28T21:09:13.659699+0000","last_active":"2023-11-28T21:09:14.835650+0000","last_peered":"2023-11-28T21:09:14.835650+0000","last_clean":"2023-11-28T21:09:14.835650+0000","last_became_active":"2023-11-28T21:09:13.659369+0000","last_became_peered":"2023-11-28T21:09:13.659369+0000","last_unstale":"2023-11-28T21:09:14.835650+0000","last_undegraded":"2023-11-28T21:09:14.835650+0000","last_fullsized":"2023-11-28T21:09:14.835650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:59:35.141172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.677093+0000","last_change":"2023-11-28T21:09:12.647560+0000","last_active":"2023-11-28T21:09:13.677093+0000","last_peered":"2023-11-28T21:09:13.677093+0000","last_clean":"2023-11-28T21:09:13.677093+0000","last_became_active":"2023-11-28T21:09:12.647217+0000","last_became_peered":"2023-11-28T21:09:12.647217+0000","last_unstale":"2023-11-28T21:09:13.677093+0000","last_undegraded":"2023-11-28T21:09:13.677093+0000","last_fullsized":"2023-11-28T21:09:13.677093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:29.233767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.890947+0000","last_change":"2023-11-28T21:09:13.673945+0000","last_active":"2023-11-28T21:09:15.890947+0000","last_peered":"2023-11-28T21:09:15.890947+0000","last_clean":"2023-11-28T21:09:15.890947+0000","last_became_active":"2023-11-28T21:09:13.673608+0000","last_became_peered":"2023-11-28T21:09:13.673608+0000","last_unstale":"2023-11-28T21:09:15.890947+0000","last_undegraded":"2023-11-28T21:09:15.890947+0000","last_fullsized":"2023-11-28T21:09:15.890947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:45:57.959074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.642770+0000","last_change":"2023-11-28T21:09:12.648568+0000","last_active":"2023-11-28T21:09:13.642770+0000","last_peered":"2023-11-28T21:09:13.642770+0000","last_clean":"2023-11-28T21:09:13.642770+0000","last_became_active":"2023-11-28T21:09:12.648273+0000","last_became_peered":"2023-11-28T21:09:12.648273+0000","last_unstale":"2023-11-28T21:09:13.642770+0000","last_undegraded":"2023-11-28T21:09:13.642770+0000","last_fullsized":"2023-11-28T21:09:13.642770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:53:25.602316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660641+0000","last_change":"2023-11-28T21:09:13.669729+0000","last_active":"2023-11-28T21:09:14.660641+0000","last_peered":"2023-11-28T21:09:14.660641+0000","last_clean":"2023-11-28T21:09:14.660641+0000","last_became_active":"2023-11-28T21:09:13.669296+0000","last_became_peered":"2023-11-28T21:09:13.669296+0000","last_unstale":"2023-11-28T21:09:14.660641+0000","last_undegraded":"2023-11-28T21:09:14.660641+0000","last_fullsized":"2023-11-28T21:09:14.660641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:21.899588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.693198+0000","last_change":"2023-11-28T21:09:12.653405+0000","last_active":"2023-11-28T21:09:13.693198+0000","last_peered":"2023-11-28T21:09:13.693198+0000","last_clean":"2023-11-28T21:09:13.693198+0000","last_became_active":"2023-11-28T21:09:12.653137+0000","last_became_peered":"2023-11-28T21:09:12.653137+0000","last_unstale":"2023-11-28T21:09:13.693198+0000","last_undegraded":"2023-11-28T21:09:13.693198+0000","last_fullsized":"2023-11-28T21:09:13.693198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:49:25.030386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.661326+0000","last_change":"2023-11-28T21:09:13.668871+0000","last_active":"2023-11-28T21:09:14.661326+0000","last_peered":"2023-11-28T21:09:14.661326+0000","last_clean":"2023-11-28T21:09:14.661326+0000","last_became_active":"2023-11-28T21:09:13.668515+0000","last_became_peered":"2023-11-28T21:09:13.668515+0000","last_unstale":"2023-11-28T21:09:14.661326+0000","last_undegraded":"2023-11-28T21:09:14.661326+0000","last_fullsized":"2023-11-28T21:09:14.661326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:40:25.891136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.690663+0000","last_change":"2023-11-28T21:09:12.660005+0000","last_active":"2023-11-28T21:09:13.690663+0000","last_peered":"2023-11-28T21:09:13.690663+0000","last_clean":"2023-11-28T21:09:13.690663+0000","last_became_active":"2023-11-28T21:09:12.659801+0000","last_became_peered":"2023-11-28T21:09:12.659801+0000","last_unstale":"2023-11-28T21:09:13.690663+0000","last_undegraded":"2023-11-28T21:09:13.690663+0000","last_fullsized":"2023-11-28T21:09:13.690663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:29:12.175192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891861+0000","last_change":"2023-11-28T21:09:13.668203+0000","last_active":"2023-11-28T21:09:15.891861+0000","last_peered":"2023-11-28T21:09:15.891861+0000","last_clean":"2023-11-28T21:09:15.891861+0000","last_became_active":"2023-11-28T21:09:13.667919+0000","last_became_peered":"2023-11-28T21:09:13.667919+0000","last_unstale":"2023-11-28T21:09:15.891861+0000","last_undegraded":"2023-11-28T21:09:15.891861+0000","last_fullsized":"2023-11-28T21:09:15.891861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:13:20.767673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.686510+0000","last_change":"2023-11-28T21:09:12.646449+0000","last_active":"2023-11-28T21:09:13.686510+0000","last_peered":"2023-11-28T21:09:13.686510+0000","last_clean":"2023-11-28T21:09:13.686510+0000","last_became_active":"2023-11-28T21:09:12.645943+0000","last_became_peered":"2023-11-28T21:09:12.645943+0000","last_unstale":"2023-11-28T21:09:13.686510+0000","last_undegraded":"2023-11-28T21:09:13.686510+0000","last_fullsized":"2023-11-28T21:09:13.686510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:30:20.888775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.757536+0000","last_change":"2023-11-28T21:09:13.667162+0000","last_active":"2023-11-28T21:09:15.757536+0000","last_peered":"2023-11-28T21:09:15.757536+0000","last_clean":"2023-11-28T21:09:15.757536+0000","last_became_active":"2023-11-28T21:09:13.666842+0000","last_became_peered":"2023-11-28T21:09:13.666842+0000","last_unstale":"2023-11-28T21:09:15.757536+0000","last_undegraded":"2023-11-28T21:09:15.757536+0000","last_fullsized":"2023-11-28T21:09:15.757536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:21:56.044971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.687667+0000","last_change":"2023-11-28T21:09:12.645973+0000","last_active":"2023-11-28T21:09:13.687667+0000","last_peered":"2023-11-28T21:09:13.687667+0000","last_clean":"2023-11-28T21:09:13.687667+0000","last_became_active":"2023-11-28T21:09:12.645659+0000","last_became_peered":"2023-11-28T21:09:12.645659+0000","last_unstale":"2023-11-28T21:09:13.687667+0000","last_undegraded":"2023-11-28T21:09:13.687667+0000","last_fullsized":"2023-11-28T21:09:13.687667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:29.233767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889558+0000","last_change":"2023-11-28T21:09:13.676055+0000","last_active":"2023-11-28T21:09:15.889558+0000","last_peered":"2023-11-28T21:09:15.889558+0000","last_clean":"2023-11-28T21:09:15.889558+0000","last_became_active":"2023-11-28T21:09:13.675785+0000","last_became_peered":"2023-11-28T21:09:13.675785+0000","last_unstale":"2023-11-28T21:09:15.889558+0000","last_undegraded":"2023-11-28T21:09:15.889558+0000","last_fullsized":"2023-11-28T21:09:15.889558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:08.647727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.657209+0000","last_change":"2023-11-28T21:09:12.658797+0000","last_active":"2023-11-28T21:09:13.657209+0000","last_peered":"2023-11-28T21:09:13.657209+0000","last_clean":"2023-11-28T21:09:13.657209+0000","last_became_active":"2023-11-28T21:09:12.658507+0000","last_became_peered":"2023-11-28T21:09:12.658507+0000","last_unstale":"2023-11-28T21:09:13.657209+0000","last_undegraded":"2023-11-28T21:09:13.657209+0000","last_fullsized":"2023-11-28T21:09:13.657209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.752865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889323+0000","last_change":"2023-11-28T21:09:13.668191+0000","last_active":"2023-11-28T21:09:15.889323+0000","last_peered":"2023-11-28T21:09:15.889323+0000","last_clean":"2023-11-28T21:09:15.889323+0000","last_became_active":"2023-11-28T21:09:13.667787+0000","last_became_peered":"2023-11-28T21:09:13.667787+0000","last_unstale":"2023-11-28T21:09:15.889323+0000","last_undegraded":"2023-11-28T21:09:15.889323+0000","last_fullsized":"2023-11-28T21:09:15.889323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:57:38.881223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.688457+0000","last_change":"2023-11-28T21:09:12.642446+0000","last_active":"2023-11-28T21:09:13.688457+0000","last_peered":"2023-11-28T21:09:13.688457+0000","last_clean":"2023-11-28T21:09:13.688457+0000","last_became_active":"2023-11-28T21:09:12.642124+0000","last_became_peered":"2023-11-28T21:09:12.642124+0000","last_unstale":"2023-11-28T21:09:13.688457+0000","last_undegraded":"2023-11-28T21:09:13.688457+0000","last_fullsized":"2023-11-28T21:09:13.688457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:25:57.756173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889498+0000","last_change":"2023-11-28T21:09:13.666241+0000","last_active":"2023-11-28T21:09:15.889498+0000","last_peered":"2023-11-28T21:09:15.889498+0000","last_clean":"2023-11-28T21:09:15.889498+0000","last_became_active":"2023-11-28T21:09:13.665979+0000","last_became_peered":"2023-11-28T21:09:13.665979+0000","last_unstale":"2023-11-28T21:09:15.889498+0000","last_undegraded":"2023-11-28T21:09:15.889498+0000","last_fullsized":"2023-11-28T21:09:15.889498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:06.807618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.650673+0000","last_change":"2023-11-28T21:09:12.647997+0000","last_active":"2023-11-28T21:09:13.650673+0000","last_peered":"2023-11-28T21:09:13.650673+0000","last_clean":"2023-11-28T21:09:13.650673+0000","last_became_active":"2023-11-28T21:09:12.647711+0000","last_became_peered":"2023-11-28T21:09:12.647711+0000","last_unstale":"2023-11-28T21:09:13.650673+0000","last_undegraded":"2023-11-28T21:09:13.650673+0000","last_fullsized":"2023-11-28T21:09:13.650673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:07.636914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889230+0000","last_change":"2023-11-28T21:09:13.659683+0000","last_active":"2023-11-28T21:09:15.889230+0000","last_peered":"2023-11-28T21:09:15.889230+0000","last_clean":"2023-11-28T21:09:15.889230+0000","last_became_active":"2023-11-28T21:09:13.659389+0000","last_became_peered":"2023-11-28T21:09:13.659389+0000","last_unstale":"2023-11-28T21:09:15.889230+0000","last_undegraded":"2023-11-28T21:09:15.889230+0000","last_fullsized":"2023-11-28T21:09:15.889230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:01:11.150251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.655913+0000","last_change":"2023-11-28T21:09:12.640178+0000","last_active":"2023-11-28T21:09:13.655913+0000","last_peered":"2023-11-28T21:09:13.655913+0000","last_clean":"2023-11-28T21:09:13.655913+0000","last_became_active":"2023-11-28T21:09:12.639755+0000","last_became_peered":"2023-11-28T21:09:12.639755+0000","last_unstale":"2023-11-28T21:09:13.655913+0000","last_undegraded":"2023-11-28T21:09:13.655913+0000","last_fullsized":"2023-11-28T21:09:13.655913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:19:49.738021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891120+0000","last_change":"2023-11-28T21:09:13.669785+0000","last_active":"2023-11-28T21:09:15.891120+0000","last_peered":"2023-11-28T21:09:15.891120+0000","last_clean":"2023-11-28T21:09:15.891120+0000","last_became_active":"2023-11-28T21:09:13.669219+0000","last_became_peered":"2023-11-28T21:09:13.669219+0000","last_unstale":"2023-11-28T21:09:15.891120+0000","last_undegraded":"2023-11-28T21:09:15.891120+0000","last_fullsized":"2023-11-28T21:09:15.891120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:48:08.599206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.648665+0000","last_change":"2023-11-28T21:09:12.652318+0000","last_active":"2023-11-28T21:09:13.648665+0000","last_peered":"2023-11-28T21:09:13.648665+0000","last_clean":"2023-11-28T21:09:13.648665+0000","last_became_active":"2023-11-28T21:09:12.651417+0000","last_became_peered":"2023-11-28T21:09:12.651417+0000","last_unstale":"2023-11-28T21:09:13.648665+0000","last_undegraded":"2023-11-28T21:09:13.648665+0000","last_fullsized":"2023-11-28T21:09:13.648665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:31.670556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.889557+0000","last_change":"2023-11-28T21:09:13.665155+0000","last_active":"2023-11-28T21:09:15.889557+0000","last_peered":"2023-11-28T21:09:15.889557+0000","last_clean":"2023-11-28T21:09:15.889557+0000","last_became_active":"2023-11-28T21:09:13.664878+0000","last_became_peered":"2023-11-28T21:09:13.664878+0000","last_unstale":"2023-11-28T21:09:15.889557+0000","last_undegraded":"2023-11-28T21:09:15.889557+0000","last_fullsized":"2023-11-28T21:09:15.889557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:19:50.748834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.689520+0000","last_change":"2023-11-28T21:09:12.648459+0000","last_active":"2023-11-28T21:09:13.689520+0000","last_peered":"2023-11-28T21:09:13.689520+0000","last_clean":"2023-11-28T21:09:13.689520+0000","last_became_active":"2023-11-28T21:09:12.648238+0000","last_became_peered":"2023-11-28T21:09:12.648238+0000","last_unstale":"2023-11-28T21:09:13.689520+0000","last_undegraded":"2023-11-28T21:09:13.689520+0000","last_fullsized":"2023-11-28T21:09:13.689520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:50:05.829863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891887+0000","last_change":"2023-11-28T21:09:13.684224+0000","last_active":"2023-11-28T21:09:15.891887+0000","last_peered":"2023-11-28T21:09:15.891887+0000","last_clean":"2023-11-28T21:09:15.891887+0000","last_became_active":"2023-11-28T21:09:13.681010+0000","last_became_peered":"2023-11-28T21:09:13.681010+0000","last_unstale":"2023-11-28T21:09:15.891887+0000","last_undegraded":"2023-11-28T21:09:15.891887+0000","last_fullsized":"2023-11-28T21:09:15.891887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:36:10.608962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.657523+0000","last_change":"2023-11-28T21:09:12.644229+0000","last_active":"2023-11-28T21:09:14.657523+0000","last_peered":"2023-11-28T21:09:14.657523+0000","last_clean":"2023-11-28T21:09:14.657523+0000","last_became_active":"2023-11-28T21:09:12.643754+0000","last_became_peered":"2023-11-28T21:09:12.643754+0000","last_unstale":"2023-11-28T21:09:14.657523+0000","last_undegraded":"2023-11-28T21:09:14.657523+0000","last_fullsized":"2023-11-28T21:09:14.657523+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:53:25.602316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.657146+0000","last_change":"2023-11-28T21:09:13.684023+0000","last_active":"2023-11-28T21:09:14.657146+0000","last_peered":"2023-11-28T21:09:14.657146+0000","last_clean":"2023-11-28T21:09:14.657146+0000","last_became_active":"2023-11-28T21:09:13.683693+0000","last_became_peered":"2023-11-28T21:09:13.683693+0000","last_unstale":"2023-11-28T21:09:14.657146+0000","last_undegraded":"2023-11-28T21:09:14.657146+0000","last_fullsized":"2023-11-28T21:09:14.657146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:34:52.553510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.677670+0000","last_change":"2023-11-28T21:09:12.652297+0000","last_active":"2023-11-28T21:09:13.677670+0000","last_peered":"2023-11-28T21:09:13.677670+0000","last_clean":"2023-11-28T21:09:13.677670+0000","last_became_active":"2023-11-28T21:09:12.651956+0000","last_became_peered":"2023-11-28T21:09:12.651956+0000","last_unstale":"2023-11-28T21:09:13.677670+0000","last_undegraded":"2023-11-28T21:09:13.677670+0000","last_fullsized":"2023-11-28T21:09:13.677670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:04.376397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660795+0000","last_change":"2023-11-28T21:09:13.660549+0000","last_active":"2023-11-28T21:09:14.660795+0000","last_peered":"2023-11-28T21:09:14.660795+0000","last_clean":"2023-11-28T21:09:14.660795+0000","last_became_active":"2023-11-28T21:09:13.659999+0000","last_became_peered":"2023-11-28T21:09:13.659999+0000","last_unstale":"2023-11-28T21:09:14.660795+0000","last_undegraded":"2023-11-28T21:09:14.660795+0000","last_fullsized":"2023-11-28T21:09:14.660795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:30.244580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.650920+0000","last_change":"2023-11-28T21:09:12.646351+0000","last_active":"2023-11-28T21:09:13.650920+0000","last_peered":"2023-11-28T21:09:13.650920+0000","last_clean":"2023-11-28T21:09:13.650920+0000","last_became_active":"2023-11-28T21:09:12.646053+0000","last_became_peered":"2023-11-28T21:09:12.646053+0000","last_unstale":"2023-11-28T21:09:13.650920+0000","last_undegraded":"2023-11-28T21:09:13.650920+0000","last_fullsized":"2023-11-28T21:09:13.650920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:00:21.201294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.657144+0000","last_change":"2023-11-28T21:09:13.662668+0000","last_active":"2023-11-28T21:09:14.657144+0000","last_peered":"2023-11-28T21:09:14.657144+0000","last_clean":"2023-11-28T21:09:14.657144+0000","last_became_active":"2023-11-28T21:09:13.662391+0000","last_became_peered":"2023-11-28T21:09:13.662391+0000","last_unstale":"2023-11-28T21:09:14.657144+0000","last_undegraded":"2023-11-28T21:09:14.657144+0000","last_fullsized":"2023-11-28T21:09:14.657144+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:04:43.249171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.677225+0000","last_change":"2023-11-28T21:09:12.647939+0000","last_active":"2023-11-28T21:09:13.677225+0000","last_peered":"2023-11-28T21:09:13.677225+0000","last_clean":"2023-11-28T21:09:13.677225+0000","last_became_active":"2023-11-28T21:09:12.647634+0000","last_became_peered":"2023-11-28T21:09:12.647634+0000","last_unstale":"2023-11-28T21:09:13.677225+0000","last_undegraded":"2023-11-28T21:09:13.677225+0000","last_fullsized":"2023-11-28T21:09:13.677225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:01:52.212158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.835334+0000","last_change":"2023-11-28T21:09:13.664473+0000","last_active":"2023-11-28T21:09:14.835334+0000","last_peered":"2023-11-28T21:09:14.835334+0000","last_clean":"2023-11-28T21:09:14.835334+0000","last_became_active":"2023-11-28T21:09:13.662153+0000","last_became_peered":"2023-11-28T21:09:13.662153+0000","last_unstale":"2023-11-28T21:09:14.835334+0000","last_undegraded":"2023-11-28T21:09:14.835334+0000","last_fullsized":"2023-11-28T21:09:14.835334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:45:10.064647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.656200+0000","last_change":"2023-11-28T21:09:12.644889+0000","last_active":"2023-11-28T21:09:13.656200+0000","last_peered":"2023-11-28T21:09:13.656200+0000","last_clean":"2023-11-28T21:09:13.656200+0000","last_became_active":"2023-11-28T21:09:12.644463+0000","last_became_peered":"2023-11-28T21:09:12.644463+0000","last_unstale":"2023-11-28T21:09:13.656200+0000","last_undegraded":"2023-11-28T21:09:13.656200+0000","last_fullsized":"2023-11-28T21:09:13.656200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:34:03.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:14.660457+0000","last_change":"2023-11-28T21:09:13.672086+0000","last_active":"2023-11-28T21:09:14.660457+0000","last_peered":"2023-11-28T21:09:14.660457+0000","last_clean":"2023-11-28T21:09:14.660457+0000","last_became_active":"2023-11-28T21:09:13.670058+0000","last_became_peered":"2023-11-28T21:09:13.670058+0000","last_unstale":"2023-11-28T21:09:14.660457+0000","last_undegraded":"2023-11-28T21:09:14.660457+0000","last_fullsized":"2023-11-28T21:09:14.660457+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:18:05.387210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.642768+0000","last_change":"2023-11-28T21:09:12.655138+0000","last_active":"2023-11-28T21:09:13.642768+0000","last_peered":"2023-11-28T21:09:13.642768+0000","last_clean":"2023-11-28T21:09:13.642768+0000","last_became_active":"2023-11-28T21:09:12.651291+0000","last_became_peered":"2023-11-28T21:09:12.651291+0000","last_unstale":"2023-11-28T21:09:13.642768+0000","last_undegraded":"2023-11-28T21:09:13.642768+0000","last_fullsized":"2023-11-28T21:09:13.642768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:09:03.644817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T21:09:15.891320+0000","last_change":"2023-11-28T21:09:13.685933+0000","last_active":"2023-11-28T21:09:15.891320+0000","last_peered":"2023-11-28T21:09:15.891320+0000","last_clean":"2023-11-28T21:09:15.891320+0000","last_became_active":"2023-11-28T21:09:13.684976+0000","last_became_peered":"2023-11-28T21:09:13.684976+0000","last_unstale":"2023-11-28T21:09:15.891320+0000","last_undegraded":"2023-11-28T21:09:15.891320+0000","last_fullsized":"2023-11-28T21:09:15.891320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:12.615310+0000","last_clean_scrub_stamp":"2023-11-28T21:09:12.615310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:09:17.289660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.650709+0000","last_change":"2023-11-28T21:09:12.646304+0000","last_active":"2023-11-28T21:09:13.650709+0000","last_peered":"2023-11-28T21:09:13.650709+0000","last_clean":"2023-11-28T21:09:13.650709+0000","last_became_active":"2023-11-28T21:09:12.645620+0000","last_became_peered":"2023-11-28T21:09:12.645620+0000","last_unstale":"2023-11-28T21:09:13.650709+0000","last_undegraded":"2023-11-28T21:09:13.650709+0000","last_fullsized":"2023-11-28T21:09:13.650709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:09:11.604497+0000","last_clean_scrub_stamp":"2023-11-28T21:09:11.604497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T08:34:03.788470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T21:09:13.659880+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-28T21:09:13.659880+0000","last_peered":"2023-11-28T21:09:13.659880+0000","last_clean":"2023-11-28T21:09:13.659880+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-28T21:09:13.659880+0000","last_undegraded":"2023-11-28T21:09:13.659880+0000","last_fullsized":"2023-11-28T21:09:13.659880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":974848,"data_stored":738347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.72699999999999998}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.745},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":0.79400000000000004}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85299999999999998}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66500000000000004}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.872}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.82799999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.68400000000000005}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.60099999999999998}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.70799999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":148561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.624}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.55200000000000005}]},{"osd":6,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.76600000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":147993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.624}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.68500000000000005}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.73699999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.75800000000000001}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.93200000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.4930000000000003,"5min":4.4930000000000003,"15min":4.4930000000000003},"last":0.47599999999999998}]},{"osd":1,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":6.4770000000000003,"5min":6.4770000000000003,"15min":6.4770000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.63500000000000001}]},{"osd":3,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.0789999999999997,"5min":5.0789999999999997,"15min":5.0789999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":4.9969999999999999,"5min":4.9969999999999999,"15min":4.9969999999999999},"last":0.93799999999999994}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":6.7190000000000003,"5min":6.7190000000000003,"15min":6.7190000000000003},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.86599999999999999}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.7350000000000003,"5min":4.7350000000000003,"15min":4.7350000000000003},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.91400000000000003}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":4.4640000000000004,"5min":4.4640000000000004,"15min":4.4640000000000004},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.7910000000000004,"5min":4.7910000000000004,"15min":4.7910000000000004},"last":0.88400000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542164,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":149523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.31},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":6.8869999999999996,"5min":6.8869999999999996,"15min":6.8869999999999996},"last":0.38800000000000001}]},{"osd":1,"last update":"Tue Nov 28 21:08:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":7.0759999999999996,"5min":7.0759999999999996,"15min":7.0759999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.1269999999999998,"5min":3.1269999999999998,"15min":3.1269999999999998},"last":0.34200000000000003}]},{"osd":2,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":6.9359999999999999,"5min":6.9359999999999999,"15min":6.9359999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.2589999999999999,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.3290000000000002,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.52300000000000002}]},{"osd":5,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.3740000000000001,"5min":3.3740000000000001,"15min":3.3740000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":3.496,"5min":3.496,"15min":3.496},"last":0.66400000000000003}]},{"osd":7,"last update":"Tue Nov 28 21:09:00 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.302,"5min":3.302,"15min":3.302},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.177,"5min":3.177,"15min":3.177},"last":0.54900000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":149523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.48499999999999999}]},{"osd":3,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.95199999999999996}]},{"osd":5,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.86899999999999999}]},{"osd":7,"last update":"Tue Nov 28 21:08:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.91100000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":738257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.623},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.77700000000000002}]},{"osd":4,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.874},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":0.84999999999999998}]},{"osd":6,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue Nov 28 21:08:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T21:09:22.717 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T21:09:22.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T21:09:22.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f548752a640 1 Processor -- start 2023-11-28T21:09:22.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f548752a640 1 -- start start 2023-11-28T21:09:22.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f548752a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54800cbf40 0x7f54800ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f548752a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f548015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f548752a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548015b510 con 0x7f548015e370 2023-11-28T21:09:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f548752a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54800cd730 con 0x7f54800cbf40 2023-11-28T21:09:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f548752a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548013d450 con 0x7f548015e750 2023-11-28T21:09:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f54852c6640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f548015e370 0x7f54800cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:59396/0 (socket says 172.21.15.6:59396) 2023-11-28T21:09:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f54852c6640 1 -- 172.21.15.6:0/3356114705 learned_addr learned my addr 172.21.15.6:0/3356114705 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f5485ac7640 1 --2- 172.21.15.6:0/3356114705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f548015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f5484ac5640 1 --2- 172.21.15.6:0/3356114705 >> v2:172.21.15.31:3300/0 conn(0x7f54800cbf40 0x7f54800ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f5477fff640 1 -- 172.21.15.6:0/3356114705 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994563093 0 0) 0x7f548015b510 con 0x7f548015e370 2023-11-28T21:09:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f5477fff640 1 -- 172.21.15.6:0/3356114705 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f546c003530 con 0x7f548015e370 2023-11-28T21:09:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f5485ac7640 1 -- 172.21.15.6:0/3356114705 >> v2:172.21.15.31:3300/0 conn(0x7f54800cbf40 msgr2=0x7f54800ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f5485ac7640 1 --2- 172.21.15.6:0/3356114705 >> v2:172.21.15.31:3300/0 conn(0x7f54800cbf40 0x7f54800ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f5485ac7640 1 -- 172.21.15.6:0/3356114705 >> v1:172.21.15.31:6789/0 conn(0x7f548015e370 legacy=0x7f54800cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.902+0000 7f5485ac7640 1 -- 172.21.15.6:0/3356114705 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800cd940 con 0x7f548015e750 2023-11-28T21:09:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f5485ac7640 1 --2- 172.21.15.6:0/3356114705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f548015a7e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5478009d90 tx=0x7f547801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aba3b573632f4b23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f5477fff640 1 -- 172.21.15.6:0/3356114705 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54780a5900 con 0x7f548015e750 2023-11-28T21:09:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f5477fff640 1 -- 172.21.15.6:0/3356114705 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54780a5a60 con 0x7f548015e750 2023-11-28T21:09:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f5477fff640 1 -- 172.21.15.6:0/3356114705 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54780a5df0 con 0x7f548015e750 2023-11-28T21:09:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f548752a640 1 -- 172.21.15.6:0/3356114705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 msgr2=0x7f548015a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f548752a640 1 --2- 172.21.15.6:0/3356114705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f548015a7e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5478009d90 tx=0x7f547801c950 comp rx=0 tx=0).stop 2023-11-28T21:09:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f548752a640 1 -- 172.21.15.6:0/3356114705 shutdown_connections 2023-11-28T21:09:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f548752a640 1 --2- 172.21.15.6:0/3356114705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f548015a7e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f548752a640 1 --2- 172.21.15.6:0/3356114705 >> v2:172.21.15.31:3300/0 conn(0x7f54800cbf40 0x7f54800ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f548752a640 1 -- 172.21.15.6:0/3356114705 >> 172.21.15.6:0/3356114705 conn(0x7f548006a980 msgr2=0x7f548006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f548752a640 1 -- 172.21.15.6:0/3356114705 shutdown_connections 2023-11-28T21:09:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.906+0000 7f548752a640 1 -- 172.21.15.6:0/3356114705 wait complete. 2023-11-28T21:09:22.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f548752a640 1 Processor -- start 2023-11-28T21:09:22.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f548752a640 1 -- start start 2023-11-28T21:09:22.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f548752a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800cbf40 0x7f548013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f548752a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f548015e370 0x7f5480133570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f548752a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f54800b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f548752a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5480140370 con 0x7f54800cbf40 2023-11-28T21:09:22.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f548752a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548013fa40 con 0x7f548015e370 2023-11-28T21:09:22.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f548752a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548013fd20 con 0x7f548015e750 2023-11-28T21:09:22.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f54852c6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800cbf40 0x7f548013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f54852c6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800cbf40 0x7f548013c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40212/0 (socket says 172.21.15.6:40212) 2023-11-28T21:09:22.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f54852c6640 1 -- 172.21.15.6:0/3348075983 learned_addr learned my addr 172.21.15.6:0/3348075983 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:22.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f5484ac5640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f548015e370 0x7f5480133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f5485ac7640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f54800b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f54852c6640 1 -- 172.21.15.6:0/3348075983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 msgr2=0x7f54800b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f54852c6640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f54800b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f54852c6640 1 -- 172.21.15.6:0/3348075983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f548015e370 msgr2=0x7f5480133570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f54852c6640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f548015e370 0x7f5480133570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f54852c6640 1 -- 172.21.15.6:0/3348075983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5478009a70 con 0x7f54800cbf40 2023-11-28T21:09:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f5485ac7640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f54800b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f54852c6640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800cbf40 0x7f548013c7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f547c00c4d0 tx=0x7f547c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f5475ffb640 1 -- 172.21.15.6:0/3348075983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c005cf0 con 0x7f54800cbf40 2023-11-28T21:09:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f5475ffb640 1 -- 172.21.15.6:0/3348075983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c005e50 con 0x7f54800cbf40 2023-11-28T21:09:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f5475ffb640 1 -- 172.21.15.6:0/3348075983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c007270 con 0x7f54800cbf40 2023-11-28T21:09:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.910+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5480140000 con 0x7f54800cbf40 2023-11-28T21:09:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.914+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548013f660 con 0x7f54800cbf40 2023-11-28T21:09:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.914+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5480072b90 con 0x7f54800cbf40 2023-11-28T21:09:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.914+0000 7f5475ffb640 1 -- 172.21.15.6:0/3348075983 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f547c0073d0 con 0x7f54800cbf40 2023-11-28T21:09:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.914+0000 7f5475ffb640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5464066470 0x7f5464068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.914+0000 7f5475ffb640 1 -- 172.21.15.6:0/3348075983 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f547c0833d0 con 0x7f54800cbf40 2023-11-28T21:09:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.914+0000 7f5484ac5640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5464066470 0x7f5464068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.914+0000 7f5484ac5640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5464066470 0x7f5464068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f548013c680 tx=0x7f5470009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:22.918+0000 7f5475ffb640 1 -- 172.21.15.6:0/3348075983 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f547c050860 con 0x7f54800cbf40 2023-11-28T21:09:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.134+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f548004e930 con 0x7f54800cbf40 2023-11-28T21:09:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.134+0000 7f5475ffb640 1 -- 172.21.15.6:0/3348075983 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f547c0170b0 con 0x7f54800cbf40 2023-11-28T21:09:23.142 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-11-28T21:09:23.142 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB+VmZlxLImOBAA8izHwHkD3t81GJWncBXtsA== 2023-11-28T21:09:23.142 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-11-28T21:09:23.142 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-11-28T21:09:23.142 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T21:09:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-11-28T21:09:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5464066470 msgr2=0x7f5464068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5464066470 0x7f5464068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f548013c680 tx=0x7f5470009190 comp rx=0 tx=0).stop 2023-11-28T21:09:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800cbf40 msgr2=0x7f548013c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800cbf40 0x7f548013c7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f547c00c4d0 tx=0x7f547c00c990 comp rx=0 tx=0).stop 2023-11-28T21:09:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 shutdown_connections 2023-11-28T21:09:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f5464066470 0x7f5464068930 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f548015e750 0x7f54800b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f548015e370 0x7f5480133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 --2- 172.21.15.6:0/3348075983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800cbf40 0x7f548013c7a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 >> 172.21.15.6:0/3348075983 conn(0x7f548006a980 msgr2=0x7f54800aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 shutdown_connections 2023-11-28T21:09:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.138+0000 7f548752a640 1 -- 172.21.15.6:0/3348075983 wait complete. 2023-11-28T21:09:23.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T21:09:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa950054640 1 Processor -- start 2023-11-28T21:09:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa950054640 1 -- start start 2023-11-28T21:09:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa950054640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa948159750 0x7fa9480b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa950054640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9480b4ab0 con 0x7fa9480733f0 2023-11-28T21:09:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa950054640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94806d3f0 con 0x7fa94815d9b0 2023-11-28T21:09:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa950054640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480cf3b0 con 0x7fa948159750 2023-11-28T21:09:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94d5ef640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa9480733f0 0x7fa94815d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34608/0 (socket says 172.21.15.6:34608) 2023-11-28T21:09:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94d5ef640 1 -- 172.21.15.6:0/1033722491 learned_addr learned my addr 172.21.15.6:0/1033722491 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94ddf0640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa948159750 0x7fa9480b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970712931 0 0) 0x7fa938001120 con 0x7fa9480733f0 2023-11-28T21:09:23.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa934005740 con 0x7fa9480733f0 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3802886664 0 0) 0x7fa934005740 con 0x7fa9480733f0 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa948159750 msgr2=0x7fa9480b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa948159750 0x7fa9480b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 >> v1:172.21.15.31:6789/0 conn(0x7fa94815d9b0 legacy=0x7fa948164610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948159b30 con 0x7fa9480733f0 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fa938001810 con 0x7fa9480733f0 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 >> v1:172.21.15.6:6789/0 conn(0x7fa9480733f0 legacy=0x7fa94815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa934005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934006570 0x7fa934006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa948159750 0x7fa9340072a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480cf3b0 con 0x7fa934005bc0 2023-11-28T21:09:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93400dba0 con 0x7fa934006570 2023-11-28T21:09:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93400dd60 con 0x7fa948159750 2023-11-28T21:09:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94ddf0640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa934005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94d5ef640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934006570 0x7fa934006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94e5f1640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa948159750 0x7fa9340072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94ddf0640 1 -- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa948159750 msgr2=0x7fa9340072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94ddf0640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa948159750 0x7fa9340072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94ddf0640 1 -- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934006570 msgr2=0x7fa934006a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94ddf0640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934006570 0x7fa934006a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94ddf0640 1 -- 172.21.15.6:0/1033722491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa934005740 con 0x7fa934005bc0 2023-11-28T21:09:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94d5ef640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa934006570 0x7fa934006a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.302+0000 7fa94e5f1640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa948159750 0x7fa9340072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa94ddf0640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa934005fa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa944009ae0 tx=0x7fa94401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2af6416072883b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440a5640 con 0x7fa934005bc0 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9440a57a0 con 0x7fa934005bc0 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa94cdee640 1 -- 172.21.15.6:0/1033722491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440a5b50 con 0x7fa934005bc0 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa950054640 1 -- 172.21.15.6:0/1033722491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 msgr2=0x7fa934005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa950054640 1 --2- 172.21.15.6:0/1033722491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa934005fa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa944009ae0 tx=0x7fa94401ca50 comp rx=0 tx=0).stop 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa94e5f1640 1 -- 172.21.15.6:0/1033722491 reap_dead start 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa950054640 1 -- 172.21.15.6:0/1033722491 shutdown_connections 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa950054640 1 -- 172.21.15.6:0/1033722491 >> 172.21.15.6:0/1033722491 conn(0x7fa9480cf7b0 msgr2=0x7fa9480cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa950054640 1 -- 172.21.15.6:0/1033722491 shutdown_connections 2023-11-28T21:09:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.306+0000 7fa950054640 1 -- 172.21.15.6:0/1033722491 wait complete. 2023-11-28T21:09:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 Processor -- start 2023-11-28T21:09:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 -- start start 2023-11-28T21:09:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa94815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa948153190 0x7fa9481520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa94814cc80 0x7fa9481e6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94815a770 con 0x7fa934005bc0 2023-11-28T21:09:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94815b2f0 con 0x7fa948153190 2023-11-28T21:09:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94815a9c0 con 0x7fa94814cc80 2023-11-28T21:09:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa94ddf0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa94815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa94ddf0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa94815b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40224/0 (socket says 172.21.15.6:40224) 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa94ddf0640 1 -- 172.21.15.6:0/4264882824 learned_addr learned my addr 172.21.15.6:0/4264882824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa94ddf0640 1 -- 172.21.15.6:0/4264882824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa94814cc80 msgr2=0x7fa9481e6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa94ddf0640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa94814cc80 0x7fa9481e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa94ddf0640 1 -- 172.21.15.6:0/4264882824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa948153190 msgr2=0x7fa9481520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa94ddf0640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa948153190 0x7fa9481520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa94ddf0640 1 -- 172.21.15.6:0/4264882824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94815aca0 con 0x7fa934005bc0 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa94ddf0640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa94815b780 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa94401c880 tx=0x7fa934007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa93e7fc640 1 -- 172.21.15.6:0/4264882824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440bc070 con 0x7fa934005bc0 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa93e7fc640 1 -- 172.21.15.6:0/4264882824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944004020 con 0x7fa934005bc0 2023-11-28T21:09:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa93e7fc640 1 -- 172.21.15.6:0/4264882824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440a5640 con 0x7fa934005bc0 2023-11-28T21:09:23.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94815af80 con 0x7fa934005bc0 2023-11-28T21:09:23.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.310+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94814d110 con 0x7fa934005bc0 2023-11-28T21:09:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.314+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94814d3c0 con 0x7fa934005bc0 2023-11-28T21:09:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.314+0000 7fa93e7fc640 1 -- 172.21.15.6:0/4264882824 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa9440b4040 con 0x7fa934005bc0 2023-11-28T21:09:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.314+0000 7fa93e7fc640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa92c066470 0x7fa92c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.314+0000 7fa93e7fc640 1 -- 172.21.15.6:0/4264882824 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa94411d7c0 con 0x7fa934005bc0 2023-11-28T21:09:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.314+0000 7fa94d5ef640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa92c066470 0x7fa92c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.314+0000 7fa94d5ef640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa92c066470 0x7fa92c068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa938000f70 tx=0x7fa938001310 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:23.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.318+0000 7fa93e7fc640 1 -- 172.21.15.6:0/4264882824 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa9440ead50 con 0x7fa934005bc0 2023-11-28T21:09:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.506+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9480674d0 con 0x7fa934005bc0 2023-11-28T21:09:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.506+0000 7fa93e7fc640 1 -- 172.21.15.6:0/4264882824 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4901 (secure 0 0 0) 0x7fa9440ee370 con 0x7fa934005bc0 2023-11-28T21:09:23.514 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:23.515 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1525667557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1525667557},{"type":"v1","addr":"172.21.15.31:6834","nonce":1525667557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/71303197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":71303197},{"type":"v1","addr":"172.21.15.31:6835","nonce":71303197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/4130466882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":4130466882},{"type":"v1","addr":"172.21.15.6:6837","nonce":4130466882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:09:13.024455+0000","modified":"2023-11-28T21:09:16.059795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5190":{"gid":5190,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2805255705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2805255705},{"type":"v1","addr":"172.21.15.6:6835","nonce":2805255705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T21:09:23.515 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-11-28T21:09:23.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa92c066470 msgr2=0x7fa92c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:23.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa92c066470 0x7fa92c068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa938000f70 tx=0x7fa938001310 comp rx=0 tx=0).stop 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 msgr2=0x7fa94815b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa94815b780 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa94401c880 tx=0x7fa934007a10 comp rx=0 tx=0).stop 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 shutdown_connections 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fa92c066470 0x7fa92c068930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa94814cc80 0x7fa9481e6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa948153190 0x7fa9481520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 --2- 172.21.15.6:0/4264882824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa934005bc0 0x7fa94815b780 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 >> 172.21.15.6:0/4264882824 conn(0x7fa9480cf7b0 msgr2=0x7fa9480b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 shutdown_connections 2023-11-28T21:09:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:23.510+0000 7fa950054640 1 -- 172.21.15.6:0/4264882824 wait complete. 2023-11-28T21:09:23.937 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T21:09:13.024455+0000', 'modified': '2023-11-28T21:09:16.059795+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5190': {'gid': 5190, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/2805255705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 2805255705}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2805255705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T21:09:23.938 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T21:09:23.938 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T21:09:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba8bb8640 1 Processor -- start 2023-11-28T21:09:24.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba8bb8640 1 -- start start 2023-11-28T21:09:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba8bb8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faba415e370 0x7faba40ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba8bb8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba8bb8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba415b510 con 0x7faba415e750 2023-11-28T21:09:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba8bb8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40cd730 con 0x7faba415e370 2023-11-28T21:09:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba8bb8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba413d450 con 0x7faba40cbf40 2023-11-28T21:09:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faba415e370 0x7faba40ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7fab9bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faba415e750 0x7faba40cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34610/0 (socket says 172.21.15.6:34610) 2023-11-28T21:09:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7fab9bfff640 1 -- 172.21.15.6:0/2319688330 learned_addr learned my addr 172.21.15.6:0/2319688330 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba2d9d640 1 --2- 172.21.15.6:0/2319688330 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba259c640 1 -- 172.21.15.6:0/2319688330 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 msgr2=0x7faba415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba259c640 1 --2- 172.21.15.6:0/2319688330 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba415a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba259c640 1 -- 172.21.15.6:0/2319688330 >> v1:172.21.15.6:6789/0 conn(0x7faba415e750 legacy=0x7faba40cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba259c640 1 -- 172.21.15.6:0/2319688330 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40cd940 con 0x7faba415e370 2023-11-28T21:09:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba1d9b640 1 -- 172.21.15.6:0/2319688330 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268804062 0 0) 0x7faba415b510 con 0x7faba415e750 2023-11-28T21:09:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.082+0000 7faba2d9d640 1 --2- 172.21.15.6:0/2319688330 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba415a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:24.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba259c640 1 --2- 172.21.15.6:0/2319688330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e370 0x7faba40ce700 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fab940097c0 tx=0x7fab9401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69d5e01d09c436 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba1d9b640 1 -- 172.21.15.6:0/2319688330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940ab600 con 0x7faba415e370 2023-11-28T21:09:24.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba1d9b640 1 -- 172.21.15.6:0/2319688330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940a7050 con 0x7faba415e370 2023-11-28T21:09:24.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba1d9b640 1 -- 172.21.15.6:0/2319688330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940ab980 con 0x7faba415e370 2023-11-28T21:09:24.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 -- 172.21.15.6:0/2319688330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e370 msgr2=0x7faba40ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 --2- 172.21.15.6:0/2319688330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e370 0x7faba40ce700 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fab940097c0 tx=0x7fab9401c480 comp rx=0 tx=0).stop 2023-11-28T21:09:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 -- 172.21.15.6:0/2319688330 shutdown_connections 2023-11-28T21:09:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 --2- 172.21.15.6:0/2319688330 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba415a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 --2- 172.21.15.6:0/2319688330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e370 0x7faba40ce700 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 -- 172.21.15.6:0/2319688330 >> 172.21.15.6:0/2319688330 conn(0x7faba406a980 msgr2=0x7faba406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 -- 172.21.15.6:0/2319688330 shutdown_connections 2023-11-28T21:09:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 -- 172.21.15.6:0/2319688330 wait complete. 2023-11-28T21:09:24.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 Processor -- start 2023-11-28T21:09:24.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.086+0000 7faba8bb8640 1 -- start start 2023-11-28T21:09:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba8bb8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba4158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba8bb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faba415e370 0x7faba40b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba8bb8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e750 0x7faba41f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba8bb8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba41f7f60 con 0x7faba415e750 2023-11-28T21:09:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba8bb8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba41f8190 con 0x7faba415e370 2023-11-28T21:09:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba8bb8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba41f8470 con 0x7faba40cbf40 2023-11-28T21:09:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e750 0x7faba41f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e750 0x7faba41f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40244/0 (socket says 172.21.15.6:40244) 2023-11-28T21:09:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba2d9d640 1 -- 172.21.15.6:0/3109720894 learned_addr learned my addr 172.21.15.6:0/3109720894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba259c640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba4158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7fab9bfff640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faba415e370 0x7faba40b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba2d9d640 1 -- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 msgr2=0x7faba4158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba2d9d640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba4158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba2d9d640 1 -- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faba415e370 msgr2=0x7faba40b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba2d9d640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faba415e370 0x7faba40b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba2d9d640 1 -- 172.21.15.6:0/3109720894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94009420 con 0x7faba415e750 2023-11-28T21:09:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba259c640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba4158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7fab9bfff640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faba415e370 0x7faba40b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T21:09:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba2d9d640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e750 0x7faba41f7a20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00cef0 tx=0x7fab9c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7fab9affd640 1 -- 172.21.15.6:0/3109720894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00d840 con 0x7faba415e750 2023-11-28T21:09:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7fab9affd640 1 -- 172.21.15.6:0/3109720894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c00d9c0 con 0x7faba415e750 2023-11-28T21:09:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba8bb8640 1 -- 172.21.15.6:0/3109720894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba41f8750 con 0x7faba415e750 2023-11-28T21:09:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7fab9affd640 1 -- 172.21.15.6:0/3109720894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00dd70 con 0x7faba415e750 2023-11-28T21:09:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.090+0000 7faba8bb8640 1 -- 172.21.15.6:0/3109720894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba413afb0 con 0x7faba415e750 2023-11-28T21:09:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fab9affd640 1 -- 172.21.15.6:0/3109720894 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab9c01e3b0 con 0x7faba415e750 2023-11-28T21:09:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fab9affd640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab84066470 0x7fab84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fab9affd640 1 -- 172.21.15.6:0/3109720894 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab9c0849d0 con 0x7faba415e750 2023-11-28T21:09:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab84066470 0x7fab84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fababf22000 1 Processor -- start 2023-11-28T21:09:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fababf22000 1 -- start start 2023-11-28T21:09:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab84066470 0x7fab84068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab940ad000 tx=0x7fab940a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fababf22000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a2070554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fababf22000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 0x55a2070086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fababf22000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 0x55a207009010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fababf22000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a206e71130 con 0x55a2070550f0 2023-11-28T21:09:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fababf22000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a206e5e9a0 con 0x55a207008c30 2023-11-28T21:09:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fababf22000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a206e5bed0 con 0x55a207055a10 2023-11-28T21:09:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a2070554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a2070554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40250/0 (socket says 172.21.15.6:40250) 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 -- 172.21.15.6:0/1580263991 learned_addr learned my addr 172.21.15.6:0/1580263991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba2d9d640 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 0x55a207009010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7fab9bfff640 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 0x55a2070086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 -- 172.21.15.6:0/1580263991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 msgr2=0x55a2070086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 0x55a2070086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 -- 172.21.15.6:0/1580263991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 msgr2=0x55a207009010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 0x55a207009010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 -- 172.21.15.6:0/1580263991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a206b4f890 con 0x55a2070550f0 2023-11-28T21:09:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba2d9d640 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 0x55a207009010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.094+0000 7faba259c640 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a2070554d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fab9401a0b0 tx=0x7fab94004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f733e77d04941aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab83fff640 1 -- 172.21.15.6:0/1580263991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940ab400 con 0x55a2070550f0 2023-11-28T21:09:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab83fff640 1 -- 172.21.15.6:0/1580263991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940c3650 con 0x55a2070550f0 2023-11-28T21:09:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab83fff640 1 -- 172.21.15.6:0/1580263991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940c39c0 con 0x55a2070550f0 2023-11-28T21:09:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 -- 172.21.15.6:0/1580263991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 msgr2=0x55a2070554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a2070554d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fab9401a0b0 tx=0x7fab94004740 comp rx=0 tx=0).stop 2023-11-28T21:09:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 -- 172.21.15.6:0/1580263991 shutdown_connections 2023-11-28T21:09:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 0x55a207009010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 0x55a2070086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 --2- 172.21.15.6:0/1580263991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a2070554d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 -- 172.21.15.6:0/1580263991 >> 172.21.15.6:0/1580263991 conn(0x55a207035c80 msgr2=0x55a207038070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 -- 172.21.15.6:0/1580263991 shutdown_connections 2023-11-28T21:09:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 -- 172.21.15.6:0/1580263991 wait complete. 2023-11-28T21:09:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 -- start start 2023-11-28T21:09:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 Processor -- start 2023-11-28T21:09:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207008c30 0x55a20703ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a20703b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207055a10 0x55a20703b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a206e577c0 con 0x55a2070550f0 2023-11-28T21:09:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a206e0fbf0 con 0x55a207055a10 2023-11-28T21:09:24.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a206e15a90 con 0x55a207008c30 2023-11-28T21:09:24.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fababf22000 10 client.0 _ll_register_callbacks cb 0x55a206ff23c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T21:09:24.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab9bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a20703b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab9bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a20703b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40260/0 (socket says 172.21.15.6:40260) 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab9bfff640 1 -- 172.21.15.6:0/681093269 learned_addr learned my addr 172.21.15.6:0/681093269 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7faba259c640 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207008c30 0x55a20703ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7faba2d9d640 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207055a10 0x55a20703b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab9bfff640 1 -- 172.21.15.6:0/681093269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207008c30 msgr2=0x55a20703ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab9bfff640 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207008c30 0x55a20703ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab9bfff640 1 -- 172.21.15.6:0/681093269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207055a10 msgr2=0x55a20703b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab9bfff640 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207055a10 0x55a20703b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.098+0000 7fab9bfff640 1 -- 172.21.15.6:0/681093269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba40cd940 con 0x55a2070550f0 2023-11-28T21:09:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab9bfff640 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a20703b190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fab8c005ea0 tx=0x7fab8c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a535184eeccc2a7d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 1 -- 172.21.15.6:0/681093269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0133f0 con 0x55a2070550f0 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 1 -- 172.21.15.6:0/681093269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab8c013550 con 0x55a2070550f0 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 -- 172.21.15.6:0/681093269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a206e19470 con 0x55a2070550f0 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 1 -- 172.21.15.6:0/681093269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab8c013710 con 0x55a2070550f0 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 10 client.5370 fetch_fsmap learned FSMap version 17 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 -- 172.21.15.6:0/681093269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a206e18190 con 0x55a2070550f0 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 1 -- 172.21.15.6:0/681093269 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a206e19470 con 0x55a2070550f0 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 1 -- 172.21.15.6:0/681093269 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fab8c012070 con 0x55a2070550f0 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 10 client.5370 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 10 client.5370 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T21:09:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 20 client.5370 populate_metadata read hostname 'smithi006' 2023-11-28T21:09:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] conn(0x55a2070653a0 0x55a207067790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 4 client.5370 mds_command: new command op to 5190 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T21:09:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 -- 172.21.15.6:0/681093269 --> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a206e1cb50 con 0x55a2070653a0 2023-11-28T21:09:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7faba259c640 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] conn(0x55a2070653a0 0x55a207067790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 10 client.5370 ms_handle_connect on v2:172.21.15.6:6834/2805255705 2023-11-28T21:09:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7faba259c640 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] conn(0x55a2070653a0 0x55a207067790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae042997ee7f8da0 server_cookie=d0e539a42ec4fc2b in_seq=0 out_seq=0 2023-11-28T21:09:24.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 1 -- 172.21.15.6:0/681093269 <== mds.0 v2:172.21.15.6:6834/2805255705 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a206e1cb50 con 0x55a2070653a0 2023-11-28T21:09:24.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 10 client.5370 handle_command_reply: tid=0 2023-11-28T21:09:24.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 client.5370 shutdown 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 -- 172.21.15.6:0/681093269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 msgr2=0x55a20703b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a20703b190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fab8c005ea0 tx=0x7fab8c005f90 comp rx=0 tx=0).stop 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 -- 172.21.15.6:0/681093269 shutdown_connections 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207055a10 0x55a20703b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] conn(0x55a2070653a0 0x55a207067790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2070550f0 0x55a20703b190 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 --2- 172.21.15.6:0/681093269 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207008c30 0x55a20703ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fab817fa640 0 client.5370 ms_handle_reset on v2:172.21.15.6:6834/2805255705 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 -- 172.21.15.6:0/681093269 >> 172.21.15.6:0/681093269 conn(0x55a207035c80 msgr2=0x55a207038070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 -- 172.21.15.6:0/681093269 shutdown_connections 2023-11-28T21:09:24.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 1 -- 172.21.15.6:0/681093269 wait complete. 2023-11-28T21:09:24.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.102+0000 7fababf22000 20 client.5370 trim_cache size 0 max 16384 2023-11-28T21:09:24.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.118+0000 7fababf22000 1 Processor -- start 2023-11-28T21:09:24.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.118+0000 7fababf22000 1 -- start start 2023-11-28T21:09:24.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.118+0000 7fababf22000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207008c30 0x55a207066790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.118+0000 7fababf22000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a2070550f0 0x55a207066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.118+0000 7fababf22000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 0x55a207067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.118+0000 7fababf22000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a206b10940 con 0x55a207008c30 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.118+0000 7fababf22000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a206ffe750 con 0x55a2070550f0 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.118+0000 7fababf22000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a206e13680 con 0x55a207055a10 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207008c30 0x55a207066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207008c30 0x55a207066790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40262/0 (socket says 172.21.15.6:40262) 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba259c640 1 -- 172.21.15.6:0/3079451843 learned_addr learned my addr 172.21.15.6:0/3079451843 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba2d9d640 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 0x55a207067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fab9bfff640 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a2070550f0 0x55a207066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba259c640 1 -- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 msgr2=0x55a207067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba259c640 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 0x55a207067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba259c640 1 -- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a2070550f0 msgr2=0x55a207066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba259c640 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a2070550f0 0x55a207066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba259c640 1 -- 172.21.15.6:0/3079451843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a206dfe490 con 0x55a207008c30 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba2d9d640 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 0x55a207067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fab9bfff640 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a2070550f0 0x55a207066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba259c640 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207008c30 0x55a207066790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fab94008010 tx=0x7fab94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7194960be0757c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fab98ff9640 1 -- 172.21.15.6:0/3079451843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940d2040 con 0x55a207008c30 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fab98ff9640 1 -- 172.21.15.6:0/3079451843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab940c4240 con 0x55a207008c30 2023-11-28T21:09:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fab98ff9640 1 -- 172.21.15.6:0/3079451843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940d7460 con 0x55a207008c30 2023-11-28T21:09:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 -- 172.21.15.6:0/3079451843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207008c30 msgr2=0x55a207066790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207008c30 0x55a207066790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fab94008010 tx=0x7fab94008040 comp rx=0 tx=0).stop 2023-11-28T21:09:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 -- 172.21.15.6:0/3079451843 shutdown_connections 2023-11-28T21:09:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a207055a10 0x55a207067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a2070550f0 0x55a207066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 --2- 172.21.15.6:0/3079451843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207008c30 0x55a207066790 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 -- 172.21.15.6:0/3079451843 >> 172.21.15.6:0/3079451843 conn(0x55a207035c80 msgr2=0x55a2070626e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 -- 172.21.15.6:0/3079451843 shutdown_connections 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 -- 172.21.15.6:0/3079451843 wait complete. 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 -- start start 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 Processor -- start 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 0x55a2070b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a2070550f0 0x55a2070b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207055a10 0x55a207071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a207002fa0 con 0x55a207055a10 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a206b10940 con 0x55a207008c30 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a206e5df30 con 0x55a2070550f0 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7fababf22000 10 client.0 _ll_register_callbacks cb 0x55a206ea5c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.122+0000 7faba2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207055a10 0x55a207071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207055a10 0x55a207071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40264/0 (socket says 172.21.15.6:40264) 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba2d9d640 1 -- 172.21.15.6:0/1460340516 learned_addr learned my addr 172.21.15.6:0/1460340516 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba259c640 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 0x55a2070b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab9bfff640 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a2070550f0 0x55a2070b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba2d9d640 1 -- 172.21.15.6:0/1460340516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a2070550f0 msgr2=0x55a2070b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba2d9d640 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a2070550f0 0x55a2070b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba2d9d640 1 -- 172.21.15.6:0/1460340516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 msgr2=0x55a2070b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba2d9d640 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 0x55a2070b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba2d9d640 1 -- 172.21.15.6:0/1460340516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a206b4f890 con 0x55a207055a10 2023-11-28T21:09:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba2d9d640 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207055a10 0x55a207071210 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fab9c051fe0 tx=0x7fab9c059d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82ad1dde5c8b265 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-11-28T21:09:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 1 -- 172.21.15.6:0/1460340516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c053f90 con 0x55a207055a10 2023-11-28T21:09:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 1 -- 172.21.15.6:0/1460340516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab9c06ec40 con 0x55a207055a10 2023-11-28T21:09:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 -- 172.21.15.6:0/1460340516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a207054a10 con 0x55a207055a10 2023-11-28T21:09:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 1 -- 172.21.15.6:0/1460340516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab9c06ee00 con 0x55a207055a10 2023-11-28T21:09:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 10 client.5376 fetch_fsmap learned FSMap version 17 2023-11-28T21:09:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 -- 172.21.15.6:0/1460340516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a206b4fcc0 con 0x55a207055a10 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 1 -- 172.21.15.6:0/1460340516 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c077030 con 0x55a207055a10 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 1 -- 172.21.15.6:0/1460340516 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fab9c005d20 con 0x55a207055a10 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 10 client.5376 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 10 client.5376 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 20 client.5376 populate_metadata read hostname 'smithi006' 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] conn(0x55a2070bce10 0x55a2070bf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 4 client.5376 mds_command: new command op to 5190 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 -- 172.21.15.6:0/1460340516 --> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a206e56110 con 0x55a2070bce10 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba259c640 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] conn(0x55a2070bce10 0x55a2070bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba259c640 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] conn(0x55a2070bce10 0x55a2070bf200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a3139dbe2d6fc2c server_cookie=cd4300aa1eb8922d in_seq=0 out_seq=0 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 10 client.5376 ms_handle_connect on v2:172.21.15.6:6834/2805255705 2023-11-28T21:09:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 1 -- 172.21.15.6:0/1460340516 <== mds.0 v2:172.21.15.6:6834/2805255705 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a206e56110 con 0x55a2070bce10 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 10 client.5376 handle_command_reply: tid=0 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 client.5376 shutdown 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 -- 172.21.15.6:0/1460340516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207055a10 msgr2=0x55a207071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207055a10 0x55a207071210 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fab9c051fe0 tx=0x7fab9c059d40 comp rx=0 tx=0).stop 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 -- 172.21.15.6:0/1460340516 shutdown_connections 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.6:6834/2805255705,v1:172.21.15.6:6835/2805255705] conn(0x55a2070bce10 0x55a2070bf200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a207055a10 0x55a207071210 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a2070550f0 0x55a2070b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 --2- 172.21.15.6:0/1460340516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a207008c30 0x55a2070b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fab817fa640 0 client.5376 ms_handle_reset on v2:172.21.15.6:6834/2805255705 2023-11-28T21:09:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 -- 172.21.15.6:0/1460340516 >> 172.21.15.6:0/1460340516 conn(0x55a207035c80 msgr2=0x55a207065780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:24.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 -- 172.21.15.6:0/1460340516 shutdown_connections 2023-11-28T21:09:24.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 1 -- 172.21.15.6:0/1460340516 wait complete. 2023-11-28T21:09:24.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7fababf22000 20 client.5376 trim_cache size 0 max 16384 2023-11-28T21:09:24.140 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-28T21:09:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "3f552c97-91e2-4211-95f6-2c2c108871dc", 2023-11-28T21:09:24.140 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5190, 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.49304555, 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 17, 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 34, 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 34, 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 18.383055383999999 2023-11-28T21:09:24.141 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-28T21:09:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 -- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab84066470 msgr2=0x7fab84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab84066470 0x7fab84068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab940ad000 tx=0x7fab940a6000 comp rx=0 tx=0).stop 2023-11-28T21:09:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 -- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e750 msgr2=0x7faba41f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e750 0x7faba41f7a20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00cef0 tx=0x7fab9c00a710 comp rx=0 tx=0).stop 2023-11-28T21:09:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 -- 172.21.15.6:0/3109720894 shutdown_connections 2023-11-28T21:09:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fab84066470 0x7fab84068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faba415e750 0x7faba41f7a20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faba415e370 0x7faba40b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 --2- 172.21.15.6:0/3109720894 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faba40cbf40 0x7faba4158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 -- 172.21.15.6:0/3109720894 >> 172.21.15.6:0/3109720894 conn(0x7faba406a980 msgr2=0x7faba406d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:24.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.126+0000 7faba8bb8640 1 -- 172.21.15.6:0/3109720894 shutdown_connections 2023-11-28T21:09:24.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.130+0000 7faba8bb8640 1 -- 172.21.15.6:0/3109720894 wait complete. 2023-11-28T21:09:24.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T21:09:24.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f34479640 1 Processor -- start 2023-11-28T21:09:24.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f34479640 1 -- start start 2023-11-28T21:09:24.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f34479640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f2c06dd90 0x7f6f2c071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f34479640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f2c15e7d0 0x7f6f2c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f34479640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c15e340 con 0x7f6f2c142da0 2023-11-28T21:09:24.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f34479640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2c15dae0 con 0x7f6f2c15e7d0 2023-11-28T21:09:24.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f34479640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2c0b39b0 con 0x7f6f2c06dd90 2023-11-28T21:09:24.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f32a16640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f2c15e7d0 0x7f6f2c0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f32215640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6f2c142da0 0x7f6f2c06d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34612/0 (socket says 172.21.15.6:34612) 2023-11-28T21:09:24.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f32215640 1 -- 172.21.15.6:0/1218179562 learned_addr learned my addr 172.21.15.6:0/1218179562 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:24.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f31a14640 1 --2- 172.21.15.6:0/1218179562 >> v2:172.21.15.31:3300/0 conn(0x7f6f2c06dd90 0x7f6f2c071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f32a16640 1 -- 172.21.15.6:0/1218179562 >> v2:172.21.15.31:3300/0 conn(0x7f6f2c06dd90 msgr2=0x7f6f2c071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:24.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f32a16640 1 --2- 172.21.15.6:0/1218179562 >> v2:172.21.15.31:3300/0 conn(0x7f6f2c06dd90 0x7f6f2c071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.290+0000 7f6f32a16640 1 -- 172.21.15.6:0/1218179562 >> v1:172.21.15.6:6789/0 conn(0x7f6f2c142da0 legacy=0x7f6f2c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f32a16640 1 -- 172.21.15.6:0/1218179562 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c143440 con 0x7f6f2c15e7d0 2023-11-28T21:09:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f31a14640 1 --2- 172.21.15.6:0/1218179562 >> v2:172.21.15.31:3300/0 conn(0x7f6f2c06dd90 0x7f6f2c071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f32a16640 1 --2- 172.21.15.6:0/1218179562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c15e7d0 0x7f6f2c0b1d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c06e7e0 tx=0x7f6f2401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07681d866b6b867 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f31213640 1 -- 172.21.15.6:0/1218179562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240a59a0 con 0x7f6f2c15e7d0 2023-11-28T21:09:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f31213640 1 -- 172.21.15.6:0/1218179562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f240a5b00 con 0x7f6f2c15e7d0 2023-11-28T21:09:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f31213640 1 -- 172.21.15.6:0/1218179562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240a5e90 con 0x7f6f2c15e7d0 2023-11-28T21:09:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f34479640 1 -- 172.21.15.6:0/1218179562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c15e7d0 msgr2=0x7f6f2c0b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f34479640 1 --2- 172.21.15.6:0/1218179562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c15e7d0 0x7f6f2c0b1d90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c06e7e0 tx=0x7f6f2401c8e0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f34479640 1 -- 172.21.15.6:0/1218179562 shutdown_connections 2023-11-28T21:09:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f34479640 1 --2- 172.21.15.6:0/1218179562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c15e7d0 0x7f6f2c0b1d90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f34479640 1 --2- 172.21.15.6:0/1218179562 >> v2:172.21.15.31:3300/0 conn(0x7f6f2c06dd90 0x7f6f2c071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f34479640 1 -- 172.21.15.6:0/1218179562 >> 172.21.15.6:0/1218179562 conn(0x7f6f2c06ab80 msgr2=0x7f6f2c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.294+0000 7f6f34479640 1 -- 172.21.15.6:0/1218179562 shutdown_connections 2023-11-28T21:09:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f34479640 1 -- 172.21.15.6:0/1218179562 wait complete. 2023-11-28T21:09:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f34479640 1 Processor -- start 2023-11-28T21:09:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f34479640 1 -- start start 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f34479640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c06dd90 0x7f6f2c15aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f34479640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c142da0 0x7f6f2c137930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f34479640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c15e7d0 0x7f6f2c13a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f34479640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c0b0450 con 0x7f6f2c142da0 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f34479640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c15c900 con 0x7f6f2c06dd90 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f34479640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c15cbe0 con 0x7f6f2c15e7d0 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f31a14640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c142da0 0x7f6f2c137930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f31a14640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c142da0 0x7f6f2c137930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40274/0 (socket says 172.21.15.6:40274) 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f31a14640 1 -- 172.21.15.6:0/2725052743 learned_addr learned my addr 172.21.15.6:0/2725052743 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f32215640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c06dd90 0x7f6f2c15aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f32a16640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c15e7d0 0x7f6f2c13a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f31a14640 1 -- 172.21.15.6:0/2725052743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c15e7d0 msgr2=0x7f6f2c13a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f31a14640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c15e7d0 0x7f6f2c13a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f31a14640 1 -- 172.21.15.6:0/2725052743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c06dd90 msgr2=0x7f6f2c15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f31a14640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c06dd90 0x7f6f2c15aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f31a14640 1 -- 172.21.15.6:0/2725052743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24009a70 con 0x7f6f2c142da0 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f32215640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c06dd90 0x7f6f2c15aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.298+0000 7f6f31a14640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c142da0 0x7f6f2c137930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00e810 tx=0x7f6f1c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f22ffd640 1 -- 172.21.15.6:0/2725052743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00c8d0 con 0x7f6f2c142da0 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f22ffd640 1 -- 172.21.15.6:0/2725052743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c00ca30 con 0x7f6f2c142da0 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2c15cec0 con 0x7f6f2c142da0 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f22ffd640 1 -- 172.21.15.6:0/2725052743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00cdc0 con 0x7f6f2c142da0 2023-11-28T21:09:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c137e70 con 0x7f6f2c142da0 2023-11-28T21:09:24.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c0674d0 con 0x7f6f2c142da0 2023-11-28T21:09:24.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f22ffd640 1 -- 172.21.15.6:0/2725052743 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6f1c013410 con 0x7f6f2c142da0 2023-11-28T21:09:24.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f22ffd640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6f100664a0 0x7f6f10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:24.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f22ffd640 1 -- 172.21.15.6:0/2725052743 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f1c083c60 con 0x7f6f2c142da0 2023-11-28T21:09:24.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.302+0000 7f6f32215640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6f100664a0 0x7f6f10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:24.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.306+0000 7f6f32215640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6f100664a0 0x7f6f10068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f28005890 tx=0x7f6f28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:24.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.306+0000 7f6f22ffd640 1 -- 172.21.15.6:0/2725052743 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6f1c0510d0 con 0x7f6f2c142da0 2023-11-28T21:09:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6f2c0cfba0 con 0x7f6f2c142da0 2023-11-28T21:09:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f22ffd640 1 -- 172.21.15.6:0/2725052743 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6f1c009480 con 0x7f6f2c142da0 2023-11-28T21:09:24.517 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T21:09:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6f100664a0 msgr2=0x7f6f10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6f100664a0 0x7f6f10068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f28005890 tx=0x7f6f28009040 comp rx=0 tx=0).stop 2023-11-28T21:09:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c142da0 msgr2=0x7f6f2c137930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c142da0 0x7f6f2c137930 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00e810 tx=0x7f6f1c00ecd0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 shutdown_connections 2023-11-28T21:09:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6f100664a0 0x7f6f10068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6f2c15e7d0 0x7f6f2c13a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c142da0 0x7f6f2c137930 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 --2- 172.21.15.6:0/2725052743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f2c06dd90 0x7f6f2c15aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 >> 172.21.15.6:0/2725052743 conn(0x7f6f2c06ab80 msgr2=0x7f6f2c06c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 shutdown_connections 2023-11-28T21:09:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:24.510+0000 7f6f34479640 1 -- 172.21.15.6:0/2725052743 wait complete. 2023-11-28T21:09:24.538 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T21:09:24.538 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T21:09:24.539 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-11-28T21:09:24.539 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T21:09:24.539 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T21:09:24.539 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T21:09:24.540 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T21:09:24.540 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T21:09:24.540 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T21:09:24.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:24.541 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-11-28T21:09:24.553 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T21:09:24.553 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T21:09:24.553 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T21:09:24.553 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:09:24.553 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-11-28T21:09:24.553 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:09:24.553 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42352sec preferred_lft 42352sec 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-11-28T21:09:24.554 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:e1:03:b3:a2 brd ff:ff:ff:ff:ff:ff 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:09:24.555 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T21:09:24.556 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:09:24.556 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T21:09:24.556 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:09:24.556 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T21:09:24.556 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:09:24.556 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T21:09:24.556 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-11-28T21:09:24.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:24.556 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T21:09:24.617 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-11-28T21:09:24.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:24.620 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-11-28T21:09:24.677 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-11-28T21:09:24.677 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T21:09:24.677 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T21:09:24.677 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T21:09:24.677 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T21:09:24.678 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T21:09:24.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:24.678 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-11-28T21:09:24.678 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-11-28T21:09:24.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T21:09:24.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T21:09:24.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T21:09:24.679 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-11-28T21:09:24.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:24.772 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-11-28T21:09:24.782 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T21:09:24.782 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T21:09:24.783 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T21:09:24.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:24.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-11-28T21:09:24.848 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-28T21:09:24.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:09:24.848 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T21:09:24.899 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T21:09:24.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T21:09:24.899 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T21:09:24.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-11-28T21:09:25.020 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:09:25.072 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2023-11-28T21:09:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2023-11-28T21:09:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2023-11-28T21:09:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T21:09:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T21:09:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T21:09:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T21:09:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2023-11-28T21:09:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:09:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:09:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:09:25.075 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:09:25.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:25.076 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-11-28T21:09:25.134 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-28T21:09:25.134 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-28T21:09:25.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-11-28T21:09:25.201 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2023-11-28T21:09:25.254 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2023-11-28T21:09:25.254 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2023-11-28T21:09:25.254 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2023-11-28T21:09:25.254 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2023-11-28T21:09:25.254 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2023-11-28T21:09:25.254 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/run/lock 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/fs/nfsd 2023-11-28T21:09:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysusers.service 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/run/rpc_pipefs 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T21:09:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:09:25.257 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T21:09:25.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:25.257 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-11-28T21:09:25.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2023-11-28T21:09:25.270+0000 7f8e55fbe580 -1 init, newargv = 0x558be45280f0 newargc=15 2023-11-28T21:09:25.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[47577]: starting ceph client 2023-11-28T21:09:25.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[47577]: starting fuse 2023-11-28T21:09:25.287 INFO:teuthology.orchestra.run.smithi006.stdout:43 2023-11-28T21:09:25.288 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-11-28T21:09:25.288 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-11-28T21:09:25.289 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-11-28T21:09:25.290 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-28T21:09:25.290 DEBUG:teuthology.orchestra.run.smithi006:> 2023-11-28T21:09:25.290 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2023-11-28T21:09:25.290 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-11-28T21:09:25.415 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.47577.asok 2023-11-28T21:09:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-28T21:09:25.426 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47577.asok 2023-11-28T21:09:25.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:25.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47577.asok status 2023-11-28T21:09:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-28T21:09:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-11-28T21:09:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "43dd94c190073cf16cff1e711dd7f5a7b1cbc883", 2023-11-28T21:09:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 18.0.0-7520-g43dd94c1 (43dd94c190073cf16cff1e711dd7f5a7b1cbc883) reef (dev)", 2023-11-28T21:09:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2023-11-28T21:09:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-11-28T21:09:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-28T21:09:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "47577", 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5009, 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5009 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-11-28T21:09:25.610 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 31295787 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 31295787 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.5009 192.168.0.1:0/31295787", 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/31295787", 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-11-28T21:09:25.611 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 17, 2023-11-28T21:09:25.612 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 34, 2023-11-28T21:09:25.612 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-11-28T21:09:25.612 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-11-28T21:09:25.612 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-11-28T21:09:25.612 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-28T21:09:25.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:25.624 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-11-28T21:09:25.624 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-28T21:09:25.635 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-11-28T21:09:25.635 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-28T21:09:25.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:25.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T21:09:25.704 DEBUG:teuthology.orchestra.run.smithi006:> mktemp -d --suffix=xfstests-dev 2023-11-28T21:09:25.762 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.TCCktrMdx7xfstests-dev 2023-11-28T21:09:25.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:25.762 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.TCCktrMdx7xfstests-dev) 2023-11-28T21:09:25.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:25.829 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.TCCktrMdx7xfstests-dev) 2023-11-28T21:09:25.885 INFO:teuthology.orchestra.run.smithi006.stderr:Cloning into '/tmp/tmp.TCCktrMdx7xfstests-dev'... 2023-11-28T21:09:26.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:26.761 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-28T21:09:26.821 DEBUG:teuthology.orchestra.run.smithi006:> mktemp -d --suffix=test 2023-11-28T21:09:26.871 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.Vq8HeyZOWwtest 2023-11-28T21:09:26.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:09:26.872 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-28T21:09:26.926 DEBUG:teuthology.orchestra.run.smithi006:> mktemp -d --suffix=scratch 2023-11-28T21:09:26.981 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.Hs8VCeqGxcscratch 2023-11-28T21:09:26.982 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-11-28T21:09:26.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev 2023-11-28T21:09:27.103 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2023-11-28T21:09:27.277 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2023-11-28T21:09:27.278 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2023-11-28T21:09:27.436 INFO:teuthology.orchestra.run.smithi006.stdout:acl is already the newest version (2.3.1-1). 2023-11-28T21:09:27.436 INFO:teuthology.orchestra.run.smithi006.stdout:acl set to manually installed. 2023-11-28T21:09:27.436 INFO:teuthology.orchestra.run.smithi006.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-11-28T21:09:27.436 INFO:teuthology.orchestra.run.smithi006.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-11-28T21:09:27.436 INFO:teuthology.orchestra.run.smithi006.stdout:bc is already the newest version (1.07.1-3build1). 2023-11-28T21:09:27.436 INFO:teuthology.orchestra.run.smithi006.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-11-28T21:09:27.436 INFO:teuthology.orchestra.run.smithi006.stdout:gcc set to manually installed. 2023-11-28T21:09:27.436 INFO:teuthology.orchestra.run.smithi006.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:libtool is already the newest version (2.4.6-15build2). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:make is already the newest version (4.3-4.1build1). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:make set to manually installed. 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:psmisc is already the newest version (23.4-2build3). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:quota is already the newest version (4.06-1build2). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:sed is already the newest version (4.8-1ubuntu2). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2023-11-28T21:09:27.437 INFO:teuthology.orchestra.run.smithi006.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout:dbench is already the newest version (4.0-2build1). 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout:dump is already the newest version (0.4b47-3). 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout:python3 is already the newest version (3.10.6-1~22.04). 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2023-11-28T21:09:27.438 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2023-11-28T21:09:27.439 INFO:teuthology.orchestra.run.smithi006.stdout: python2.7 python2.7-dev python2.7-minimal 2023-11-28T21:09:27.439 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T21:09:27.439 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2023-11-28T21:09:27.439 INFO:teuthology.orchestra.run.smithi006.stdout: libcap2 libcmap4 libcorosync-common4 libdlm3 libpmemblk1 libqb100 2023-11-28T21:09:27.439 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2023-11-28T21:09:27.440 INFO:teuthology.orchestra.run.smithi006.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc dvd+rw-tools udfclient 2023-11-28T21:09:27.481 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2023-11-28T21:09:27.481 INFO:teuthology.orchestra.run.smithi006.stdout: exfatprogs f2fs-tools fio libcap-dev libcmap4 libcorosync-common4 libdlm3 2023-11-28T21:09:27.482 INFO:teuthology.orchestra.run.smithi006.stdout: libgdbm-dev libpmemblk1 libqb100 liburing-dev ocfs2-tools sqlite3 udftools 2023-11-28T21:09:27.482 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2023-11-28T21:09:27.483 INFO:teuthology.orchestra.run.smithi006.stdout: gawk libcap2 2023-11-28T21:09:27.565 INFO:teuthology.orchestra.run.smithi006.stdout:2 upgraded, 14 newly installed, 0 to remove and 261 not upgraded. 2023-11-28T21:09:27.566 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 6,641 kB of archives. 2023-11-28T21:09:27.566 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 14.2 MB of additional disk space will be used. 2023-11-28T21:09:27.566 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2023-11-28T21:09:27.695 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2023-11-28T21:09:27.695 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2023-11-28T21:09:27.697 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2023-11-28T21:09:27.698 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2023-11-28T21:09:27.698 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2023-11-28T21:09:27.725 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2023-11-28T21:09:27.725 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2023-11-28T21:09:27.725 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2023-11-28T21:09:27.731 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-11-28T21:09:27.733 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-11-28T21:09:27.782 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2023-11-28T21:09:27.782 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-11-28T21:09:27.783 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2023-11-28T21:09:27.784 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-11-28T21:09:27.791 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2023-11-28T21:09:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:debconf: unable to initialize frontend: Dialog 2023-11-28T21:09:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-28T21:09:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:debconf: falling back to frontend: Readline 2023-11-28T21:09:28.135 INFO:teuthology.orchestra.run.smithi006.stderr:debconf: unable to initialize frontend: Readline 2023-11-28T21:09:28.135 INFO:teuthology.orchestra.run.smithi006.stderr:debconf: (This frontend requires a controlling tty.) 2023-11-28T21:09:28.135 INFO:teuthology.orchestra.run.smithi006.stderr:debconf: falling back to frontend: Teletype 2023-11-28T21:09:28.142 INFO:teuthology.orchestra.run.smithi006.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-11-28T21:09:28.181 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 6,641 kB in 0s (22.0 MB/s) 2023-11-28T21:09:28.533 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143366 files and directories currently installed.) 2023-11-28T21:09:28.537 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../0-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2023-11-28T21:09:28.679 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2023-11-28T21:09:29.206 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2023-11-28T21:09:29.222 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../1-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-28T21:09:29.307 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T21:09:29.619 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqb100:amd64. 2023-11-28T21:09:29.634 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../2-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2023-11-28T21:09:29.677 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-28T21:09:30.022 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcmap4:amd64. 2023-11-28T21:09:30.038 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../3-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-28T21:09:30.080 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T21:09:30.434 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libdlm3:amd64. 2023-11-28T21:09:30.449 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../4-libdlm3_4.1.1-1build1_amd64.deb ... 2023-11-28T21:09:30.493 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2023-11-28T21:09:30.896 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ocfs2-tools. 2023-11-28T21:09:30.914 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../5-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2023-11-28T21:09:30.954 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2023-11-28T21:09:31.492 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../6-libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:09:31.644 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2023-11-28T21:09:31.978 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-28T21:09:32.311 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package exfatprogs. 2023-11-28T21:09:32.394 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143440 files and directories currently installed.) 2023-11-28T21:09:32.398 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../0-exfatprogs_1.1.3-1_amd64.deb ... 2023-11-28T21:09:32.443 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking exfatprogs (1.1.3-1) ... 2023-11-28T21:09:32.730 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package f2fs-tools. 2023-11-28T21:09:32.746 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../1-f2fs-tools_1.14.0-2build1_amd64.deb ... 2023-11-28T21:09:32.839 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2023-11-28T21:09:33.227 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-11-28T21:09:33.234 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../2-libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-11-28T21:09:33.268 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-28T21:09:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package fio. 2023-11-28T21:09:33.621 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../3-fio_3.28-1_amd64.deb ... 2023-11-28T21:09:33.662 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking fio (3.28-1) ... 2023-11-28T21:09:34.092 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcap-dev:amd64. 2023-11-28T21:09:34.107 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../4-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T21:09:34.150 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-28T21:09:34.414 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-11-28T21:09:34.430 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../5-libgdbm-dev_1.23-1_amd64.deb ... 2023-11-28T21:09:34.472 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-11-28T21:09:34.792 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liburing-dev:amd64. 2023-11-28T21:09:34.809 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../6-liburing-dev_2.1-2build1_amd64.deb ... 2023-11-28T21:09:34.842 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2023-11-28T21:09:35.104 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package sqlite3. 2023-11-28T21:09:35.120 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../7-sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-11-28T21:09:35.162 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-28T21:09:35.540 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package udftools. 2023-11-28T21:09:35.557 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../8-udftools_2.3-1_amd64.deb ... 2023-11-28T21:09:35.638 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking udftools (2.3-1) ... 2023-11-28T21:09:35.942 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up exfatprogs (1.1.3-1) ... 2023-11-28T21:09:36.070 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2023-11-28T21:09:36.323 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2023-11-28T21:09:36.493 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-28T21:09:36.600 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T21:09:36.718 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-28T21:09:36.844 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up udftools (2.3-1) ... 2023-11-28T21:09:37.003 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2023-11-28T21:09:37.129 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-11-28T21:09:37.255 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-28T21:09:37.407 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-28T21:09:37.533 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2023-11-28T21:09:37.642 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T21:09:37.768 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up fio (3.28-1) ... 2023-11-28T21:09:38.171 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:38.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:38.471 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2023-11-28T21:09:38.746 INFO:teuthology.orchestra.run.smithi006.stdout:debconf: unable to initialize frontend: Dialog 2023-11-28T21:09:38.746 INFO:teuthology.orchestra.run.smithi006.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-28T21:09:38.747 INFO:teuthology.orchestra.run.smithi006.stdout:debconf: falling back to frontend: Readline 2023-11-28T21:09:39.841 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2023-11-28T21:09:39.947 INFO:teuthology.orchestra.run.smithi006.stdout:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T21:09:54.704 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T21:09:54.855 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T21:09:56.267 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T21:09:56.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo useradd -m fsgqa 2023-11-28T21:09:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:useradd: user 'fsgqa' already exists 2023-11-28T21:09:56.870 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-28T21:09:56.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo groupadd fsgqa 2023-11-28T21:09:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:groupadd: group 'fsgqa' already exists 2023-11-28T21:09:56.939 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-28T21:09:56.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo useradd fsgqa2 2023-11-28T21:09:57.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo useradd 123456-fsgqa 2023-11-28T21:09:57.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-28T21:09:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbc2d2a640 1 Processor -- start 2023-11-28T21:09:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbc2d2a640 1 -- start start 2023-11-28T21:09:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbc2d2a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdbbc142da0 0x7fdbbc071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbc2d2a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc15e340 con 0x7fdbbc15e7d0 2023-11-28T21:09:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbc2d2a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc0b39b0 con 0x7fdbbc06dd90 2023-11-28T21:09:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbc2d2a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc15dae0 con 0x7fdbbc142da0 2023-11-28T21:09:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbbbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdbbc15e7d0 0x7fdbbc06d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38732/0 (socket says 172.21.15.6:38732) 2023-11-28T21:09:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbbbfff640 1 -- 172.21.15.6:0/642204239 learned_addr learned my addr 172.21.15.6:0/642204239 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbc0ac6640 1 --2- 172.21.15.6:0/642204239 >> v2:172.21.15.31:3300/0 conn(0x7fdbbc142da0 0x7fdbbc071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700449126 0 0) 0x7fdbbc15e340 con 0x7fdbbc15e7d0 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.962+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbac003530 con 0x7fdbbc15e7d0 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2699441947 0 0) 0x7fdbac003530 con 0x7fdbbc15e7d0 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 >> v2:172.21.15.31:3300/0 conn(0x7fdbbc142da0 msgr2=0x7fdbbc071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 --2- 172.21.15.6:0/642204239 >> v2:172.21.15.31:3300/0 conn(0x7fdbbc142da0 0x7fdbbc071fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 >> v1:172.21.15.31:6789/0 conn(0x7fdbbc06dd90 legacy=0x7fdbbc0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc143440 con 0x7fdbbc15e7d0 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fdba8001680 con 0x7fdbbc15e7d0 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 >> v1:172.21.15.6:6789/0 conn(0x7fdbbc15e7d0 legacy=0x7fdbbc06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:57.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbac0039d0 0x7fdbac003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbac005190 0x7fdbac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc15dae0 con 0x7fdbac0047d0 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac00c090 con 0x7fdbac0039d0 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac00c250 con 0x7fdbac005190 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbbfff640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbc0ac6640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbac0039d0 0x7fdbac003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbc12c7640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbac005190 0x7fdbac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbbfff640 1 -- 172.21.15.6:0/642204239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbac005190 msgr2=0x7fdbac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbbfff640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbac005190 0x7fdbac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbbfff640 1 -- 172.21.15.6:0/642204239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbac0039d0 msgr2=0x7fdbac003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T21:09:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbbfff640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbac0039d0 0x7fdbac003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbbfff640 1 -- 172.21.15.6:0/642204239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac003530 con 0x7fdbac0047d0 2023-11-28T21:09:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbc12c7640 1 -- 172.21.15.6:0/642204239 reap_dead start 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.966+0000 7fdbbbfff640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbac004c50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdba8007c10 tx=0x7fdba80214e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359968397eae4766 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8005ae0 con 0x7fdbac0047d0 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba80ad070 con 0x7fdbac0047d0 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbbb7fe640 1 -- 172.21.15.6:0/642204239 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8007070 con 0x7fdbac0047d0 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/642204239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 msgr2=0x7fdbac004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbac004c50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdba8007c10 tx=0x7fdba80214e0 comp rx=0 tx=0).stop 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/642204239 shutdown_connections 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 --2- 172.21.15.6:0/642204239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbac004c50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/642204239 >> 172.21.15.6:0/642204239 conn(0x7fdbbc06ab80 msgr2=0x7fdbbc0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/642204239 shutdown_connections 2023-11-28T21:09:57.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/642204239 wait complete. 2023-11-28T21:09:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 Processor -- start 2023-11-28T21:09:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 -- start start 2023-11-28T21:09:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbbc13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc0abef0 0x7fdbbc13dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbbc0a9ed0 0x7fdbbc0aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc13ed10 con 0x7fdbac0047d0 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0aa890 con 0x7fdbbc0abef0 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc2d2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0cce10 con 0x7fdbbc0a9ed0 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.970+0000 7fdbc0ac6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbbc13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc0ac6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbbc13e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60840/0 (socket says 172.21.15.6:60840) 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc0ac6640 1 -- 172.21.15.6:0/791472067 learned_addr learned my addr 172.21.15.6:0/791472067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbbbfff640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc0abef0 0x7fdbbc13dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc12c7640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbbc0a9ed0 0x7fdbbc0aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc0ac6640 1 -- 172.21.15.6:0/791472067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbbc0a9ed0 msgr2=0x7fdbbc0aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc0ac6640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbbc0a9ed0 0x7fdbbc0aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc0ac6640 1 -- 172.21.15.6:0/791472067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc0abef0 msgr2=0x7fdbbc13dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc0ac6640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc0abef0 0x7fdbbc13dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc0ac6640 1 -- 172.21.15.6:0/791472067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc13e220 con 0x7fdbac0047d0 2023-11-28T21:09:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbbbfff640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc0abef0 0x7fdbbc13dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T21:09:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc0ac6640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbbc13e410 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0011aa0 tx=0x7fdbb0011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbb97fa640 1 -- 172.21.15.6:0/791472067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000fb80 con 0x7fdbac0047d0 2023-11-28T21:09:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbb97fa640 1 -- 172.21.15.6:0/791472067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb000fce0 con 0x7fdbac0047d0 2023-11-28T21:09:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbb97fa640 1 -- 172.21.15.6:0/791472067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0014680 con 0x7fdbac0047d0 2023-11-28T21:09:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc0cc500 con 0x7fdbac0047d0 2023-11-28T21:09:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc0cc7c0 con 0x7fdbac0047d0 2023-11-28T21:09:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc0674d0 con 0x7fdbac0047d0 2023-11-28T21:09:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.974+0000 7fdbb97fa640 1 -- 172.21.15.6:0/791472067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdbb00147e0 con 0x7fdbac0047d0 2023-11-28T21:09:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.978+0000 7fdbb97fa640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba0066470 0x7fdba0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.978+0000 7fdbb97fa640 1 -- 172.21.15.6:0/791472067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbb0084810 con 0x7fdbac0047d0 2023-11-28T21:09:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.978+0000 7fdbbbfff640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba0066470 0x7fdba0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.978+0000 7fdbbbfff640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba0066470 0x7fdba0068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdba80b1000 tx=0x7fdba80ac000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:57.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:57.982+0000 7fdbb97fa640 1 -- 172.21.15.6:0/791472067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbb0051c80 con 0x7fdbac0047d0 2023-11-28T21:09:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.194+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdbbc0b3010 con 0x7fdbac0047d0 2023-11-28T21:09:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.194+0000 7fdbb97fa640 1 -- 172.21.15.6:0/791472067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1264 (secure 0 0 0) 0x7fdbb0022090 con 0x7fdbac0047d0 2023-11-28T21:09:58.198 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:09:58.198 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","modified":"2023-11-28T21:07:09.803828Z","created":"2023-11-28T21:07:09.803828Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3301","nonce":0},{"type":"v1","addr":"172.21.15.31:6790","nonce":0}]},"addr":"172.21.15.31:6790/0","public_addr":"172.21.15.31:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-28T21:09:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:dumped monmap epoch 1 2023-11-28T21:09:58.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba0066470 msgr2=0x7fdba0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba0066470 0x7fdba0068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdba80b1000 tx=0x7fdba80ac000 comp rx=0 tx=0).stop 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 msgr2=0x7fdbbc13e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbbc13e410 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0011aa0 tx=0x7fdbb0011f60 comp rx=0 tx=0).stop 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 shutdown_connections 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fdba0066470 0x7fdba0068930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdbbc0a9ed0 0x7fdbbc0aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc0abef0 0x7fdbbc13dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 --2- 172.21.15.6:0/791472067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbac0047d0 0x7fdbbc13e410 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 >> 172.21.15.6:0/791472067 conn(0x7fdbbc06ab80 msgr2=0x7fdbbc142390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 shutdown_connections 2023-11-28T21:09:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.198+0000 7fdbc2d2a640 1 -- 172.21.15.6:0/791472067 wait complete. 2023-11-28T21:09:58.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-11-28T21:09:58.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.362+0000 7f17d8faa640 1 Processor -- start 2023-11-28T21:09:58.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.362+0000 7f17d8faa640 1 -- start start 2023-11-28T21:09:58.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.362+0000 7f17d8faa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17d415e750 0x7f17d415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:58.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.362+0000 7f17d8faa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d415b510 con 0x7f17d415e370 2023-11-28T21:09:58.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.362+0000 7f17d8faa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40cd940 con 0x7f17d40cbf40 2023-11-28T21:09:58.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.362+0000 7f17d8faa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d40cd730 con 0x7f17d415e750 2023-11-28T21:09:58.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f17d415e370 0x7f17d40cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36246/0 (socket says 172.21.15.6:36246) 2023-11-28T21:09:58.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d259c640 1 -- 172.21.15.6:0/2350120366 learned_addr learned my addr 172.21.15.6:0/2350120366 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-28T21:09:58.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d2d9d640 1 --2- 172.21.15.6:0/2350120366 >> v2:172.21.15.6:3300/0 conn(0x7f17d415e750 0x7f17d415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:58.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d1d9b640 1 -- 172.21.15.6:0/2350120366 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035290365 0 0) 0x7f17d415b510 con 0x7f17d415e370 2023-11-28T21:09:58.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d1d9b640 1 -- 172.21.15.6:0/2350120366 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c0005740 con 0x7f17d415e370 2023-11-28T21:09:58.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d2d9d640 1 -- 172.21.15.6:0/2350120366 >> v1:172.21.15.31:6789/0 conn(0x7f17d40cbf40 legacy=0x7f17d415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:58.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d2d9d640 1 -- 172.21.15.6:0/2350120366 >> v1:172.21.15.6:6789/0 conn(0x7f17d415e370 legacy=0x7f17d40cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d2d9d640 1 -- 172.21.15.6:0/2350120366 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40cdc20 con 0x7f17d415e750 2023-11-28T21:09:58.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d2d9d640 1 --2- 172.21.15.6:0/2350120366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d415e750 0x7f17d415aef0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009d90 tx=0x7f17cc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d0c4d7e514da65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:58.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d1d9b640 1 -- 172.21.15.6:0/2350120366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0a5900 con 0x7f17d415e750 2023-11-28T21:09:58.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d1d9b640 1 -- 172.21.15.6:0/2350120366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc0a5a60 con 0x7f17d415e750 2023-11-28T21:09:58.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.366+0000 7f17d1d9b640 1 -- 172.21.15.6:0/2350120366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0a5df0 con 0x7f17d415e750 2023-11-28T21:09:58.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 -- 172.21.15.6:0/2350120366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d415e750 msgr2=0x7f17d415aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:58.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 --2- 172.21.15.6:0/2350120366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d415e750 0x7f17d415aef0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009d90 tx=0x7f17cc01c950 comp rx=0 tx=0).stop 2023-11-28T21:09:58.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 -- 172.21.15.6:0/2350120366 shutdown_connections 2023-11-28T21:09:58.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 --2- 172.21.15.6:0/2350120366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d415e750 0x7f17d415aef0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 -- 172.21.15.6:0/2350120366 >> 172.21.15.6:0/2350120366 conn(0x7f17d406a980 msgr2=0x7f17d406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:58.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 -- 172.21.15.6:0/2350120366 shutdown_connections 2023-11-28T21:09:58.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 -- 172.21.15.6:0/2350120366 wait complete. 2023-11-28T21:09:58.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 Processor -- start 2023-11-28T21:09:58.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 -- start start 2023-11-28T21:09:58.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d40cbf40 0x7f17d41538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:58.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d415e370 0x7f17d40ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:58.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17d415e750 0x7f17d40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:58.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40a8c90 con 0x7f17d40cbf40 2023-11-28T21:09:58.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40a9ab0 con 0x7f17d415e370 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d8faa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40a8ea0 con 0x7f17d415e750 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d40cbf40 0x7f17d41538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d40cbf40 0x7f17d41538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50448/0 (socket says 172.21.15.6:50448) 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.370+0000 7f17d259c640 1 -- 172.21.15.6:0/1653701792 learned_addr learned my addr 172.21.15.6:0/1653701792 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17d259c640 1 -- 172.21.15.6:0/1653701792 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17d415e750 msgr2=0x7f17d40adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17d259c640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17d415e750 0x7f17d40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17d259c640 1 -- 172.21.15.6:0/1653701792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d415e370 msgr2=0x7f17d40ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17d259c640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d415e370 0x7f17d40ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17d259c640 1 -- 172.21.15.6:0/1653701792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc009a70 con 0x7f17d40cbf40 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17d259c640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d40cbf40 0x7f17d41538a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c4d0 tx=0x7f17c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17caffd640 1 -- 172.21.15.6:0/1653701792 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4005cf0 con 0x7f17d40cbf40 2023-11-28T21:09:58.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17caffd640 1 -- 172.21.15.6:0/1653701792 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c4005e50 con 0x7f17d40cbf40 2023-11-28T21:09:58.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17caffd640 1 -- 172.21.15.6:0/1653701792 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4007270 con 0x7f17d40cbf40 2023-11-28T21:09:58.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d40a9180 con 0x7f17d40cbf40 2023-11-28T21:09:58.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d40a9740 con 0x7f17d40cbf40 2023-11-28T21:09:58.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d40a9900 con 0x7f17d40cbf40 2023-11-28T21:09:58.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17caffd640 1 -- 172.21.15.6:0/1653701792 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17c40073d0 con 0x7f17d40cbf40 2023-11-28T21:09:58.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17caffd640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f17b4066470 0x7f17b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T21:09:58.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17caffd640 1 -- 172.21.15.6:0/1653701792 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17c4083440 con 0x7f17d40cbf40 2023-11-28T21:09:58.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.374+0000 7f17cbfff640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f17b4066470 0x7f17b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T21:09:58.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.378+0000 7f17cbfff640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f17b4066470 0x7f17b4068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000f70 tx=0x7f17bc0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T21:09:58.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.378+0000 7f17caffd640 1 -- 172.21.15.6:0/1653701792 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17c40508d0 con 0x7f17d40cbf40 2023-11-28T21:09:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f17d4072b90 con 0x7f17d40cbf40 2023-11-28T21:09:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17caffd640 1 -- 172.21.15.6:0/1653701792 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) v1 ==== 82+0+151 (secure 0 0 0) 0x7f17c40170b0 con 0x7f17d40cbf40 2023-11-28T21:09:58.604 INFO:teuthology.orchestra.run.smithi006.stdout:[client.admin] 2023-11-28T21:09:58.605 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB+VmZlq5+DAhAAEKmYEYdkGfkA8W6HkmR4GA== 2023-11-28T21:09:58.605 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow *" 2023-11-28T21:09:58.605 INFO:teuthology.orchestra.run.smithi006.stdout: caps mgr = "allow *" 2023-11-28T21:09:58.605 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow *" 2023-11-28T21:09:58.605 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow *" 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f17b4066470 msgr2=0x7f17b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f17b4066470 0x7f17b4068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000f70 tx=0x7f17bc0079c0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d40cbf40 msgr2=0x7f17d41538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d40cbf40 0x7f17d41538a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c4d0 tx=0x7f17c400c990 comp rx=0 tx=0).stop 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 shutdown_connections 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f17b4066470 0x7f17b4068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17d415e750 0x7f17d40adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17d415e370 0x7f17d40ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 --2- 172.21.15.6:0/1653701792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d40cbf40 0x7f17d41538a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T21:09:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 >> 172.21.15.6:0/1653701792 conn(0x7f17d406a980 msgr2=0x7f17d415c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T21:09:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 shutdown_connections 2023-11-28T21:09:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-28T21:09:58.602+0000 7f17d8faa640 1 -- 172.21.15.6:0/1653701792 wait complete. 2023-11-28T21:09:58.626 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-11-28T21:09:58.637 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.MXbzLnvVsq 2023-11-28T21:09:58.638 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:09:58.638 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/tmp/tmp.MXbzLnvVsq 2023-11-28T21:09:58.687 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:09:58.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/tmp/tmp.TCCktrMdx7xfstests-dev/local.config 2023-11-28T21:09:58.751 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.Vq8HeyZOWwtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.Hs8VCeqGxcscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.6:6789 -k /tmp/tmp.MXbzLnvVsq --client_mountpoint /test" 2023-11-28T21:09:58.751 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-28T21:09:58.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/tmp/tmp.TCCktrMdx7xfstests-dev/ceph.exclude 2023-11-28T21:09:58.819 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo make) 2023-11-28T21:09:58.887 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize -cfi 2023-11-28T21:09:59.227 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-28T21:09:59.227 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file './config.guess' 2023-11-28T21:09:59.237 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file './config.sub' 2023-11-28T21:09:59.253 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file './install-sh' 2023-11-28T21:09:59.264 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file './ltmain.sh' 2023-11-28T21:09:59.309 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-28T21:09:59.309 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-28T21:09:59.328 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-28T21:09:59.339 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-28T21:09:59.349 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-28T21:09:59.359 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-28T21:09:59.370 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-28T21:09:59.372 INFO:teuthology.orchestra.run.smithi006.stdout:cp include/install-sh . 2023-11-28T21:09:59.374 INFO:teuthology.orchestra.run.smithi006.stdout:aclocal -I m4 2023-11-28T21:10:00.466 INFO:teuthology.orchestra.run.smithi006.stdout:autoheader 2023-11-28T21:10:09.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:autoconf 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:./configure \ 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout: --libexecdir=/usr/lib \ 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout: --exec_prefix=/var/lib 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to print strings... printf 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc... gcc 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether the C compiler works... yes 2023-11-28T21:10:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:checking for C compiler default output file name... a.out 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking for suffix of executables... 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether we are cross compiling... no 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking for suffix of object files... o 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether the compiler supports GNU C... yes 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether gcc accepts -g... yes 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc option to enable C11 features... none needed 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking for egrep... /usr/bin/grep -E 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-28T21:10:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether ln -s works... yes 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking the maximum length of command line arguments... 1572864 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for objdump... objdump 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to recognize dependent libraries... pass_all 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for dlltool... no 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for ar... ar 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for archiver @FILE support... @ 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for strip... strip 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for ranlib... ranlib 2023-11-28T21:10:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gawk... gawk 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sysroot... no 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for a working dd... /usr/bin/dd 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for mt... mt 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking if mt is a manifest tool... no 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for stdio.h... yes 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for stdlib.h... yes 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for string.h... yes 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for inttypes.h... yes 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for stdint.h... yes 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for strings.h... yes 2023-11-28T21:10:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/stat.h... yes 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/types.h... yes 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking for unistd.h... yes 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking for dlfcn.h... yes 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking for objdir... .libs 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc static flag -static works... yes 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc supports -c -o file.o... yes 2023-11-28T21:10:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-28T21:10:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-28T21:10:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether -lc should be explicitly linked in... no 2023-11-28T21:10:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-28T21:10:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to hardcode library paths into programs... immediate 2023-11-28T21:10:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether stripping libraries is possible... yes 2023-11-28T21:10:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:checking if libtool supports shared libraries... yes 2023-11-28T21:10:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether to build shared libraries... yes 2023-11-28T21:10:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether to build static libraries... yes 2023-11-28T21:10:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc... (cached) gcc 2023-11-28T21:10:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-28T21:10:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-28T21:10:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-28T21:10:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gmake... /usr/bin/gmake 2023-11-28T21:10:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-11-28T21:10:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:checking for tar... /bin/tar 2023-11-28T21:10:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gzip... /bin/gzip 2023-11-28T21:10:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether gcc -MM is supported... yes 2023-11-28T21:10:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sort... /bin/sort 2023-11-28T21:10:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether ln -s works... yes 2023-11-28T21:10:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:checking for rpm... no 2023-11-28T21:10:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:checking for assert.h... yes 2023-11-28T21:10:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:checking for bstring.h... no 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for libgen.h... yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for dirent.h... yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for errno.h... yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for malloc.h... yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for uuid.h... no 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for uuid/uuid.h... yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/uuid.h... no 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/file.h... yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/fcntl.h... yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/syssgi.h... no 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/param.h... yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/stat.h... (cached) yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/statvfs.h... yes 2023-11-28T21:10:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/time.h... yes 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/ioctl.h... yes 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/wait.h... yes 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/types.h... (cached) yes 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for strings.h... (cached) yes 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for err.h... yes 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/falloc.h... yes 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/platform_defs.h... no 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for btrfs/ioctl.h... no 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for cifs/ioctl.h... no 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/mman.h... yes 2023-11-28T21:10:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/xfs_log_format.h... no 2023-11-28T21:10:09.637 INFO:teuthology.orchestra.run.smithi006.stdout:checking for uuid_compare... no 2023-11-28T21:10:09.637 INFO:teuthology.orchestra.run.smithi006.stdout:checking for uuid_compare in -luuid... yes 2023-11-28T21:10:09.637 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/xfs.h... yes 2023-11-28T21:10:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/libxfs.h... no 2023-11-28T21:10:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-11-28T21:10:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-28T21:10:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/xqm.h... yes 2023-11-28T21:10:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-28T21:10:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/handle.h... yes 2023-11-28T21:10:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-28T21:10:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/acl.h... yes 2023-11-28T21:10:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:checking for acl/libacl.h... yes 2023-11-28T21:10:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:checking for acl_init in -lacl... yes 2023-11-28T21:10:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gdbm-ndbm.h... no 2023-11-28T21:10:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gdbm/ndbm.h... no 2023-11-28T21:10:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:checking for ndbm.h... no 2023-11-28T21:10:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:checking for libaio.h... yes 2023-11-28T21:10:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:checking for liburing.h... yes 2023-11-28T21:10:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/capability.h... yes 2023-11-28T21:10:09.645 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/fiemap.h... yes 2023-11-28T21:10:09.645 INFO:teuthology.orchestra.run.smithi006.stdout:checking for fallocate... yes 2023-11-28T21:10:09.645 INFO:teuthology.orchestra.run.smithi006.stdout:checking for open_by_handle_at... yes 2023-11-28T21:10:09.646 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/prctl.h... yes 2023-11-28T21:10:09.646 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/fs.h... yes 2023-11-28T21:10:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:checking for btrfsutil.h... no 2023-11-28T21:10:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:checking for copy_file_range... yes 2023-11-28T21:10:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:checking for SEEK_DATA... yes 2023-11-28T21:10:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:checking for BMV_OF_SHARED... yes 2023-11-28T21:10:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:checking for nftw... yes 2023-11-28T21:10:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:checking for RLIMIT_NOFILE... yes 2023-11-28T21:10:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-28T21:10:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:checking for renameat2... yes 2023-11-28T21:10:09.648 INFO:teuthology.orchestra.run.smithi006.stdout:checking for reallocarray... yes 2023-11-28T21:10:09.648 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct mount_attr... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/btrfs.h... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/btrfs_tree.h... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-11-28T21:10:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:configure: creating ./config.status 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:config.status: creating include/builddefs 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:config.status: creating include/config.h 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:config.status: executing libtool commands 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:Building include 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:Building lib 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout: [LTDEP] 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dataascii.lo 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] databin.lo 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] datapid.lo 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] file_lock.lo 2023-11-28T21:10:09.650 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] forker.lo 2023-11-28T21:10:09.651 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] pattern.lo 2023-11-28T21:10:09.651 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] open_flags.lo 2023-11-28T21:10:09.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:09.725 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] random_range.lo 2023-11-28T21:10:09.994 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] string_to_tokens.lo 2023-11-28T21:10:10.127 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] str_to_bytes.lo 2023-11-28T21:10:10.304 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] tlibio.lo 2023-11-28T21:10:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] write_log.lo 2023-11-28T21:10:10.692 INFO:teuthology.orchestra.run.smithi006.stderr:write_log.c: In function 'wlog_record_write': 2023-11-28T21:10:10.693 INFO:teuthology.orchestra.run.smithi006.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:10.693 INFO:teuthology.orchestra.run.smithi006.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-11-28T21:10:10.693 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:10.693 INFO:teuthology.orchestra.run.smithi006.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:10.693 INFO:teuthology.orchestra.run.smithi006.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-11-28T21:10:10.693 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] random.lo 2023-11-28T21:10:11.025 INFO:teuthology.orchestra.run.smithi006.stdout: [LD] 2023-11-28T21:10:11.148 INFO:teuthology.orchestra.run.smithi006.stdout:Building ltp 2023-11-28T21:10:11.154 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-11-28T21:10:11.367 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] doio 2023-11-28T21:10:12.152 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fsstress 2023-11-28T21:10:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fsx 2023-11-28T21:10:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] growfiles 2023-11-28T21:10:15.269 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] iogen 2023-11-28T21:10:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:iogen.c: In function 'main': 2023-11-28T21:10:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:15.441 INFO:teuthology.orchestra.run.smithi006.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-11-28T21:10:15.441 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:15.444 INFO:teuthology.orchestra.run.smithi006.stderr:iogen.c: In function 'parse_cmdline': 2023-11-28T21:10:15.444 INFO:teuthology.orchestra.run.smithi006.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:15.445 INFO:teuthology.orchestra.run.smithi006.stderr: 1535 | getcwd(fptr->f_path, 2023-11-28T21:10:15.445 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:15.445 INFO:teuthology.orchestra.run.smithi006.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-11-28T21:10:15.445 INFO:teuthology.orchestra.run.smithi006.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:15.742 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-stress 2023-11-28T21:10:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-11-28T21:10:15.910 INFO:teuthology.orchestra.run.smithi006.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:15.910 INFO:teuthology.orchestra.run.smithi006.stderr: 1013 | ftruncate(fd, total_ram); 2023-11-28T21:10:15.910 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:16.253 INFO:teuthology.orchestra.run.smithi006.stdout:Building src 2023-11-28T21:10:16.262 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-11-28T21:10:18.768 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-11-28T21:10:18.817 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-11-28T21:10:18.831 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-11-28T21:10:19.174 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-11-28T21:10:19.210 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dirstress 2023-11-28T21:10:19.516 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fill 2023-11-28T21:10:19.717 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fill2 2023-11-28T21:10:20.004 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] getpagesize 2023-11-28T21:10:20.186 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] holes 2023-11-28T21:10:20.439 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] lstat64 2023-11-28T21:10:21.266 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] nametest 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:nametest.c: In function 'main': 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr: 236 | write(1, "\n", 1); 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr: 238 | write(1, ".", 1); 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr: 288 | write(1, ".", 1); 2023-11-28T21:10:21.267 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:21.268 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] permname 2023-11-28T21:10:21.268 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] randholes 2023-11-28T21:10:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] runas 2023-11-28T21:10:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] truncfile 2023-11-28T21:10:22.005 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] usemem 2023-11-28T21:10:22.204 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mmapcat 2023-11-28T21:10:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:mmapcat.c: In function 'main': 2023-11-28T21:10:22.359 INFO:teuthology.orchestra.run.smithi006.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:22.359 INFO:teuthology.orchestra.run.smithi006.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-11-28T21:10:22.359 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:22.404 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] append_reader 2023-11-28T21:10:22.607 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] append_writer 2023-11-28T21:10:22.808 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dirperf 2023-11-28T21:10:23.088 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] metaperf 2023-11-28T21:10:23.250 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c: In function 'crfiles': 2023-11-28T21:10:23.250 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:23.250 INFO:teuthology.orchestra.run.smithi006.stderr: 166 | write(fd, buf, fsize); 2023-11-28T21:10:23.250 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:23.250 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c: In function 't_linkun': 2023-11-28T21:10:23.250 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:23.250 INFO:teuthology.orchestra.run.smithi006.stderr: 454 | link("a", *fnp); 2023-11-28T21:10:23.250 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~ 2023-11-28T21:10:23.251 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c: In function 't_chown': 2023-11-28T21:10:23.251 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:23.251 INFO:teuthology.orchestra.run.smithi006.stderr: 404 | chown(*fnp, 2, -1); 2023-11-28T21:10:23.251 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr: 406 | chown(*fnp, 1, -1); 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c: In function 'i_chown': 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr: 291 | chown(*fnp, 1, -1); 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c: In function 'main': 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr: 152 | chdir(".."); 2023-11-28T21:10:23.252 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~ 2023-11-28T21:10:23.428 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] devzero 2023-11-28T21:10:23.659 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] feature 2023-11-28T21:10:23.948 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] alloc 2023-11-28T21:10:24.120 INFO:teuthology.orchestra.run.smithi006.stderr:alloc.c: In function 'main': 2023-11-28T21:10:24.120 INFO:teuthology.orchestra.run.smithi006.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:24.121 INFO:teuthology.orchestra.run.smithi006.stderr: 247 | mkstemp(tmpfile); 2023-11-28T21:10:24.121 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:24.223 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fault 2023-11-28T21:10:24.439 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fstest 2023-11-28T21:10:24.740 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_access_root 2023-11-28T21:10:24.894 INFO:teuthology.orchestra.run.smithi006.stderr:t_access_root.c: In function 'main': 2023-11-28T21:10:24.894 INFO:teuthology.orchestra.run.smithi006.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:24.894 INFO:teuthology.orchestra.run.smithi006.stderr: 55 | system(cmd); 2023-11-28T21:10:24.894 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~ 2023-11-28T21:10:24.946 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] godown 2023-11-28T21:10:25.170 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] resvtest 2023-11-28T21:10:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] writemod 2023-11-28T21:10:25.609 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] writev_on_pagefault 2023-11-28T21:10:25.823 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] makeextents 2023-11-28T21:10:26.061 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] itrash 2023-11-28T21:10:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] rename 2023-11-28T21:10:26.446 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] multi_open_unlink 2023-11-28T21:10:26.666 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] unwritten_sync 2023-11-28T21:10:26.902 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] genhashnames 2023-11-28T21:10:27.141 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_holes 2023-11-28T21:10:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_writev 2023-11-28T21:10:27.538 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_truncate_cmtime 2023-11-28T21:10:27.747 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dirhash_collide 2023-11-28T21:10:27.982 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_rename_overwrite 2023-11-28T21:10:28.169 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] holetest 2023-11-28T21:10:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:holetest.c: In function 'pt_write_marker': 2023-11-28T21:10:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:28.331 INFO:teuthology.orchestra.run.smithi006.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-11-28T21:10:28.331 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:28.453 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_truncate_self 2023-11-28T21:10:28.641 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] af_unix 2023-11-28T21:10:28.845 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_stale_pmd 2023-11-28T21:10:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-11-28T21:10:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:29.001 INFO:teuthology.orchestra.run.smithi006.stderr: 42 | ftruncate(fd, 0); 2023-11-28T21:10:29.001 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:29.001 INFO:teuthology.orchestra.run.smithi006.stderr: 43 | ftruncate(fd, MiB(4)); 2023-11-28T21:10:29.001 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:29.002 INFO:teuthology.orchestra.run.smithi006.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-11-28T21:10:29.002 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:29.049 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_cow_race 2023-11-28T21:10:29.208 INFO:teuthology.orchestra.run.smithi006.stderr:t_mmap_cow_race.c: In function 'main': 2023-11-28T21:10:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:29.209 INFO:teuthology.orchestra.run.smithi006.stderr: 61 | ftruncate(fd, 0); 2023-11-28T21:10:29.209 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:29.209 INFO:teuthology.orchestra.run.smithi006.stderr: 62 | ftruncate(fd, MiB(2)); 2023-11-28T21:10:29.209 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:29.266 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_fallocate 2023-11-28T21:10:29.467 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fsync-err 2023-11-28T21:10:29.706 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_write_ro 2023-11-28T21:10:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-28T21:10:30.067 INFO:teuthology.orchestra.run.smithi006.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-11-28T21:10:30.067 INFO:teuthology.orchestra.run.smithi006.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:30.067 INFO:teuthology.orchestra.run.smithi006.stderr: 61 | ftruncate(fd, 0); 2023-11-28T21:10:30.067 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-28T21:10:30.348 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_ofd_locks 2023-11-28T21:10:30.600 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_collision 2023-11-28T21:10:30.857 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mmap-write-concurrent 2023-11-28T21:10:31.079 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_get_file_time 2023-11-28T21:10:31.275 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_create_short_dirs 2023-11-28T21:10:31.495 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_create_long_dirs 2023-11-28T21:10:31.710 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_enospc 2023-11-28T21:10:31.964 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_writev_overlap 2023-11-28T21:10:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] checkpoint_journal 2023-11-28T21:10:32.394 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mmap-rw-fault 2023-11-28T21:10:32.650 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] allocstale 2023-11-28T21:10:32.874 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_cow_memory_failure 2023-11-28T21:10:33.098 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fake-dump-rootino 2023-11-28T21:10:33.298 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dio-buf-fault 2023-11-28T21:10:33.504 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] rewinddir-test 2023-11-28T21:10:33.729 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] xfsctl 2023-11-28T21:10:33.977 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] bstat 2023-11-28T21:10:34.247 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mtab 2023-11-28T21:10:34.406 INFO:teuthology.orchestra.run.smithi006.stderr:t_mtab.c: In function 'update_mtab': 2023-11-28T21:10:34.406 INFO:teuthology.orchestra.run.smithi006.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:34.406 INFO:teuthology.orchestra.run.smithi006.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-11-28T21:10:34.406 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:34.490 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] getdevicesize 2023-11-28T21:10:34.682 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] preallo_rw_pattern_reader 2023-11-28T21:10:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-11-28T21:10:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:iopat.c: In function 'main': 2023-11-28T21:10:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:34.849 INFO:teuthology.orchestra.run.smithi006.stderr: 38 | read(fd, &x, 1048576); 2023-11-28T21:10:34.849 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:34.894 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] preallo_rw_pattern_writer 2023-11-28T21:10:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-11-28T21:10:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:iopat.c: In function 'main': 2023-11-28T21:10:35.060 INFO:teuthology.orchestra.run.smithi006.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:35.061 INFO:teuthology.orchestra.run.smithi006.stderr: 34 | write(fd, &x, 1048576); 2023-11-28T21:10:35.061 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:35.105 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] ftrunc 2023-11-28T21:10:35.305 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] trunc 2023-11-28T21:10:35.522 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fs_perms 2023-11-28T21:10:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:fs_perms.c: In function 'main': 2023-11-28T21:10:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:35.680 INFO:teuthology.orchestra.run.smithi006.stderr: 54 | system("rm -f test.file"); 2023-11-28T21:10:35.680 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:fs_perms.c: In function 'testsetup': 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr: 67 | system("cp testx.file test.file"); 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:fs_perms.c: In function 'testfperm': 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr: 123 | seteuid(0); 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~ 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:35.681 INFO:teuthology.orchestra.run.smithi006.stderr: 124 | setegid(0); 2023-11-28T21:10:35.682 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~ 2023-11-28T21:10:35.737 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] testx 2023-11-28T21:10:35.913 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] looptest 2023-11-28T21:10:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] locktest 2023-11-28T21:10:36.540 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] unwritten_mmap 2023-11-28T21:10:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] bulkstat_unlink_test 2023-11-28T21:10:36.925 INFO:teuthology.orchestra.run.smithi006.stderr:bulkstat_unlink_test.c: In function 'main': 2023-11-28T21:10:36.925 INFO:teuthology.orchestra.run.smithi006.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:36.925 INFO:teuthology.orchestra.run.smithi006.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-11-28T21:10:36.925 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:36.925 INFO:teuthology.orchestra.run.smithi006.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:36.926 INFO:teuthology.orchestra.run.smithi006.stderr: 178 | system(fname); 2023-11-28T21:10:36.926 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~ 2023-11-28T21:10:37.017 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] deduperace 2023-11-28T21:10:37.271 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] bulkstat_unlink_test_modified 2023-11-28T21:10:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-11-28T21:10:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:37.439 INFO:teuthology.orchestra.run.smithi006.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-11-28T21:10:37.439 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:37.439 INFO:teuthology.orchestra.run.smithi006.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-11-28T21:10:37.439 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:37.439 INFO:teuthology.orchestra.run.smithi006.stderr: 185 | system(fname); 2023-11-28T21:10:37.440 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~ 2023-11-28T21:10:37.526 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_dir_offset 2023-11-28T21:10:37.724 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_futimens 2023-11-28T21:10:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_immutable 2023-11-28T21:10:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c: In function 'create_test_area': 2023-11-28T21:10:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.094 INFO:teuthology.orchestra.run.smithi006.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T21:10:38.094 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.094 INFO:teuthology.orchestra.run.smithi006.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T21:10:38.094 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c: In function 'remove_test_area': 2023-11-28T21:10:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.096 INFO:teuthology.orchestra.run.smithi006.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T21:10:38.096 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.096 INFO:teuthology.orchestra.run.smithi006.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-28T21:10:38.096 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.096 INFO:teuthology.orchestra.run.smithi006.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T21:10:38.096 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.097 INFO:teuthology.orchestra.run.smithi006.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-28T21:10:38.097 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.097 INFO:teuthology.orchestra.run.smithi006.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-11-28T21:10:38.097 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.098 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.098 INFO:teuthology.orchestra.run.smithi006.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-11-28T21:10:38.098 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.102 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c: In function 'check_test_area': 2023-11-28T21:10:38.102 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.102 INFO:teuthology.orchestra.run.smithi006.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-11-28T21:10:38.102 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.103 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.104 INFO:teuthology.orchestra.run.smithi006.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-28T21:10:38.104 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.104 INFO:teuthology.orchestra.run.smithi006.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-28T21:10:38.104 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.104 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.104 INFO:teuthology.orchestra.run.smithi006.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-28T21:10:38.105 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.105 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.105 INFO:teuthology.orchestra.run.smithi006.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-28T21:10:38.105 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.105 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c: In function 'test_immutable': 2023-11-28T21:10:38.105 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.105 INFO:teuthology.orchestra.run.smithi006.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-11-28T21:10:38.105 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.105 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.106 INFO:teuthology.orchestra.run.smithi006.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-11-28T21:10:38.106 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.106 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.106 INFO:teuthology.orchestra.run.smithi006.stderr: 408 | chown(path, 0, 0); 2023-11-28T21:10:38.106 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.106 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.106 INFO:teuthology.orchestra.run.smithi006.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-11-28T21:10:38.106 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.106 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.107 INFO:teuthology.orchestra.run.smithi006.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-28T21:10:38.107 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.107 INFO:teuthology.orchestra.run.smithi006.stderr: 553 | chown(path, 0, 0); 2023-11-28T21:10:38.107 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.107 INFO:teuthology.orchestra.run.smithi006.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-11-28T21:10:38.107 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.107 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.108 INFO:teuthology.orchestra.run.smithi006.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-11-28T21:10:38.108 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.108 INFO:teuthology.orchestra.run.smithi006.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-11-28T21:10:38.108 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.109 INFO:teuthology.orchestra.run.smithi006.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-11-28T21:10:38.109 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.109 INFO:teuthology.orchestra.run.smithi006.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-11-28T21:10:38.109 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.110 INFO:teuthology.orchestra.run.smithi006.stderr: 653 | chown(path, 0, 0); 2023-11-28T21:10:38.110 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.110 INFO:teuthology.orchestra.run.smithi006.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-28T21:10:38.110 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.110 INFO:teuthology.orchestra.run.smithi006.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T21:10:38.110 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.111 INFO:teuthology.orchestra.run.smithi006.stderr: 705 | chown(path, 0, 0); 2023-11-28T21:10:38.111 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.111 INFO:teuthology.orchestra.run.smithi006.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-28T21:10:38.111 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c: In function 'test_append': 2023-11-28T21:10:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.115 INFO:teuthology.orchestra.run.smithi006.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-11-28T21:10:38.115 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.115 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.115 INFO:teuthology.orchestra.run.smithi006.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr: 1051 | chown(path, 0, 0); 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr: 1516 | chown(path, 0, 0); 2023-11-28T21:10:38.116 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-11-28T21:10:38.117 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr: 1618 | chown(path, 0, 0); 2023-11-28T21:10:38.118 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr: 1644 | chown(path, 0, 0); 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.119 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.120 INFO:teuthology.orchestra.run.smithi006.stderr: 1692 | chown(path, 0, 0); 2023-11-28T21:10:38.120 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.120 INFO:teuthology.orchestra.run.smithi006.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.120 INFO:teuthology.orchestra.run.smithi006.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-28T21:10:38.120 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.692 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] stale_handle 2023-11-28T21:10:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:stale_handle.c: In function 'main': 2023-11-28T21:10:38.859 INFO:teuthology.orchestra.run.smithi006.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:38.859 INFO:teuthology.orchestra.run.smithi006.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-11-28T21:10:38.859 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:38.919 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] pwrite_mmap_blocked 2023-11-28T21:10:39.121 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_dir_offset2 2023-11-28T21:10:39.368 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] seek_sanity_test 2023-11-28T21:10:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c: In function 'test18': 2023-11-28T21:10:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:39.543 INFO:teuthology.orchestra.run.smithi006.stderr: 460 | ftruncate(fd, 0); 2023-11-28T21:10:39.543 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-11-28T21:10:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:39.545 INFO:teuthology.orchestra.run.smithi006.stderr: 1207 | ftruncate(fd, 0); 2023-11-28T21:10:39.545 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:39.545 INFO:teuthology.orchestra.run.smithi006.stderr: 1256 | ftruncate(fd, 0); 2023-11-28T21:10:39.545 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-11-28T21:10:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:39.546 INFO:teuthology.orchestra.run.smithi006.stderr: 88 | ftruncate(fd, 0); 2023-11-28T21:10:39.546 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:39.546 INFO:teuthology.orchestra.run.smithi006.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-11-28T21:10:39.546 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:39.547 INFO:teuthology.orchestra.run.smithi006.stderr: 98 | ftruncate(fd, 0); 2023-11-28T21:10:39.547 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T21:10:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:39.547 INFO:teuthology.orchestra.run.smithi006.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-11-28T21:10:39.547 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:39.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:39.728 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:39.872 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] seek_copy_test 2023-11-28T21:10:40.103 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_readdir_1 2023-11-28T21:10:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:t_readdir_1.c: In function 'main': 2023-11-28T21:10:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:40.259 INFO:teuthology.orchestra.run.smithi006.stderr: 30 | read(fd, buf, 100); 2023-11-28T21:10:40.259 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:40.303 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_readdir_2 2023-11-28T21:10:40.505 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fsync-tester 2023-11-28T21:10:40.663 INFO:teuthology.orchestra.run.smithi006.stderr:fsync-tester.c: In function 'main': 2023-11-28T21:10:40.664 INFO:teuthology.orchestra.run.smithi006.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:40.664 INFO:teuthology.orchestra.run.smithi006.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-11-28T21:10:40.664 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:40.664 INFO:teuthology.orchestra.run.smithi006.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:40.664 INFO:teuthology.orchestra.run.smithi006.stderr: 541 | system("reboot -fn"); 2023-11-28T21:10:40.664 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:40.664 INFO:teuthology.orchestra.run.smithi006.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-11-28T21:10:40.664 INFO:teuthology.orchestra.run.smithi006.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:40.665 INFO:teuthology.orchestra.run.smithi006.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-11-28T21:10:40.665 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:40.820 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] nsexec 2023-11-28T21:10:41.053 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] cloner 2023-11-28T21:10:41.284 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] renameat2 2023-11-28T21:10:41.504 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_getcwd 2023-11-28T21:10:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:t_getcwd.c: In function 'test_getcwd': 2023-11-28T21:10:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:41.661 INFO:teuthology.orchestra.run.smithi006.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-11-28T21:10:41.661 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:41.721 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] e4compact 2023-11-28T21:10:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] test-nextquota 2023-11-28T21:10:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] punch-alternating 2023-11-28T21:10:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-28T21:10:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] listxattr 2023-11-28T21:10:42.850 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dio-interleaved 2023-11-28T21:10:43.066 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_dir_type 2023-11-28T21:10:43.273 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dio-invalidate-cache 2023-11-28T21:10:43.430 INFO:teuthology.orchestra.run.smithi006.stderr:dio-invalidate-cache.c: In function 'main': 2023-11-28T21:10:43.430 INFO:teuthology.orchestra.run.smithi006.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:43.430 INFO:teuthology.orchestra.run.smithi006.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-11-28T21:10:43.430 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:43.534 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] stat_test 2023-11-28T21:10:43.886 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_encrypted_d_revalidate 2023-11-28T21:10:44.104 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] attr_replace_test 2023-11-28T21:10:44.321 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] swapon 2023-11-28T21:10:44.540 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mkswap 2023-11-28T21:10:44.743 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_attr_corruption 2023-11-28T21:10:44.944 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_open_tmpfiles 2023-11-28T21:10:45.177 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fscrypt-crypt-util 2023-11-28T21:10:45.923 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] bulkstat_null_ocount 2023-11-28T21:10:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] splice-test 2023-11-28T21:10:46.368 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] chprojid_fail 2023-11-28T21:10:46.588 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] detached_mounts_propagation 2023-11-28T21:10:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] ext4_resize 2023-11-28T21:10:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_readdir_3 2023-11-28T21:10:47.280 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] splice2pipe 2023-11-28T21:10:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-11-28T21:10:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:47.435 INFO:teuthology.orchestra.run.smithi006.stderr: 57 | write(p[1], buffer, n); 2023-11-28T21:10:47.435 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:47.435 INFO:teuthology.orchestra.run.smithi006.stderr: 65 | read(p[0], buffer, n); 2023-11-28T21:10:47.435 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] uuid_ioctl 2023-11-28T21:10:47.704 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fiemap-tester 2023-11-28T21:10:48.025 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_stripealign 2023-11-28T21:10:48.235 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] open_by_handle 2023-11-28T21:10:48.543 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_dio 2023-11-28T21:10:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] uring_read_fault 2023-11-28T21:10:49.000 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] xfsfind 2023-11-28T21:10:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fssum 2023-11-28T21:10:49.770 INFO:teuthology.orchestra.run.smithi006.stdout:Building log-writes 2023-11-28T21:10:49.778 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] replay-log 2023-11-28T21:10:50.192 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-11-28T21:10:50.198 INFO:teuthology.orchestra.run.smithi006.stdout:Building aio-dio-regress 2023-11-28T21:10:50.208 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aiocp 2023-11-28T21:10:50.501 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-28T21:10:50.731 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-append-write-read-race 2023-11-28T21:10:50.968 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-cow-race 2023-11-28T21:10:51.180 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-cycle-write 2023-11-28T21:10:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-11-28T21:10:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:51.335 INFO:teuthology.orchestra.run.smithi006.stderr: 83 | ftruncate(fd, buf_size); 2023-11-28T21:10:51.335 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:51.429 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-eof-race 2023-11-28T21:10:51.673 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-extend-stat 2023-11-28T21:10:51.897 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-fcntl-race 2023-11-28T21:10:52.117 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-hole-filling-race 2023-11-28T21:10:52.325 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-invalidate-failure 2023-11-28T21:10:52.542 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-invalidate-readahead 2023-11-28T21:10:52.768 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aiodio_sparse2 2023-11-28T21:10:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-11-28T21:10:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:52.923 INFO:teuthology.orchestra.run.smithi006.stderr: 111 | ftruncate(fd, filesize); 2023-11-28T21:10:52.923 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-11-28T21:10:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T21:10:52.923 INFO:teuthology.orchestra.run.smithi006.stderr: 274 | ftruncate(fd, size); 2023-11-28T21:10:52.923 INFO:teuthology.orchestra.run.smithi006.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-11-28T21:10:53.051 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-subblock-eof-read 2023-11-28T21:10:53.253 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-write-verify 2023-11-28T21:10:53.513 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-28T21:10:53.702 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-28T21:10:53.890 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-last-ref-held-by-io 2023-11-28T21:10:54.125 INFO:teuthology.orchestra.run.smithi006.stdout:Building vfs 2023-11-28T21:10:54.134 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] vfstest 2023-11-28T21:10:58.627 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mount-idmapped 2023-11-28T21:10:59.133 INFO:teuthology.orchestra.run.smithi006.stdout:Building m4 2023-11-28T21:10:59.138 INFO:teuthology.orchestra.run.smithi006.stdout:Building common 2023-11-28T21:10:59.145 INFO:teuthology.orchestra.run.smithi006.stdout:Building tests 2023-11-28T21:10:59.154 INFO:teuthology.orchestra.run.smithi006.stdout:Building btrfs 2023-11-28T21:10:59.164 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/btrfs/group.list 2023-11-28T21:10:59.300 INFO:teuthology.orchestra.run.smithi006.stdout:Building ceph 2023-11-28T21:10:59.309 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/ceph/group.list 2023-11-28T21:10:59.343 INFO:teuthology.orchestra.run.smithi006.stdout:Building cifs 2023-11-28T21:10:59.352 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/cifs/group.list 2023-11-28T21:10:59.380 INFO:teuthology.orchestra.run.smithi006.stdout:Building ext4 2023-11-28T21:10:59.390 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/ext4/group.list 2023-11-28T21:10:59.478 INFO:teuthology.orchestra.run.smithi006.stdout:Building f2fs 2023-11-28T21:10:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/f2fs/group.list 2023-11-28T21:10:59.527 INFO:teuthology.orchestra.run.smithi006.stdout:Building generic 2023-11-28T21:10:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/generic/group.list 2023-11-28T21:10:59.761 INFO:teuthology.orchestra.run.smithi006.stdout:Building nfs 2023-11-28T21:10:59.769 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/nfs/group.list 2023-11-28T21:10:59.803 INFO:teuthology.orchestra.run.smithi006.stdout:Building ocfs2 2023-11-28T21:10:59.811 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/ocfs2/group.list 2023-11-28T21:10:59.844 INFO:teuthology.orchestra.run.smithi006.stdout:Building overlay 2023-11-28T21:10:59.852 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/overlay/group.list 2023-11-28T21:10:59.945 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-11-28T21:10:59.954 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/perf/group.list 2023-11-28T21:10:59.980 INFO:teuthology.orchestra.run.smithi006.stdout:Building selftest 2023-11-28T21:10:59.989 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/selftest/group.list 2023-11-28T21:11:00.019 INFO:teuthology.orchestra.run.smithi006.stdout:Building shared 2023-11-28T21:11:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/shared/group.list 2023-11-28T21:11:00.068 INFO:teuthology.orchestra.run.smithi006.stdout:Building tmpfs 2023-11-28T21:11:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/tmpfs/group.list 2023-11-28T21:11:00.109 INFO:teuthology.orchestra.run.smithi006.stdout:Building udf 2023-11-28T21:11:00.117 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/udf/group.list 2023-11-28T21:11:00.144 INFO:teuthology.orchestra.run.smithi006.stdout:Building xfs 2023-11-28T21:11:00.157 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/xfs/group.list 2023-11-28T21:11:00.384 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo make install) 2023-11-28T21:11:00.428 INFO:teuthology.orchestra.run.smithi006.stdout:Building include 2023-11-28T21:11:00.434 INFO:teuthology.orchestra.run.smithi006.stdout:Building lib 2023-11-28T21:11:00.441 INFO:teuthology.orchestra.run.smithi006.stdout:Building ltp 2023-11-28T21:11:00.449 INFO:teuthology.orchestra.run.smithi006.stdout:Building src 2023-11-28T21:11:00.506 INFO:teuthology.orchestra.run.smithi006.stdout:Building log-writes 2023-11-28T21:11:00.515 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-11-28T21:11:00.519 INFO:teuthology.orchestra.run.smithi006.stdout:Building aio-dio-regress 2023-11-28T21:11:00.526 INFO:teuthology.orchestra.run.smithi006.stdout:Building vfs 2023-11-28T21:11:00.533 INFO:teuthology.orchestra.run.smithi006.stdout:Building m4 2023-11-28T21:11:00.540 INFO:teuthology.orchestra.run.smithi006.stdout:Building common 2023-11-28T21:11:00.546 INFO:teuthology.orchestra.run.smithi006.stdout:Building tests 2023-11-28T21:11:00.556 INFO:teuthology.orchestra.run.smithi006.stdout:Building btrfs 2023-11-28T21:11:00.565 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/btrfs/group.list 2023-11-28T21:11:00.700 INFO:teuthology.orchestra.run.smithi006.stdout:Building ceph 2023-11-28T21:11:00.708 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/ceph/group.list 2023-11-28T21:11:00.742 INFO:teuthology.orchestra.run.smithi006.stdout:Building cifs 2023-11-28T21:11:00.751 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/cifs/group.list 2023-11-28T21:11:00.780 INFO:teuthology.orchestra.run.smithi006.stdout:Building ext4 2023-11-28T21:11:00.789 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/ext4/group.list 2023-11-28T21:11:00.877 INFO:teuthology.orchestra.run.smithi006.stdout:Building f2fs 2023-11-28T21:11:00.886 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/f2fs/group.list 2023-11-28T21:11:00.925 INFO:teuthology.orchestra.run.smithi006.stdout:Building generic 2023-11-28T21:11:00.937 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/generic/group.list 2023-11-28T21:11:01.155 INFO:teuthology.orchestra.run.smithi006.stdout:Building nfs 2023-11-28T21:11:01.164 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/nfs/group.list 2023-11-28T21:11:01.197 INFO:teuthology.orchestra.run.smithi006.stdout:Building ocfs2 2023-11-28T21:11:01.206 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/ocfs2/group.list 2023-11-28T21:11:01.237 INFO:teuthology.orchestra.run.smithi006.stdout:Building overlay 2023-11-28T21:11:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/overlay/group.list 2023-11-28T21:11:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-11-28T21:11:01.348 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/perf/group.list 2023-11-28T21:11:01.375 INFO:teuthology.orchestra.run.smithi006.stdout:Building selftest 2023-11-28T21:11:01.385 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/selftest/group.list 2023-11-28T21:11:01.413 INFO:teuthology.orchestra.run.smithi006.stdout:Building shared 2023-11-28T21:11:01.422 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/shared/group.list 2023-11-28T21:11:01.462 INFO:teuthology.orchestra.run.smithi006.stdout:Building tmpfs 2023-11-28T21:11:01.472 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/tmpfs/group.list 2023-11-28T21:11:01.503 INFO:teuthology.orchestra.run.smithi006.stdout:Building udf 2023-11-28T21:11:01.512 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/udf/group.list 2023-11-28T21:11:01.539 INFO:teuthology.orchestra.run.smithi006.stdout:Building xfs 2023-11-28T21:11:01.549 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.TCCktrMdx7xfstests-dev/tests/xfs/group.list 2023-11-28T21:11:01.767 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-28T21:11:01.771 INFO:teuthology.orchestra.run.smithi006.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T21:11:01.771 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-28T21:11:01.776 INFO:teuthology.orchestra.run.smithi006.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T21:11:01.776 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-28T21:11:01.781 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-28T21:11:01.802 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-28T21:11:01.966 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-28T21:11:01.988 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-28T21:11:02.017 INFO:teuthology.orchestra.run.smithi006.stdout:Building log-writes 2023-11-28T21:11:02.023 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-11-28T21:11:02.030 INFO:teuthology.orchestra.run.smithi006.stdout:Building aio-dio-regress 2023-11-28T21:11:02.037 INFO:teuthology.orchestra.run.smithi006.stdout:Building vfs 2023-11-28T21:11:02.043 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake -C log-writes install 2023-11-28T21:11:02.047 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-28T21:11:02.068 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-28T21:11:02.089 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake -C perf install 2023-11-28T21:11:02.093 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-28T21:11:02.114 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-28T21:11:02.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-28T21:11:02.170 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-28T21:11:02.191 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-11-28T21:11:02.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake -C vfs install 2023-11-28T21:11:02.312 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-28T21:11:02.333 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-28T21:11:02.363 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-28T21:11:02.384 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind fssum /var/lib/xfstests/src 2023-11-28T21:11:05.281 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-28T21:11:05.512 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-28T21:11:05.560 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-28T21:11:05.564 INFO:teuthology.orchestra.run.smithi006.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T21:11:05.564 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-28T21:11:05.568 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-28T21:11:05.589 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-28T21:11:05.884 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-28T21:11:05.889 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/btrfs/ install 2023-11-28T21:11:05.894 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-28T21:11:05.915 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-11-28T21:11:07.723 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-28T21:11:07.744 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out /var/lib/xfstests/tests/btrfs 2023-11-28T21:11:09.558 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/ceph/ install 2023-11-28T21:11:09.562 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-28T21:11:09.583 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-28T21:11:09.627 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-28T21:11:09.648 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-11-28T21:11:09.693 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/cifs/ install 2023-11-28T21:11:09.697 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-28T21:11:09.718 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-28T21:11:09.740 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-28T21:11:09.761 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-28T21:11:09.782 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/ext4/ install 2023-11-28T21:11:09.786 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-28T21:11:09.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:09.793 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:09.808 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-28T21:11:10.223 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-28T21:11:10.245 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-11-28T21:11:10.687 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/f2fs/ install 2023-11-28T21:11:10.691 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-28T21:11:10.712 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-28T21:11:10.739 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-28T21:11:10.760 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-28T21:11:10.787 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/generic/ install 2023-11-28T21:11:10.795 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-28T21:11:10.817 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-28T21:11:15.213 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-28T21:11:15.234 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-11-28T21:11:19.626 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/nfs/ install 2023-11-28T21:11:19.630 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-28T21:11:19.651 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-28T21:11:19.672 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-28T21:11:19.693 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-28T21:11:19.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/ocfs2/ install 2023-11-28T21:11:19.719 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-28T21:11:19.740 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-28T21:11:19.761 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-28T21:11:19.782 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-28T21:11:19.804 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/overlay/ install 2023-11-28T21:11:19.809 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-28T21:11:19.830 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-28T21:11:20.449 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-28T21:11:20.471 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-11-28T21:11:21.091 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/perf/ install 2023-11-28T21:11:21.095 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-28T21:11:21.116 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-28T21:11:21.137 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-28T21:11:21.158 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-28T21:11:21.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/selftest/ install 2023-11-28T21:11:21.184 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-28T21:11:21.205 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-28T21:11:21.255 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-28T21:11:21.276 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-11-28T21:11:21.327 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/shared/ install 2023-11-28T21:11:21.331 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-28T21:11:21.352 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-28T21:11:21.385 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-28T21:11:21.407 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-11-28T21:11:21.440 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/tmpfs/ install 2023-11-28T21:11:21.443 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-28T21:11:21.465 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-28T21:11:21.486 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-28T21:11:21.507 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-28T21:11:21.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/udf/ install 2023-11-28T21:11:21.533 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-28T21:11:21.554 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-28T21:11:21.575 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-28T21:11:21.596 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-28T21:11:21.618 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.TCCktrMdx7xfstests-dev/tests/xfs/ install 2023-11-28T21:11:21.625 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-28T21:11:21.646 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-28T21:11:25.808 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-28T21:11:25.829 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-11-28T21:11:30.047 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-28T21:11:30.069 INFO:teuthology.orchestra.run.smithi006.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-28T21:11:30.089 INFO:teuthology.orchestra.run.smithi006.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-28T21:11:30.110 INFO:teuthology.orchestra.run.smithi006.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-28T21:11:30.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T21:11:30.134 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec ls tests/generic) 2023-11-28T21:11:30.146 INFO:teuthology.orchestra.run.smithi006.stdout:001 2023-11-28T21:11:30.146 INFO:teuthology.orchestra.run.smithi006.stdout:001.out 2023-11-28T21:11:30.146 INFO:teuthology.orchestra.run.smithi006.stdout:002 2023-11-28T21:11:30.146 INFO:teuthology.orchestra.run.smithi006.stdout:002.out 2023-11-28T21:11:30.146 INFO:teuthology.orchestra.run.smithi006.stdout:003 2023-11-28T21:11:30.146 INFO:teuthology.orchestra.run.smithi006.stdout:003.out 2023-11-28T21:11:30.146 INFO:teuthology.orchestra.run.smithi006.stdout:004 2023-11-28T21:11:30.146 INFO:teuthology.orchestra.run.smithi006.stdout:004.out 2023-11-28T21:11:30.146 INFO:teuthology.orchestra.run.smithi006.stdout:005 2023-11-28T21:11:30.147 INFO:teuthology.orchestra.run.smithi006.stdout:005.out 2023-11-28T21:11:30.147 INFO:teuthology.orchestra.run.smithi006.stdout:006 2023-11-28T21:11:30.147 INFO:teuthology.orchestra.run.smithi006.stdout:006.out 2023-11-28T21:11:30.147 INFO:teuthology.orchestra.run.smithi006.stdout:007 2023-11-28T21:11:30.147 INFO:teuthology.orchestra.run.smithi006.stdout:007.out 2023-11-28T21:11:30.147 INFO:teuthology.orchestra.run.smithi006.stdout:008 2023-11-28T21:11:30.147 INFO:teuthology.orchestra.run.smithi006.stdout:008.out 2023-11-28T21:11:30.148 INFO:teuthology.orchestra.run.smithi006.stdout:009 2023-11-28T21:11:30.148 INFO:teuthology.orchestra.run.smithi006.stdout:009.out 2023-11-28T21:11:30.148 INFO:teuthology.orchestra.run.smithi006.stdout:010 2023-11-28T21:11:30.148 INFO:teuthology.orchestra.run.smithi006.stdout:010.out 2023-11-28T21:11:30.148 INFO:teuthology.orchestra.run.smithi006.stdout:011 2023-11-28T21:11:30.148 INFO:teuthology.orchestra.run.smithi006.stdout:011.out 2023-11-28T21:11:30.148 INFO:teuthology.orchestra.run.smithi006.stdout:012 2023-11-28T21:11:30.148 INFO:teuthology.orchestra.run.smithi006.stdout:012.out 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:013 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:013.out 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:014 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:014.out 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:015 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:015.out 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:016 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:016.out 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:017 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:017.out 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:018 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:018.out 2023-11-28T21:11:30.149 INFO:teuthology.orchestra.run.smithi006.stdout:019 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:019.out 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:020 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:020.out 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:021 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:021.out 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:022 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:022.out 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:023 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:023.out 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:024 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:024.out 2023-11-28T21:11:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:025 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:025.out 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:026 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:026.out 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:027 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:027.out 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:028 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:028.out 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:029 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:029.out 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:030 2023-11-28T21:11:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:030.out 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:031 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:031.out 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:032 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:032.out 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:033 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:033.out 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:034 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:034.out 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:035 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:035.cfg 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:035.out.default 2023-11-28T21:11:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:035.out.nfs 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:036 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:036.out 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:037 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:037.out 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:038 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:038.out 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:039 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:039.out 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:040 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:040.out 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:041 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:041.out 2023-11-28T21:11:30.153 INFO:teuthology.orchestra.run.smithi006.stdout:042 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:042.out 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:043 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:043.out 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:044 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:044.out 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:045 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:045.out 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:046 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:046.out 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:047 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:047.out 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:048 2023-11-28T21:11:30.154 INFO:teuthology.orchestra.run.smithi006.stdout:048.out 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:049 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:049.out 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:050 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:050.cfg 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:050.out.default 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:050.out.nojournal 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:050.out.xfsquota 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:051 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:051.out 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:052 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:052.out 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:053 2023-11-28T21:11:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:053.out 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:054 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:054.out 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:055 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:055.out 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:056 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:056.out 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:057 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:057.out 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:058 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:058.out 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:059 2023-11-28T21:11:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:059.out 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:060 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:060.out 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:061 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:061.out 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:062 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:062.out 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:063 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:063.out 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:064 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:064.out 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:065 2023-11-28T21:11:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:065.out 2023-11-28T21:11:30.158 INFO:teuthology.orchestra.run.smithi006.stdout:066 2023-11-28T21:11:30.158 INFO:teuthology.orchestra.run.smithi006.stdout:066.out 2023-11-28T21:11:30.158 INFO:teuthology.orchestra.run.smithi006.stdout:067 2023-11-28T21:11:30.158 INFO:teuthology.orchestra.run.smithi006.stdout:067.out 2023-11-28T21:11:30.158 INFO:teuthology.orchestra.run.smithi006.stdout:068 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:068.out 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:069 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:069.out 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:070 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:070.out 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:071 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:071.out 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:072 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:072.out 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:073 2023-11-28T21:11:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:073.out 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:074 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:074.out 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:075 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:075.out 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:076 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:076.out 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:077 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:077.out 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:078 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:078.out 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:079 2023-11-28T21:11:30.160 INFO:teuthology.orchestra.run.smithi006.stdout:079.out 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:080 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:080.out 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:081 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:081.out 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:082 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:082.out 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:083 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:083.out 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:084 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:084.out 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:085 2023-11-28T21:11:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:085.out 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:086 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:086.out 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:087 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:087.out 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:088 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:088.out 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:089 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:089.out 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:090 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:090.out 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:091 2023-11-28T21:11:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:091.out 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:092 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:092.out 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:093 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:093.out 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:094 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:094.out 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:095 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:095.out 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:096 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:096.out 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:097 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:097.out 2023-11-28T21:11:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:098 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:098.out 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:099 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:099.out 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:100 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:100.out 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:101 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:101.out 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:102 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:102.out 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:103 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:103.out 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:104 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:104.out 2023-11-28T21:11:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:105 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:105.out 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:106 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:106.out 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:107 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:107.out 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:108 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:108.out 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:109 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:109.out 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:110 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:110.out 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:111 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:111.out 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:112 2023-11-28T21:11:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:112.out 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:113 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:113.out 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:114 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:114.out 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:115 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:115.out 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:116 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:116.out 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:117 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:117.out 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:118 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:118.out 2023-11-28T21:11:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:119 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:119.out 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:120 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:120.out 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:121 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:121.out 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:122 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:122.out 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:123 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:123.out 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:124 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:124.out 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:125 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:125.out 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:126 2023-11-28T21:11:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:126.out 2023-11-28T21:11:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:127 2023-11-28T21:11:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:127.out 2023-11-28T21:11:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:128 2023-11-28T21:11:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:128.out 2023-11-28T21:11:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:129 2023-11-28T21:11:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:129.out 2023-11-28T21:11:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:130 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:130.out 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:131 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:131.out 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:132 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:132.out 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:133 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:133.out 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:134 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:134.out 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:135 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:135.out 2023-11-28T21:11:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:136 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:136.out 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:137 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:137.out 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:138 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:138.out 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:139 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:139.out 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:140 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:140.out 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:141 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:141.out 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:142 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:142.out 2023-11-28T21:11:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:143 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:143.out 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:144 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:144.out 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:145 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:145.out 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:146 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:146.out 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:147 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:147.out 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:148 2023-11-28T21:11:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:148.out 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:149 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:149.out 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:150 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:150.out 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:151 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:151.out 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:152 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:152.out 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:153 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:153.out 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:154 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:154.out 2023-11-28T21:11:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:155 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:155.out 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:156 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:156.out 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:157 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:157.out 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:158 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:158.out 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:159 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:159.out 2023-11-28T21:11:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:160 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:160.out 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:161 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:161.out 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:162 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:162.out 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:163 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:163.out 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:164 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:164.out 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:165 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:165.out 2023-11-28T21:11:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:166 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:166.out 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:167 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:167.out 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:168 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:168.out 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:169 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:169.out 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:170 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:170.out 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:171 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:171.out 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:172 2023-11-28T21:11:30.175 INFO:teuthology.orchestra.run.smithi006.stdout:172.out 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:173 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:173.out 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:174 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:174.out 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:175 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:175.out 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:176 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:176.out 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:177 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:177.out 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:178 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:178.out 2023-11-28T21:11:30.176 INFO:teuthology.orchestra.run.smithi006.stdout:179 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:179.out 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:180 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:180.out 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:181 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:181.out 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:182 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:182.out 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:183 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:183.out 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:184 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:184.out 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:185 2023-11-28T21:11:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:185.out 2023-11-28T21:11:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:186 2023-11-28T21:11:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:186.out 2023-11-28T21:11:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:187 2023-11-28T21:11:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:187.out 2023-11-28T21:11:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:188 2023-11-28T21:11:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:188.out 2023-11-28T21:11:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:189 2023-11-28T21:11:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:189.out 2023-11-28T21:11:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:190 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:190.out 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:191 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:191.out 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:192 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:192.out 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:193 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:193.out 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:194 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:194.out 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:195 2023-11-28T21:11:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:195.out 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:196 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:196.out 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:197 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:197.out 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:198 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:198.out 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:199 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:199.out 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:200 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:200.out 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:201 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:201.out 2023-11-28T21:11:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:202 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:202.out 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:203 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:203.out 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:204 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:204.out 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:205 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:205.out 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:206 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:206.out 2023-11-28T21:11:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:207 2023-11-28T21:11:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:207.out 2023-11-28T21:11:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:208 2023-11-28T21:11:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:208.out 2023-11-28T21:11:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:209 2023-11-28T21:11:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:209.out 2023-11-28T21:11:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:210 2023-11-28T21:11:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:210.out 2023-11-28T21:11:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:211 2023-11-28T21:11:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:211.out 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:212 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:212.out 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:213 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:213.out 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:214 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:214.out 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:215 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:215.out 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:216 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:216.out 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:217 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:217.out 2023-11-28T21:11:30.183 INFO:teuthology.orchestra.run.smithi006.stdout:218 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:218.out 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:219 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:219.out 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:220 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:220.out 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:221 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:221.out 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:222 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:222.out 2023-11-28T21:11:30.184 INFO:teuthology.orchestra.run.smithi006.stdout:223 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:223.out 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:224 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:224.out 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:225 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:225.out 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:226 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:226.out 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:227 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:227.out 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:228 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:228.out 2023-11-28T21:11:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:229 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:229.out 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:230 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:230.out 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:231 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:231.out 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:232 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:232.out 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:233 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:233.out 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:234 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:234.out 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:235 2023-11-28T21:11:30.186 INFO:teuthology.orchestra.run.smithi006.stdout:235.out 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:236 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:236.out 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:237 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:237.out 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:238 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:238.out 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:239 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:239.out 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:240 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:240.out 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:241 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:241.out 2023-11-28T21:11:30.187 INFO:teuthology.orchestra.run.smithi006.stdout:242 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:242.out 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:243 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:243.out 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:244 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:244.out 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:245 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:245.out 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:246 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:246.out 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:247 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:247.out 2023-11-28T21:11:30.188 INFO:teuthology.orchestra.run.smithi006.stdout:248 2023-11-28T21:11:30.189 INFO:teuthology.orchestra.run.smithi006.stdout:248.out 2023-11-28T21:11:30.189 INFO:teuthology.orchestra.run.smithi006.stdout:249 2023-11-28T21:11:30.189 INFO:teuthology.orchestra.run.smithi006.stdout:249.out 2023-11-28T21:11:30.189 INFO:teuthology.orchestra.run.smithi006.stdout:250 2023-11-28T21:11:30.189 INFO:teuthology.orchestra.run.smithi006.stdout:250.out 2023-11-28T21:11:30.189 INFO:teuthology.orchestra.run.smithi006.stdout:251 2023-11-28T21:11:30.189 INFO:teuthology.orchestra.run.smithi006.stdout:251.out 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:252 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:252.out 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:253 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:253.out 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:254 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:254.out 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:255 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:255.out 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:256 2023-11-28T21:11:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:256.out 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:257 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:257.out 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:258 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:258.out 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:259 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:259.out 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:260 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:260.out 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:261 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:261.out 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:262 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:262.out 2023-11-28T21:11:30.191 INFO:teuthology.orchestra.run.smithi006.stdout:263 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:263.out 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:264 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:264.out 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:265 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:265.out 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:266 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:266.out 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:267 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:267.out 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:268 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:268.out 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:269 2023-11-28T21:11:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:269.out 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:270 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:270.out 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:271 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:271.out 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:272 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:272.out 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:273 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:273.out 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:274 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:274.out 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:275 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:275.out 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:276 2023-11-28T21:11:30.193 INFO:teuthology.orchestra.run.smithi006.stdout:276.out 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:277 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:277.out 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:278 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:278.out 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:279 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:279.out 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:280 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:280.out 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:281 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:281.out 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:282 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:282.out 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:283 2023-11-28T21:11:30.194 INFO:teuthology.orchestra.run.smithi006.stdout:283.out 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:284 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:284.out 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:285 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:285.out 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:286 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:286.out 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:287 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:287.out 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:288 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:288.out 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:289 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:289.out 2023-11-28T21:11:30.195 INFO:teuthology.orchestra.run.smithi006.stdout:290 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:290.out 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:291 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:291.out 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:292 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:292.out 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:293 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:293.out 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:294 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:294.out 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:295 2023-11-28T21:11:30.196 INFO:teuthology.orchestra.run.smithi006.stdout:295.out 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:296 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:296.out 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:297 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:297.out 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:298 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:298.out 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:299 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:299.out 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:300 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:300.out 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:301 2023-11-28T21:11:30.197 INFO:teuthology.orchestra.run.smithi006.stdout:301.out 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:302 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:302.out 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:303 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:303.out 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:304 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:304.out 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:305 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:305.out 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:306 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:306.out 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:307 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:307.out 2023-11-28T21:11:30.198 INFO:teuthology.orchestra.run.smithi006.stdout:308 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:308.out 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:309 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:309.out 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:310 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:310.out 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:311 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:311.out 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:312 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:312.out 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:313 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:313.out 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:314 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:314.out 2023-11-28T21:11:30.199 INFO:teuthology.orchestra.run.smithi006.stdout:315 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:315.out 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:316 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:316.out 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:317 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:317.out 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:318 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:318.out 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:319 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:319.out 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:320 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:320.out 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:321 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:321.out 2023-11-28T21:11:30.200 INFO:teuthology.orchestra.run.smithi006.stdout:322 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:322.out 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:323 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:323.out 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:324 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:324.out 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:325 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:325.out 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:326 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:326.out 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:327 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:327.out 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:328 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:328.out 2023-11-28T21:11:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:329 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:329.out 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:330 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:330.out 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:331 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:331.out 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:332 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:332.out 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:333 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:333.out 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:334 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:334.out 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:335 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:335.out 2023-11-28T21:11:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:336 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:336.out 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:337 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:337.out 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:338 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:338.out 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:339 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:339.out 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:340 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:340.out 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:341 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:341.out 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:342 2023-11-28T21:11:30.203 INFO:teuthology.orchestra.run.smithi006.stdout:342.out 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:343 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:343.out 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:344 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:344.out 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:345 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:345.out 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:346 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:346.out 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:347 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:347.out 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:348 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:348.out 2023-11-28T21:11:30.204 INFO:teuthology.orchestra.run.smithi006.stdout:349 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:349.out 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:350 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:350.out 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:351 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:351.out 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:352 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:352.out 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:353 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:353.out 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:354 2023-11-28T21:11:30.205 INFO:teuthology.orchestra.run.smithi006.stdout:354.out 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:355 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:355.out 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:356 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:356.out 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:357 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:357.out 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:358 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:358.out 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:359 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:359.out 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:360 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:360.out 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:361 2023-11-28T21:11:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:361.out 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:362 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:362.out 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:363 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:363.out 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:364 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:364.out 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:365 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:365.out 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:366 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:366.out 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:367 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:367.out 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:368 2023-11-28T21:11:30.207 INFO:teuthology.orchestra.run.smithi006.stdout:368.out 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:369 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:369.out 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:370 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:370.out 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:371 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:371.out 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:372 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:372.out 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:373 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:373.out 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:374 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:374.out 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:375 2023-11-28T21:11:30.208 INFO:teuthology.orchestra.run.smithi006.stdout:375.out 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:376 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:376.out 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:377 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:377.out 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:378 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:378.out 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:379 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:379.out 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:380 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:380.out 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:381 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:381.out 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:382 2023-11-28T21:11:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:382.out 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:383 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:383.out 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:384 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:384.out 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:385 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:385.out 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:386 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:386.out 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:387 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:387.out 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:388 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:388.out 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:389 2023-11-28T21:11:30.210 INFO:teuthology.orchestra.run.smithi006.stdout:389.out 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:390 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:390.out 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:391 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:391.out 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:392 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:392.out 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:393 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:393.out 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:394 2023-11-28T21:11:30.211 INFO:teuthology.orchestra.run.smithi006.stdout:394.out 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:395 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:395.out 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:396 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:396.out 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:397 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:397.out 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:398 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:398.out 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:399 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:399.out 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:400 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:400.out 2023-11-28T21:11:30.212 INFO:teuthology.orchestra.run.smithi006.stdout:401 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:401.out 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:402 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:402.out 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:403 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:403.out 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:404 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:404.out 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:405 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:405.out 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:406 2023-11-28T21:11:30.213 INFO:teuthology.orchestra.run.smithi006.stdout:406.out 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:407 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:407.out 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:408 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:408.out 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:409 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:409.out 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:410 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:410.out 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:411 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:411.out 2023-11-28T21:11:30.214 INFO:teuthology.orchestra.run.smithi006.stdout:412 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:412.out 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:413 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:413.out 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:414 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:414.out 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:415 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:415.out 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:416 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:416.out 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:417 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:417.out 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:418 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:418.out 2023-11-28T21:11:30.215 INFO:teuthology.orchestra.run.smithi006.stdout:419 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:419.out 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:420 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:420.out 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:421 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:421.out 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:422 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:422.out 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:423 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:423.out 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:424 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:424.out 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:425 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:425.out 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:426 2023-11-28T21:11:30.216 INFO:teuthology.orchestra.run.smithi006.stdout:426.out 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:427 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:427.out 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:428 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:428.out 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:429 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:429.out 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:430 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:430.out 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:431 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:431.out 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:432 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:432.out 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:433 2023-11-28T21:11:30.217 INFO:teuthology.orchestra.run.smithi006.stdout:433.out 2023-11-28T21:11:30.218 INFO:teuthology.orchestra.run.smithi006.stdout:434 2023-11-28T21:11:30.218 INFO:teuthology.orchestra.run.smithi006.stdout:434.out 2023-11-28T21:11:30.218 INFO:teuthology.orchestra.run.smithi006.stdout:435 2023-11-28T21:11:30.218 INFO:teuthology.orchestra.run.smithi006.stdout:435.out 2023-11-28T21:11:30.218 INFO:teuthology.orchestra.run.smithi006.stdout:436 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:436.out 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:437 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:437.out 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:438 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:438.out 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:439 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:439.out 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:440 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:440.out 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:441 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:441.out 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:442 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:442.out 2023-11-28T21:11:30.219 INFO:teuthology.orchestra.run.smithi006.stdout:443 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:443.out 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:444 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:444.out 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:445 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:445.out 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:446 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:446.out 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:447 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:447.out 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:448 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:448.out 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:449 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:449.out 2023-11-28T21:11:30.220 INFO:teuthology.orchestra.run.smithi006.stdout:450 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:450.out 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:451 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:451.out 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:452 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:452.out 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:453 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:453.out 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:454 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:454.out 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:455 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:455.out 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:456 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:456.out 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:457 2023-11-28T21:11:30.221 INFO:teuthology.orchestra.run.smithi006.stdout:457.out 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:458 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:458.out 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:459 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:459.out 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:460 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:460.out 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:461 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:461.out 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:462 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:462.out 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:463 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:463.out 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:464 2023-11-28T21:11:30.222 INFO:teuthology.orchestra.run.smithi006.stdout:464.out 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:465 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:465.out 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:466 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:466.out 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:467 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:467.out 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:468 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:468.out 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:469 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:469.out 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:470 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:470.out 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:471 2023-11-28T21:11:30.223 INFO:teuthology.orchestra.run.smithi006.stdout:471.out 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:472 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:472.out 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:473 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:473.out 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:474 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:474.out 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:475 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:475.out 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:476 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:476.out 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:477 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:477.out 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:478 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:478.out 2023-11-28T21:11:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:479 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:479.out 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:480 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:480.out 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:481 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:481.out 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:482 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:482.out 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:483 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:483.out 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:484 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:484.out 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:485 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:485.out 2023-11-28T21:11:30.225 INFO:teuthology.orchestra.run.smithi006.stdout:486 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:486.out 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:487 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:487.out 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:488 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:488.out 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:489 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:489.out 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:490 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:490.out 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:491 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:491.out 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:492 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:492.out 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:493 2023-11-28T21:11:30.226 INFO:teuthology.orchestra.run.smithi006.stdout:493.out 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:494 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:494.out 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:495 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:495.out 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:496 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:496.out 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:497 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:497.out 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:498 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:498.out 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:499 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:499.out 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:500 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:500.out 2023-11-28T21:11:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:501 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:501.out 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:502 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:502.out 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:503 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:503.out 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:504 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:504.out 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:505 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:505.out 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:506 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:506.out 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:507 2023-11-28T21:11:30.228 INFO:teuthology.orchestra.run.smithi006.stdout:507.out 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:508 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:508.out 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:509 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:509.out 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:510 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:510.out 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:511 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:511.out 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:512 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:512.out 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:513 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:513.out 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:514 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:514.out 2023-11-28T21:11:30.229 INFO:teuthology.orchestra.run.smithi006.stdout:515 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:515.out 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:516 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:516.out 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:517 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:517.out 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:518 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:518.out 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:519 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:519.out 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:520 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:520.out 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:521 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:521.out 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:522 2023-11-28T21:11:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:522.out 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:523 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:523.out 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:524 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:524.out 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:525 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:525.out 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:526 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:526.out 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:527 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:527.out 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:528 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:528.out 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:529 2023-11-28T21:11:30.231 INFO:teuthology.orchestra.run.smithi006.stdout:529.out 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:530 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:530.out 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:531 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:531.out 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:532 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:532.out 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:533 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:533.out 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:534 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:534.out 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:535 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:535.out 2023-11-28T21:11:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:536 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:536.out 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:537 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:537.out 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:538 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:538.out 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:539 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:539.out 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:540 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:540.out 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:541 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:541.out 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:542 2023-11-28T21:11:30.233 INFO:teuthology.orchestra.run.smithi006.stdout:542.out 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:543 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:543.out 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:544 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:544.out 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:545 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:545.out 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:546 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:546.out 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:547 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:547.out 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:548 2023-11-28T21:11:30.234 INFO:teuthology.orchestra.run.smithi006.stdout:548.out 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:549 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:549.out 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:550 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:550.out 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:551 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:551.out 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:552 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:552.out 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:553 2023-11-28T21:11:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:553.out 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:554 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:554.out 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:555 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:555.out 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:556 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:556.out 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:557 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:557.out 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:558 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:558.out 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:559 2023-11-28T21:11:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:559.out 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:560 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:560.out 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:561 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:561.out 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:562 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:562.out 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:563 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:563.out 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:564 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:564.out 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:565 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:565.out 2023-11-28T21:11:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:566 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:566.out 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:567 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:567.out 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:568 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:568.out 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:569 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:569.out 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:570 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:570.out 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:571 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:571.out 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:572 2023-11-28T21:11:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:572.out 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:573 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:573.out 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:574 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:574.out 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:575 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:575.out 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:576 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:576.out 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:577 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:577.out 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:578 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:578.out 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:579 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:579.out 2023-11-28T21:11:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:580 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:580.out 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:581 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:581.out 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:582 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:582.out 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:583 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:583.out 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:584 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:584.out 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:585 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:585.out 2023-11-28T21:11:30.240 INFO:teuthology.orchestra.run.smithi006.stdout:586 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:586.out 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:587 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:587.out 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:588 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:588.out 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:589 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:589.out 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:590 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:590.out 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:591 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:591.out 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:592 2023-11-28T21:11:30.241 INFO:teuthology.orchestra.run.smithi006.stdout:592.out 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:593 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:593.out 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:594 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:594.out 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:595 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:595.out 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:596 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:596.out 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:597 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:597.out 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:598 2023-11-28T21:11:30.242 INFO:teuthology.orchestra.run.smithi006.stdout:598.out 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:599 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:599.out 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:600 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:600.out 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:601 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:601.out 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:602 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:602.out 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:603 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:603.out 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:604 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:604.out 2023-11-28T21:11:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:605 2023-11-28T21:11:30.244 INFO:teuthology.orchestra.run.smithi006.stdout:605.out 2023-11-28T21:11:30.244 INFO:teuthology.orchestra.run.smithi006.stdout:606 2023-11-28T21:11:30.244 INFO:teuthology.orchestra.run.smithi006.stdout:606.out 2023-11-28T21:11:30.244 INFO:teuthology.orchestra.run.smithi006.stdout:607 2023-11-28T21:11:30.244 INFO:teuthology.orchestra.run.smithi006.stdout:607.out 2023-11-28T21:11:30.244 INFO:teuthology.orchestra.run.smithi006.stdout:608 2023-11-28T21:11:30.244 INFO:teuthology.orchestra.run.smithi006.stdout:608.out 2023-11-28T21:11:30.244 INFO:teuthology.orchestra.run.smithi006.stdout:609 2023-11-28T21:11:30.244 INFO:teuthology.orchestra.run.smithi006.stdout:609.out 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:610 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:610.out 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:611 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:611.out 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:612 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:612.out 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:613 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:613.out 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:614 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:614.out 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:615 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:615.out 2023-11-28T21:11:30.245 INFO:teuthology.orchestra.run.smithi006.stdout:616 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:616.out 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:617 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:617.out 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:618 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:618.out 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:619 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:619.out 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:620 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:620.out 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:621 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:621.out 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:622 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:622.out 2023-11-28T21:11:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:623 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:623.out 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:624 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:624.out 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:625 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:625.out 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:626 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:626.out 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:627 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:627.out 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:628 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:628.out 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:629 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:629.out 2023-11-28T21:11:30.247 INFO:teuthology.orchestra.run.smithi006.stdout:630 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:630.out 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:631 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:631.out 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:632 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:632.out 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:633 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:633.out 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:634 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:634.out 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:635 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:635.out 2023-11-28T21:11:30.248 INFO:teuthology.orchestra.run.smithi006.stdout:636 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:636.out 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:637 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:637.out 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:638 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:638.out 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:639 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:639.out 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:640 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:640.out 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:641 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:641.out 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:642 2023-11-28T21:11:30.249 INFO:teuthology.orchestra.run.smithi006.stdout:642.out 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:643 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:643.out 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:644 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:644.out 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:645 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:645.out 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:646 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:646.out 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:647 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:647.out 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:648 2023-11-28T21:11:30.250 INFO:teuthology.orchestra.run.smithi006.stdout:648.out 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:649 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:649.out 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:650 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:650.out 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:651 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:651.out 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:652 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:652.out 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:653 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:653.out 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:654 2023-11-28T21:11:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:654.out 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:655 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:655.out 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:656 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:656.out 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:657 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:657.out 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:658 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:658.out 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:659 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:659.out 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:660 2023-11-28T21:11:30.252 INFO:teuthology.orchestra.run.smithi006.stdout:660.out 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:661 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:661.out 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:662 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:662.out 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:663 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:663.out 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:664 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:664.out 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:665 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:665.out 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:666 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:666.out 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:667 2023-11-28T21:11:30.253 INFO:teuthology.orchestra.run.smithi006.stdout:667.out 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:668 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:668.out 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:669 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:669.out 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:670 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:670.out 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:671 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:671.out 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:672 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:672.out 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:673 2023-11-28T21:11:30.254 INFO:teuthology.orchestra.run.smithi006.stdout:673.out 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:674 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:674.out 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:675 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:675.out 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:676 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:676.out 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:677 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:677.out 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:678 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:678.out 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:679 2023-11-28T21:11:30.255 INFO:teuthology.orchestra.run.smithi006.stdout:679.out 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:680 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:680.out 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:681 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:681.out 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:682 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:682.out 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:683 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:683.out 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:684 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:684.out 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:685 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:685.out 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:686 2023-11-28T21:11:30.256 INFO:teuthology.orchestra.run.smithi006.stdout:686.out 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:687 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:687.out 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:688 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:688.out 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:689 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:689.out 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:690 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:690.out 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:691 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:691.out 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:692 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:692.out 2023-11-28T21:11:30.257 INFO:teuthology.orchestra.run.smithi006.stdout:693 2023-11-28T21:11:30.258 INFO:teuthology.orchestra.run.smithi006.stdout:693.out 2023-11-28T21:11:30.258 INFO:teuthology.orchestra.run.smithi006.stdout:694 2023-11-28T21:11:30.258 INFO:teuthology.orchestra.run.smithi006.stdout:694.out 2023-11-28T21:11:30.261 INFO:teuthology.orchestra.run.smithi006.stdout:695 2023-11-28T21:11:30.261 INFO:teuthology.orchestra.run.smithi006.stdout:695.out 2023-11-28T21:11:30.261 INFO:teuthology.orchestra.run.smithi006.stdout:696 2023-11-28T21:11:30.262 INFO:teuthology.orchestra.run.smithi006.stdout:696.out 2023-11-28T21:11:30.262 INFO:teuthology.orchestra.run.smithi006.stdout:697 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:697.out 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:698 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:698.out 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:699 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:699.out 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:700 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:700.out 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:701 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:701.out 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:702 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:702.out 2023-11-28T21:11:30.263 INFO:teuthology.orchestra.run.smithi006.stdout:703 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:703.out 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:704 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:704.out 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:705 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:705.out 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:706 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:706.out 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:707 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:707.out 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:708 2023-11-28T21:11:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:708.out 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:709 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:709.out 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:710 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:710.out 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:711 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:711.out 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:712 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:712.out 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:713 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:713.out 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:714 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:714.out 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:715 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:715.out 2023-11-28T21:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:716 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:716.out 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:717 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:717.out 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:718 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:718.out 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:719 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:719.out 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:720 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:720.out 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:721 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:721.out 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:722 2023-11-28T21:11:30.266 INFO:teuthology.orchestra.run.smithi006.stdout:722.out 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:723 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:723.out 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:724 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:724.out 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:725 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:725.out 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:726 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:726.out 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:727 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:727.out 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:728 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:728.out 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:729 2023-11-28T21:11:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:729.out 2023-11-28T21:11:30.268 INFO:teuthology.orchestra.run.smithi006.stdout:730 2023-11-28T21:11:30.268 INFO:teuthology.orchestra.run.smithi006.stdout:730.out 2023-11-28T21:11:30.268 INFO:teuthology.orchestra.run.smithi006.stdout:731 2023-11-28T21:11:30.268 INFO:teuthology.orchestra.run.smithi006.stdout:731.out 2023-11-28T21:11:30.268 INFO:teuthology.orchestra.run.smithi006.stdout:732 2023-11-28T21:11:30.268 INFO:teuthology.orchestra.run.smithi006.stdout:732.out 2023-11-28T21:11:30.268 INFO:teuthology.orchestra.run.smithi006.stdout:group.list 2023-11-28T21:11:30.268 INFO:teuthology.orchestra.run.smithi006.stdout:Makefile 2023-11-28T21:11:30.269 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-11-28T21:11:30.662 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:11:30.673 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:11:30.674 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:35.100 INFO:teuthology.orchestra.run.smithi006.stdout:generic/001 5s 2023-11-28T21:11:35.112 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/001 2023-11-28T21:11:35.112 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:11:35.119 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:35.122 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[47577]: fuse finished with error 0 and tester_r 0 2023-11-28T21:11:35.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:11:35.141 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-11-28T21:11:35.521 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:11:35.532 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:11:35.532 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:36.286 INFO:teuthology.orchestra.run.smithi006.stdout:generic/002 1s 2023-11-28T21:11:36.299 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/002 2023-11-28T21:11:36.299 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:11:36.305 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:36.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:11:36.336 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-11-28T21:11:36.714 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:11:36.724 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:11:36.724 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:37.014 INFO:teuthology.orchestra.run.smithi006.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:11:37.022 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/003 2023-11-28T21:11:37.023 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/003 2023-11-28T21:11:37.023 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:11:37.029 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:37.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:11:37.050 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-11-28T21:11:37.434 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:11:37.443 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:11:37.443 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:37.760 INFO:teuthology.orchestra.run.smithi006.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-28T21:11:37.769 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/004 2023-11-28T21:11:37.769 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/004 2023-11-28T21:11:37.769 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:11:37.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:37.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:11:37.796 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-11-28T21:11:38.168 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:11:38.179 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:11:38.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:generic/005 1s 2023-11-28T21:11:39.161 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/005 2023-11-28T21:11:39.161 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:11:39.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:39.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:11:39.191 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-11-28T21:11:39.609 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:11:39.619 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:11:39.619 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:11:39.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:39.846 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:09.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:09.902 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:16.013 INFO:teuthology.orchestra.run.smithi006.stdout:generic/006 37s 2023-11-28T21:12:16.366 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/006 2023-11-28T21:12:16.366 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:12:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:12:16.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:12:16.426 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-11-28T21:12:16.804 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:12:16.815 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:12:16.815 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:12:39.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:39.981 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:10.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:10.491 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:38.119 INFO:teuthology.orchestra.run.smithi006.stdout:generic/007 82s 2023-11-28T21:13:40.312 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/007 2023-11-28T21:13:40.313 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:13:40.319 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:13:40.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:13:40.342 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-11-28T21:13:40.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:40.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:40.985 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:13:40.996 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:13:40.996 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:13:42.753 INFO:teuthology.orchestra.run.smithi006.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T21:13:42.761 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/008 2023-11-28T21:13:42.762 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/008 2023-11-28T21:13:42.762 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:13:42.768 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:13:42.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:13:42.788 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-11-28T21:13:43.154 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:13:43.165 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:13:43.165 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:13:44.673 INFO:teuthology.orchestra.run.smithi006.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T21:13:44.682 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/009 2023-11-28T21:13:44.682 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/009 2023-11-28T21:13:44.682 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:13:44.689 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:13:44.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:13:44.710 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-11-28T21:13:45.106 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:13:45.117 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:13:45.117 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:13:45.442 INFO:teuthology.orchestra.run.smithi006.stdout:generic/010 [not run] /tmp/tmp.TCCktrMdx7xfstests-dev/src/dbtest not built 2023-11-28T21:13:45.450 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/010 2023-11-28T21:13:45.450 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/010 2023-11-28T21:13:45.450 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:13:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:13:45.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:13:45.477 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-11-28T21:13:45.873 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:13:45.883 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:13:45.884 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:14:11.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:11.797 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:26.899 INFO:teuthology.orchestra.run.smithi006.stdout:generic/011 41s 2023-11-28T21:14:26.912 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/011 2023-11-28T21:14:26.912 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:14:26.918 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:14:26.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:14:26.944 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-11-28T21:14:27.360 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:14:27.370 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:14:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:14:29.070 INFO:teuthology.orchestra.run.smithi006.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T21:14:29.078 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/012 2023-11-28T21:14:29.078 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/012 2023-11-28T21:14:29.079 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:14:29.085 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:14:29.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:14:29.114 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-11-28T21:14:29.537 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:14:35.032 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:14:35.033 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:14:41.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:41.857 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:11.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:11.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:42.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:42.012 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:12.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:12.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:21.598 INFO:teuthology.orchestra.run.smithi006.stdout:generic/013 112s 2023-11-28T21:16:22.789 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/013 2023-11-28T21:16:22.789 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:16:22.800 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:16:22.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:16:22.835 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-11-28T21:16:23.465 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:16:23.484 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:16:23.484 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:16:42.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:42.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:42.678 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-28T21:16:42.670+0000 7f18273dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 91718) UID: 0 2023-11-28T21:16:42.678 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-28T21:16:42.670+0000 7f12f141c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 91718) UID: 0 2023-11-28T21:20:28.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:28.012 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:58.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:58.107 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:13.114 INFO:teuthology.orchestra.run.smithi006.stdout:generic/014 290s 2023-11-28T21:21:15.975 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/014 2023-11-28T21:21:15.975 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:15.976 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:15.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:15.976 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-11-28T21:21:16.534 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:16.551 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:16.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:16.965 INFO:teuthology.orchestra.run.smithi006.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:21:16.978 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/015 2023-11-28T21:21:16.978 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/015 2023-11-28T21:21:16.978 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:16.986 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:17.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:17.017 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-11-28T21:21:17.583 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:17.601 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:17.601 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T21:21:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/016 2023-11-28T21:21:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/016 2023-11-28T21:21:20.262 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:20.273 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:20.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:20.369 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-11-28T21:21:21.205 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:21.228 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:21.228 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:21.667 INFO:teuthology.orchestra.run.smithi006.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:21:21.679 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/017 2023-11-28T21:21:21.679 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/017 2023-11-28T21:21:21.679 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:21.689 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:21.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:21.724 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-11-28T21:21:22.298 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:22.314 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:22.314 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:22.737 INFO:teuthology.orchestra.run.smithi006.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:21:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/018 2023-11-28T21:21:22.751 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/018 2023-11-28T21:21:22.751 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:22.761 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:22.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:22.795 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-11-28T21:21:23.322 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:23.340 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:23.340 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:23.784 INFO:teuthology.orchestra.run.smithi006.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:21:23.796 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/019 2023-11-28T21:21:23.796 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/019 2023-11-28T21:21:23.796 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:23.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:23.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:23.836 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-11-28T21:21:24.416 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:24.434 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:24.434 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:28.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:28.186 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:41.506 INFO:teuthology.orchestra.run.smithi006.stdout:generic/020 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/020.out.bad) 2023-11-28T21:21:41.514 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/020.out 2023-11-28 21:09:26.530876338 +0000 2023-11-28T21:21:41.514 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/020.out.bad 2023-11-28 21:21:41.495795466 +0000 2023-11-28T21:21:41.514 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -47,9 +47,13 @@ 2023-11-28T21:21:41.514 INFO:teuthology.orchestra.run.smithi006.stdout: user.snrub="fish2\012" 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: *** really long value 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: -0000000 00 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: -* 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: -ATTRSIZE 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: +attr_set: No space left on device 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: +Could not set "long_attr" for 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: +attr_get: No data available 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: +Could not get "long_attr" for 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: +0000000 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: +attr_remove: No data available 2023-11-28T21:21:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: +Could not remove "long_attr" for 2023-11-28T21:21:41.516 INFO:teuthology.orchestra.run.smithi006.stdout: *** set/get/remove really long names (expect failure) 2023-11-28T21:21:41.516 INFO:teuthology.orchestra.run.smithi006.stdout: attr_set: Invalid argument 2023-11-28T21:21:41.516 INFO:teuthology.orchestra.run.smithi006.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-11-28T21:21:41.521 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/020 2023-11-28T21:21:41.521 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/020 2023-11-28T21:21:41.521 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T21:21:41.529 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:41.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T21:21:41.662 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T21:21:41.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T21:21:41.662 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-11-28T21:21:42.410 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:42.426 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:44.915 INFO:teuthology.orchestra.run.smithi006.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T21:21:44.927 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/021 2023-11-28T21:21:44.928 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/021 2023-11-28T21:21:44.928 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:44.937 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:45.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:45.015 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-11-28T21:21:45.813 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:45.829 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:45.829 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:48.602 INFO:teuthology.orchestra.run.smithi006.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T21:21:48.614 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/022 2023-11-28T21:21:48.614 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/022 2023-11-28T21:21:48.615 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:48.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:48.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:48.823 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-11-28T21:21:49.502 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:49.522 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:49.522 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:52.540 INFO:teuthology.orchestra.run.smithi006.stdout:generic/023 3s 2023-11-28T21:21:52.562 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/023 2023-11-28T21:21:52.562 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:52.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:52.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:52.620 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-11-28T21:21:53.501 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:53.517 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:54.027 INFO:teuthology.orchestra.run.smithi006.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-28T21:21:54.039 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/024 2023-11-28T21:21:54.039 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/024 2023-11-28T21:21:54.039 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:54.047 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:54.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:54.102 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-11-28T21:21:54.933 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:54.951 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:55.445 INFO:teuthology.orchestra.run.smithi006.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-28T21:21:55.463 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/025 2023-11-28T21:21:55.463 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/025 2023-11-28T21:21:55.463 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:55.473 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:55.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:55.519 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-11-28T21:21:56.357 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:56.373 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:56.373 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:56.990 INFO:teuthology.orchestra.run.smithi006.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T21:21:57.004 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/026 2023-11-28T21:21:57.004 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/026 2023-11-28T21:21:57.004 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:57.013 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:57.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:57.045 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-11-28T21:21:57.614 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:57.632 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:57.632 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:58.036 INFO:teuthology.orchestra.run.smithi006.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:21:58.049 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/027 2023-11-28T21:21:58.049 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/027 2023-11-28T21:21:58.049 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:21:58.058 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:21:58.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:21:58.084 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-11-28T21:21:58.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:58.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:58.664 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:21:58.681 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:21:58.681 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:04.154 INFO:teuthology.orchestra.run.smithi006.stdout:generic/028 6s 2023-11-28T21:22:04.172 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/028 2023-11-28T21:22:04.172 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:04.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:04.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:04.212 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-11-28T21:22:04.775 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:04.793 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:04.793 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:05.207 INFO:teuthology.orchestra.run.smithi006.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:05.225 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/029 2023-11-28T21:22:05.226 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/029 2023-11-28T21:22:05.226 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:05.234 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:05.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:05.262 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-11-28T21:22:05.850 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:05.864 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:05.865 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:06.258 INFO:teuthology.orchestra.run.smithi006.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:06.269 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/030 2023-11-28T21:22:06.270 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/030 2023-11-28T21:22:06.270 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:06.279 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:06.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:06.311 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-11-28T21:22:06.860 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:06.876 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:06.876 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:07.265 INFO:teuthology.orchestra.run.smithi006.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:07.277 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/031 2023-11-28T21:22:07.277 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/031 2023-11-28T21:22:07.277 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:07.286 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:07.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:07.315 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-11-28T21:22:07.873 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:07.889 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:07.889 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:08.284 INFO:teuthology.orchestra.run.smithi006.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:08.298 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/032 2023-11-28T21:22:08.298 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/032 2023-11-28T21:22:08.298 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:08.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:08.345 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-11-28T21:22:08.907 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:08.924 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:09.318 INFO:teuthology.orchestra.run.smithi006.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:09.330 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/033 2023-11-28T21:22:09.331 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/033 2023-11-28T21:22:09.331 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:09.341 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:09.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:09.373 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-11-28T21:22:09.950 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:09.966 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:09.966 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:10.402 INFO:teuthology.orchestra.run.smithi006.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:10.416 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/034 2023-11-28T21:22:10.417 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/034 2023-11-28T21:22:10.417 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:10.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:10.502 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-11-28T21:22:11.064 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:11.080 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:11.081 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:11.656 INFO:teuthology.orchestra.run.smithi006.stdout:generic/035 0s 2023-11-28T21:22:11.678 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/035 2023-11-28T21:22:11.678 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:11.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:11.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:11.763 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-11-28T21:22:12.541 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:12.555 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:23.275 INFO:teuthology.orchestra.run.smithi006.stdout:generic/036 11s 2023-11-28T21:22:23.291 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/036 2023-11-28T21:22:23.291 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:23.302 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:23.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:23.458 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-11-28T21:22:24.204 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:24.220 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:24.221 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:24.640 INFO:teuthology.orchestra.run.smithi006.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:24.654 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/037 2023-11-28T21:22:24.654 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/037 2023-11-28T21:22:24.654 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:24.664 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:24.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:24.690 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-11-28T21:22:25.252 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:25.267 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:25.267 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:25.687 INFO:teuthology.orchestra.run.smithi006.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:25.701 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/038 2023-11-28T21:22:25.701 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/038 2023-11-28T21:22:25.702 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:25.710 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:25.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:25.746 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-11-28T21:22:26.309 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:26.324 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:26.324 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:26.768 INFO:teuthology.orchestra.run.smithi006.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:26.781 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/039 2023-11-28T21:22:26.781 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/039 2023-11-28T21:22:26.781 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:26.791 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:26.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:26.826 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-11-28T21:22:27.383 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:27.410 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:27.889 INFO:teuthology.orchestra.run.smithi006.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:27.901 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/040 2023-11-28T21:22:27.902 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/040 2023-11-28T21:22:27.902 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:27.914 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:27.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:27.955 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-11-28T21:22:28.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:28.407 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:28.771 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:28.789 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:29.233 INFO:teuthology.orchestra.run.smithi006.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:29.244 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/041 2023-11-28T21:22:29.244 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/041 2023-11-28T21:22:29.244 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:29.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:29.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:29.283 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-11-28T21:22:29.865 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:29.880 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:29.880 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:30.306 INFO:teuthology.orchestra.run.smithi006.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:30.321 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/042 2023-11-28T21:22:30.321 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/042 2023-11-28T21:22:30.322 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:30.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:30.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:30.361 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-11-28T21:22:30.929 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:30.945 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:30.945 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:31.364 INFO:teuthology.orchestra.run.smithi006.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:31.376 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/043 2023-11-28T21:22:31.376 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/043 2023-11-28T21:22:31.376 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:31.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:31.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:31.416 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-11-28T21:22:32.009 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:32.026 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:32.026 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:32.436 INFO:teuthology.orchestra.run.smithi006.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:32.448 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/044 2023-11-28T21:22:32.448 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/044 2023-11-28T21:22:32.449 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:32.458 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:32.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:32.488 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-11-28T21:22:33.044 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:33.059 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:33.059 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/045 2023-11-28T21:22:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/045 2023-11-28T21:22:33.491 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:33.502 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:33.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:33.539 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-11-28T21:22:34.127 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:34.144 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:34.144 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:34.591 INFO:teuthology.orchestra.run.smithi006.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:34.599 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/046 2023-11-28T21:22:34.600 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/046 2023-11-28T21:22:34.600 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:34.606 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:34.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:34.627 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-11-28T21:22:34.984 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:35.057 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:35.058 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:35.294 INFO:teuthology.orchestra.run.smithi006.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:35.302 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/047 2023-11-28T21:22:35.302 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/047 2023-11-28T21:22:35.303 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:35.309 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:35.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:35.363 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-11-28T21:22:35.740 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:35.750 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:35.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:36.057 INFO:teuthology.orchestra.run.smithi006.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:36.066 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/048 2023-11-28T21:22:36.066 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/048 2023-11-28T21:22:36.066 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:36.072 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:36.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:36.093 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-11-28T21:22:36.464 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:36.475 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:36.476 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:36.769 INFO:teuthology.orchestra.run.smithi006.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:36.775 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/049 2023-11-28T21:22:36.776 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/049 2023-11-28T21:22:36.776 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:36.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:36.803 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-11-28T21:22:37.172 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:37.183 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:37.183 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:37.459 INFO:teuthology.orchestra.run.smithi006.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:37.468 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/050 2023-11-28T21:22:37.468 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/050 2023-11-28T21:22:37.468 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:37.474 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:37.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:37.543 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-11-28T21:22:37.928 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:37.939 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:37.939 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:38.230 INFO:teuthology.orchestra.run.smithi006.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:38.238 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/051 2023-11-28T21:22:38.238 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/051 2023-11-28T21:22:38.239 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:38.244 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:38.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:38.264 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-11-28T21:22:38.651 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:38.659 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:38.660 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:38.965 INFO:teuthology.orchestra.run.smithi006.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:38.973 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/052 2023-11-28T21:22:38.974 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/052 2023-11-28T21:22:38.974 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:38.980 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:38.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:38.999 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-11-28T21:22:39.360 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:39.371 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:39.371 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:39.672 INFO:teuthology.orchestra.run.smithi006.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:39.681 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/053 2023-11-28T21:22:39.681 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/053 2023-11-28T21:22:39.682 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:39.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:39.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:39.755 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-11-28T21:22:40.128 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:40.139 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:40.425 INFO:teuthology.orchestra.run.smithi006.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:40.434 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/054 2023-11-28T21:22:40.434 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/054 2023-11-28T21:22:40.434 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:40.440 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:40.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:40.460 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-11-28T21:22:40.848 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:40.859 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:40.859 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:41.142 INFO:teuthology.orchestra.run.smithi006.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:41.150 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/055 2023-11-28T21:22:41.150 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/055 2023-11-28T21:22:41.150 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:41.157 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:41.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:41.177 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-11-28T21:22:41.552 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:41.563 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:41.870 INFO:teuthology.orchestra.run.smithi006.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:41.878 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/056 2023-11-28T21:22:41.879 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/056 2023-11-28T21:22:41.879 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:41.885 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:41.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:41.905 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-11-28T21:22:42.300 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:42.310 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:42.607 INFO:teuthology.orchestra.run.smithi006.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:42.615 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/057 2023-11-28T21:22:42.616 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/057 2023-11-28T21:22:42.616 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:42.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:42.642 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-11-28T21:22:43.013 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:43.023 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:43.024 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:44.630 INFO:teuthology.orchestra.run.smithi006.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T21:22:44.639 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/058 2023-11-28T21:22:44.639 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/058 2023-11-28T21:22:44.639 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:44.645 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:44.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:44.695 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-11-28T21:22:45.344 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:45.355 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:45.688 INFO:teuthology.orchestra.run.smithi006.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:45.697 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/059 2023-11-28T21:22:45.697 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/059 2023-11-28T21:22:45.697 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:45.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:45.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:45.723 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-11-28T21:22:46.114 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:46.124 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:46.124 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:47.697 INFO:teuthology.orchestra.run.smithi006.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T21:22:47.706 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/060 2023-11-28T21:22:47.706 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/060 2023-11-28T21:22:47.706 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:47.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:47.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:47.772 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-11-28T21:22:48.402 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:48.412 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:49.981 INFO:teuthology.orchestra.run.smithi006.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T21:22:49.989 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/061 2023-11-28T21:22:49.989 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/061 2023-11-28T21:22:49.990 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:49.996 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:50.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:50.037 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-11-28T21:22:50.696 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:50.707 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:50.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:50.998 INFO:teuthology.orchestra.run.smithi006.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:51.006 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/062 2023-11-28T21:22:51.007 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/062 2023-11-28T21:22:51.007 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:51.013 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:51.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:51.032 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-11-28T21:22:51.409 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:51.419 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:51.420 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:52.972 INFO:teuthology.orchestra.run.smithi006.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T21:22:52.980 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/063 2023-11-28T21:22:52.980 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/063 2023-11-28T21:22:52.980 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:52.987 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:53.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:53.068 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-11-28T21:22:53.669 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:53.680 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:53.681 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:53.969 INFO:teuthology.orchestra.run.smithi006.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:53.977 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/064 2023-11-28T21:22:53.977 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/064 2023-11-28T21:22:53.977 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:54.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:54.004 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-11-28T21:22:54.364 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:54.374 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:54.671 INFO:teuthology.orchestra.run.smithi006.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:54.679 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/065 2023-11-28T21:22:54.679 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/065 2023-11-28T21:22:54.680 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:54.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:54.706 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-11-28T21:22:55.076 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:55.087 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:55.087 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:55.377 INFO:teuthology.orchestra.run.smithi006.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:55.386 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/066 2023-11-28T21:22:55.386 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/066 2023-11-28T21:22:55.386 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:55.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:55.412 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-11-28T21:22:55.776 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:55.787 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:55.787 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:56.110 INFO:teuthology.orchestra.run.smithi006.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:56.118 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/067 2023-11-28T21:22:56.119 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/067 2023-11-28T21:22:56.119 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:56.125 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:56.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:56.191 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-11-28T21:22:56.552 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:56.562 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:56.867 INFO:teuthology.orchestra.run.smithi006.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:56.876 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/068 2023-11-28T21:22:56.876 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/068 2023-11-28T21:22:56.876 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:56.882 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:56.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:56.939 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-11-28T21:22:57.334 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:57.345 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:57.345 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:57.624 INFO:teuthology.orchestra.run.smithi006.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:22:57.633 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/069 2023-11-28T21:22:57.633 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/069 2023-11-28T21:22:57.633 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:22:57.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:57.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:22:57.659 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-11-28T21:22:58.056 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:22:58.067 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:22:58.067 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:22:59.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:59.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:29.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:29.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:59.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:59.589 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:05.586 INFO:teuthology.orchestra.run.smithi006.stdout:generic/070 67s 2023-11-28T21:24:05.598 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/070 2023-11-28T21:24:05.598 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:24:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:24:05.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:24:05.653 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-11-28T21:24:06.483 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:24:06.501 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:24:06.502 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:24:06.918 INFO:teuthology.orchestra.run.smithi006.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:24:06.932 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/071 2023-11-28T21:24:06.932 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/071 2023-11-28T21:24:06.933 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:24:06.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:24:06.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:24:06.976 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-11-28T21:24:07.566 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:24:07.582 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:24:07.582 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:24:10.167 INFO:teuthology.orchestra.run.smithi006.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-28T21:24:10.180 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/072 2023-11-28T21:24:10.180 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/072 2023-11-28T21:24:10.180 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:24:10.188 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:24:10.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:24:10.219 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-11-28T21:24:10.760 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:24:10.779 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:24:10.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:24:11.191 INFO:teuthology.orchestra.run.smithi006.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T21:24:11.206 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/073 2023-11-28T21:24:11.206 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/073 2023-11-28T21:24:11.207 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:24:11.215 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:24:11.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:24:11.248 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-11-28T21:24:11.829 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:24:11.845 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:24:11.845 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:24:29.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:29.648 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:59.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:59.746 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:29.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:29.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:59.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:59.905 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:29.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:29.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:00.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:00.130 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:30.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:30.319 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:00.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:00.661 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:30.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:30.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:00.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:00.826 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:31.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:31.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:02.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:02.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:32.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:32.905 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:02.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:02.990 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:33.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:33.077 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:03.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:03.264 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:33.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:33.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:03.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:03.426 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:33.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:33.550 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:03.772 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:03.777 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:33.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:33.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:04.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:04.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:34.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:34.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:04.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:04.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:34.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:34.399 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:04.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:04.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:34.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:34.536 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:04.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:04.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:35.507 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:35.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:05.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:05.596 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:35.663 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:35.669 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:05.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:05.737 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:36.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:36.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:06.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:06.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:36.956 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:36.960 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:07.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:07.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:38.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:38.380 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:08.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:08.482 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:38.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:38.552 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:08.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:08.716 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:38.817 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:40.068 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:10.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:10.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:40.644 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:40.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:10.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:10.741 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:40.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:40.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:11.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:11.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:41.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:41.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:11.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:11.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:41.802 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:41.809 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:41.871 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-28T21:48:41.868+0000 7f2a876be640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44910) UID: 0 2023-11-28T21:48:41.872 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T21:48:41.868+0000 7f7b17a67640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44910) UID: 0 2023-11-28T21:48:41.872 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-28T21:48:41.868+0000 7fb8081c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44910) UID: 0 2023-11-28T21:48:41.872 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-28T21:48:41.868+0000 7f7a6b89b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44910) UID: 0 2023-11-28T21:52:04.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:04.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:04.699 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-28T21:52:04.697+0000 7fef6c324640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124055) UID: 0 2023-11-28T21:52:04.700 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-28T21:52:04.697+0000 7fdf27920640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124055) UID: 0 2023-11-28T21:52:04.700 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-28T21:52:04.697+0000 7fe93040a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124055) UID: 0 2023-11-28T21:52:04.700 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-28T21:52:04.697+0000 7fd4b5852640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124055) UID: 0 2023-11-28T21:56:12.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:13.489 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:43.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:43.572 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:13.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:13.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:13.845 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-28T21:57:13.840+0000 7f2a876be640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44949) UID: 0 2023-11-28T21:57:13.845 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T21:57:13.840+0000 7f7b17a67640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44949) UID: 0 2023-11-28T21:57:13.846 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-28T21:57:13.840+0000 7fb8081c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44949) UID: 0 2023-11-28T21:57:13.846 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-28T21:57:13.840+0000 7f7a6b89b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44949) UID: 0 2023-11-28T21:59:12.441 INFO:teuthology.orchestra.run.smithi006.stdout:generic/074 2101s 2023-11-28T21:59:12.527 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/074 2023-11-28T21:59:12.527 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:59:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:59:12.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:59:12.602 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-11-28T21:59:13.541 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T21:59:13.549 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:59:13.550 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:59:59.285 INFO:teuthology.orchestra.run.smithi006.stdout:generic/075 46s 2023-11-28T21:59:59.298 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/075 2023-11-28T21:59:59.298 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T21:59:59.305 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T21:59:59.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:59:59.486 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-11-28T22:00:00.045 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:00.062 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:00.373 INFO:teuthology.orchestra.run.smithi006.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:00:00.382 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/076 2023-11-28T22:00:00.383 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/076 2023-11-28T22:00:00.383 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:00.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:00.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:00.414 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-11-28T22:00:00.805 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:00.815 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:00.815 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:01.977 INFO:teuthology.orchestra.run.smithi006.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:00:01.986 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/077 2023-11-28T22:00:01.986 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/077 2023-11-28T22:00:01.986 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:01.993 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:02.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:02.013 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-11-28T22:00:02.388 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:02.399 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:02.399 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-28T22:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/078 2023-11-28T22:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/078 2023-11-28T22:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:02.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:02.821 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-11-28T22:00:03.476 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:03.487 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:03.487 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:03.834 INFO:teuthology.orchestra.run.smithi006.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-28T22:00:03.842 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/079 2023-11-28T22:00:03.842 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/079 2023-11-28T22:00:03.842 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:03.849 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:03.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:03.870 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-11-28T22:00:04.245 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:04.256 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:04.256 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:06.656 INFO:teuthology.orchestra.run.smithi006.stdout:generic/080 2s 2023-11-28T22:00:06.670 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/080 2023-11-28T22:00:06.670 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:06.677 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:06.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:06.698 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-11-28T22:00:07.080 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:07.091 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:07.091 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:07.393 INFO:teuthology.orchestra.run.smithi006.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:00:07.402 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/081 2023-11-28T22:00:07.402 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/081 2023-11-28T22:00:07.402 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:07.408 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:07.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:07.428 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-11-28T22:00:07.824 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:07.835 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:07.835 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:08.133 INFO:teuthology.orchestra.run.smithi006.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:00:08.141 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/082 2023-11-28T22:00:08.142 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/082 2023-11-28T22:00:08.142 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:08.148 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:08.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:08.168 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-11-28T22:00:08.534 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:08.545 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:08.545 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:08.831 INFO:teuthology.orchestra.run.smithi006.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:00:08.840 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/083 2023-11-28T22:00:08.840 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/083 2023-11-28T22:00:08.840 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:08.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:08.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:08.866 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-11-28T22:00:09.249 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:09.260 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:09.260 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:09.532 INFO:teuthology.orchestra.run.smithi006.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:00:09.542 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/084 2023-11-28T22:00:09.542 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/084 2023-11-28T22:00:09.542 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:09.547 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:09.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:09.567 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-11-28T22:00:09.929 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:09.940 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:09.940 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:10.259 INFO:teuthology.orchestra.run.smithi006.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:00:10.267 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/085 2023-11-28T22:00:10.267 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/085 2023-11-28T22:00:10.268 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:10.274 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:10.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:10.295 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-11-28T22:00:10.684 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:10.695 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:10.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:11.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:11.678 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:11.711 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-28T22:00:11.709+0000 7f2a876be640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44957) UID: 0 2023-11-28T22:00:11.711 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-28T22:00:11.709+0000 7fb8081c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44957) UID: 0 2023-11-28T22:00:11.712 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T22:00:11.709+0000 7f7b17a67640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44957) UID: 0 2023-11-28T22:00:11.712 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-28T22:00:11.709+0000 7f7a6b89b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44957) UID: 0 2023-11-28T22:00:27.563 INFO:teuthology.orchestra.run.smithi006.stdout:generic/086 17s 2023-11-28T22:00:27.820 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/086 2023-11-28T22:00:27.820 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:27.820 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:27.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:27.821 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-11-28T22:00:29.538 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:29.549 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:29.549 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:30.230 INFO:teuthology.orchestra.run.smithi006.stdout:generic/087 1s 2023-11-28T22:00:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/087 2023-11-28T22:00:30.243 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:30.250 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:30.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:30.297 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-11-28T22:00:30.958 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:30.968 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:30.969 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:31.370 INFO:teuthology.orchestra.run.smithi006.stdout:generic/088 1s 2023-11-28T22:00:31.383 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/088 2023-11-28T22:00:31.384 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:00:31.390 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:00:31.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:00:31.448 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-11-28T22:00:32.096 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:00:32.107 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:00:32.107 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:02:57.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:57.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:29.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:29.288 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:59.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:59.344 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:59.388 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-28T22:03:59.385+0000 7f18273dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 131993) UID: 0 2023-11-28T22:03:59.388 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-28T22:03:59.385+0000 7f12f141c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 131993) UID: 0 2023-11-28T22:07:21.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:21.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:51.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:51.942 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:22.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:22.024 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:52.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:52.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:52.131 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-28T22:08:52.126+0000 7f18273dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 132226) UID: 0 2023-11-28T22:08:52.132 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-28T22:08:52.126+0000 7f12f141c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 132226) UID: 0 2023-11-28T22:11:51.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:51.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:52.027 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-28T22:11:52.025+0000 7fd4b5852640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132235) UID: 0 2023-11-28T22:11:52.027 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-28T22:11:52.025+0000 7fef6c324640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132235) UID: 0 2023-11-28T22:11:52.028 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-28T22:11:52.025+0000 7fe93040a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132235) UID: 0 2023-11-28T22:11:52.028 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-28T22:11:52.025+0000 7fdf27920640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132235) UID: 0 2023-11-28T22:15:48.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:48.235 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:48.668 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-28T22:15:48.666+0000 7f18273dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 134260) UID: 0 2023-11-28T22:15:48.668 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-28T22:15:48.666+0000 7f12f141c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 134260) UID: 0 2023-11-28T22:19:38.946 INFO:teuthology.orchestra.run.smithi006.stdout:generic/089 1146s 2023-11-28T22:19:38.993 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/089 2023-11-28T22:19:38.993 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:19:38.999 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:19:39.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:19:39.030 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-11-28T22:19:40.168 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:19:40.178 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:19:40.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:19:40.546 INFO:teuthology.orchestra.run.smithi006.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:19:40.555 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/090 2023-11-28T22:19:40.555 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/090 2023-11-28T22:19:40.555 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:19:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:19:40.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:19:40.582 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-11-28T22:19:40.960 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:19:40.970 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:19:40.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:20:27.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:27.963 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:58.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:58.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:28.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:28.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:57.539 INFO:teuthology.orchestra.run.smithi006.stdout:generic/091 137s 2023-11-28T22:21:57.552 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/091 2023-11-28T22:21:57.552 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:21:57.558 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:21:57.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:21:57.594 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-11-28T22:21:58.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:58.209 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:58.253 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:21:58.264 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:21:58.264 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:21:58.943 INFO:teuthology.orchestra.run.smithi006.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T22:21:58.952 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/092 2023-11-28T22:21:58.952 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/092 2023-11-28T22:21:58.952 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:21:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:21:59.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:21:59.007 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-11-28T22:21:59.709 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:21:59.719 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:21:59.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:00.866 INFO:teuthology.orchestra.run.smithi006.stdout:generic/093 1s 2023-11-28T22:22:00.878 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/093 2023-11-28T22:22:00.878 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:00.885 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:00.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:00.933 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-11-28T22:22:01.602 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:01.613 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:01.900 INFO:teuthology.orchestra.run.smithi006.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:22:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/094 2023-11-28T22:22:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/094 2023-11-28T22:22:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:01.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:01.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:01.936 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-11-28T22:22:02.317 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:02.327 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:02.328 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:02.648 INFO:teuthology.orchestra.run.smithi006.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:22:02.656 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/095 2023-11-28T22:22:02.656 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/095 2023-11-28T22:22:02.656 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:02.662 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:02.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:02.684 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-11-28T22:22:03.065 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:03.075 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:03.075 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:03.381 INFO:teuthology.orchestra.run.smithi006.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:22:03.389 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/096 2023-11-28T22:22:03.389 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/096 2023-11-28T22:22:03.390 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:03.396 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:03.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:03.416 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-11-28T22:22:03.785 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:03.796 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:03.796 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:04.700 INFO:teuthology.orchestra.run.smithi006.stdout:generic/097 1s 2023-11-28T22:22:04.713 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/097 2023-11-28T22:22:04.713 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:04.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:04.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:04.738 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-11-28T22:22:05.120 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:05.131 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:05.131 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:05.400 INFO:teuthology.orchestra.run.smithi006.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:22:05.408 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/098 2023-11-28T22:22:05.408 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/098 2023-11-28T22:22:05.409 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:05.415 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:05.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:05.436 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-11-28T22:22:05.832 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:05.842 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:05.843 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:06.221 INFO:teuthology.orchestra.run.smithi006.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T22:22:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/099 2023-11-28T22:22:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/099 2023-11-28T22:22:06.230 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:06.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:06.255 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-11-28T22:22:06.614 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:06.625 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:06.625 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:28.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:28.265 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:55.758 INFO:teuthology.orchestra.run.smithi006.stdout:generic/100 49s 2023-11-28T22:22:55.770 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/100 2023-11-28T22:22:55.771 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:55.777 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:55.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:55.823 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-11-28T22:22:56.577 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:56.588 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:56.588 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:56.937 INFO:teuthology.orchestra.run.smithi006.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:22:56.946 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/101 2023-11-28T22:22:56.946 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/101 2023-11-28T22:22:56.946 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:56.952 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:56.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:56.974 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-11-28T22:22:57.358 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:57.369 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:57.369 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:57.652 INFO:teuthology.orchestra.run.smithi006.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:22:57.660 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/102 2023-11-28T22:22:57.660 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/102 2023-11-28T22:22:57.660 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:57.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:57.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:57.688 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-11-28T22:22:58.060 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:58.071 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:58.072 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:58.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:58.324 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:58.344 INFO:teuthology.orchestra.run.smithi006.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:22:58.353 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/103 2023-11-28T22:22:58.353 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/103 2023-11-28T22:22:58.353 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:58.358 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:58.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:58.380 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-11-28T22:22:58.804 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:58.815 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:59.108 INFO:teuthology.orchestra.run.smithi006.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:22:59.116 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/104 2023-11-28T22:22:59.116 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/104 2023-11-28T22:22:59.117 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:59.123 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:59.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:59.143 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-11-28T22:22:59.516 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:22:59.526 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:22:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:59.825 INFO:teuthology.orchestra.run.smithi006.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:22:59.833 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/105 2023-11-28T22:22:59.833 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/105 2023-11-28T22:22:59.834 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:22:59.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:22:59.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:22:59.861 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-11-28T22:23:00.260 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:23:00.270 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:23:00.270 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:00.569 INFO:teuthology.orchestra.run.smithi006.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:23:00.577 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/106 2023-11-28T22:23:00.577 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/106 2023-11-28T22:23:00.577 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:23:00.584 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:00.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:23:00.604 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-11-28T22:23:00.972 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:23:00.983 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:23:00.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:01.324 INFO:teuthology.orchestra.run.smithi006.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:23:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/107 2023-11-28T22:23:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/107 2023-11-28T22:23:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:23:01.339 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:01.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:23:01.359 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-11-28T22:23:01.747 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:23:01.757 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:23:01.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:03.759 INFO:teuthology.orchestra.run.smithi006.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:23:03.768 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/108 2023-11-28T22:23:03.768 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/108 2023-11-28T22:23:03.768 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:23:03.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:03.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:23:03.797 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-11-28T22:23:04.180 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:23:04.192 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:23:04.192 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:04.506 INFO:teuthology.orchestra.run.smithi006.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:23:04.515 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/109 2023-11-28T22:23:04.515 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/109 2023-11-28T22:23:04.515 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:23:04.521 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:04.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:23:04.541 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-11-28T22:23:04.920 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:23:04.930 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:23:04.930 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:05.298 INFO:teuthology.orchestra.run.smithi006.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:23:05.306 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/110 2023-11-28T22:23:05.306 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/110 2023-11-28T22:23:05.306 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:23:05.313 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:05.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:23:05.373 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-11-28T22:23:06.052 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:23:06.063 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:23:06.063 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:06.413 INFO:teuthology.orchestra.run.smithi006.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:23:06.421 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/111 2023-11-28T22:23:06.421 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/111 2023-11-28T22:23:06.421 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:23:06.427 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:06.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:23:06.456 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-11-28T22:23:07.144 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:23:07.155 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:23:07.155 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:28.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:28.384 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:58.117 INFO:teuthology.orchestra.run.smithi006.stdout:generic/112 51s 2023-11-28T22:23:58.130 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/112 2023-11-28T22:23:58.130 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:23:58.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:23:58.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:23:58.168 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-11-28T22:23:58.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:58.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:58.873 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:23:58.884 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:23:58.884 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:28.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:28.550 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:46.253 INFO:teuthology.orchestra.run.smithi006.stdout:generic/113 48s 2023-11-28T22:24:46.266 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/113 2023-11-28T22:24:46.266 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:46.273 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:46.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:46.331 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-11-28T22:24:47.045 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:47.056 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:47.056 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:47.482 INFO:teuthology.orchestra.run.smithi006.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-11-28T22:24:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/114 2023-11-28T22:24:47.491 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/114 2023-11-28T22:24:47.491 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:47.497 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:47.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:47.519 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-11-28T22:24:47.881 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:47.892 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:48.247 INFO:teuthology.orchestra.run.smithi006.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:24:48.256 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/115 2023-11-28T22:24:48.256 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/115 2023-11-28T22:24:48.256 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:48.262 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:48.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:48.298 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-11-28T22:24:48.977 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:48.988 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:48.988 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:49.356 INFO:teuthology.orchestra.run.smithi006.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:24:49.365 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/116 2023-11-28T22:24:49.365 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/116 2023-11-28T22:24:49.365 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:49.371 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:49.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:49.424 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-11-28T22:24:50.097 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:50.107 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:50.108 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:50.404 INFO:teuthology.orchestra.run.smithi006.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:24:50.413 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/117 2023-11-28T22:24:50.413 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/117 2023-11-28T22:24:50.413 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:50.419 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:50.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:50.439 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-11-28T22:24:50.804 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:50.816 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:50.816 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:51.172 INFO:teuthology.orchestra.run.smithi006.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:24:51.180 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/118 2023-11-28T22:24:51.180 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/118 2023-11-28T22:24:51.181 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:51.187 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:51.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:51.235 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-11-28T22:24:51.901 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:51.912 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:51.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:52.284 INFO:teuthology.orchestra.run.smithi006.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:24:52.292 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/119 2023-11-28T22:24:52.293 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/119 2023-11-28T22:24:52.293 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:52.299 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:52.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:52.429 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-11-28T22:24:53.048 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:53.058 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:53.059 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:53.337 INFO:teuthology.orchestra.run.smithi006.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:24:53.344 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/120 2023-11-28T22:24:53.345 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/120 2023-11-28T22:24:53.345 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:53.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:53.371 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-11-28T22:24:53.757 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:53.767 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:53.768 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:54.136 INFO:teuthology.orchestra.run.smithi006.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T22:24:54.145 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/121 2023-11-28T22:24:54.145 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/121 2023-11-28T22:24:54.145 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:54.151 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:54.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:54.204 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-11-28T22:24:54.893 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:54.904 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:55.305 INFO:teuthology.orchestra.run.smithi006.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T22:24:55.313 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/122 2023-11-28T22:24:55.314 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/122 2023-11-28T22:24:55.314 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:55.320 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:55.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:55.483 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-11-28T22:24:56.076 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:56.086 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:56.087 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:56.915 INFO:teuthology.orchestra.run.smithi006.stdout:generic/123 0s 2023-11-28T22:24:56.928 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/123 2023-11-28T22:24:56.928 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:56.935 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:56.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:56.967 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-11-28T22:24:57.684 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:57.695 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:57.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:57.980 INFO:teuthology.orchestra.run.smithi006.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:24:57.989 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/124 2023-11-28T22:24:57.989 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/124 2023-11-28T22:24:57.989 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:24:57.995 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:58.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:24:58.016 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-11-28T22:24:58.378 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:24:58.388 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:24:58.389 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:24:58.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:58.609 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:28.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:28.798 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:58.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:58.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:00.203 INFO:teuthology.orchestra.run.smithi006.stdout:generic/125 62s 2023-11-28T22:26:00.216 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/125 2023-11-28T22:26:00.216 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:26:00.222 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:26:00.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:26:00.291 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-11-28T22:26:00.941 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:26:00.951 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:26:00.952 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:26:01.816 INFO:teuthology.orchestra.run.smithi006.stdout:generic/126 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/126.out.bad) 2023-11-28T22:26:01.822 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/126.out 2023-11-28 21:09:26.546876213 +0000 2023-11-28T22:26:01.822 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/126.out.bad 2023-11-28 22:26:01.808473734 +0000 2023-11-28T22:26:01.822 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,7 +1,7 @@ 2023-11-28T22:26:01.822 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 126 2023-11-28T22:26:01.822 INFO:teuthology.orchestra.run.smithi006.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-11-28T22:26:01.822 INFO:teuthology.orchestra.run.smithi006.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-11-28T22:26:01.823 INFO:teuthology.orchestra.run.smithi006.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-11-28T22:26:01.823 INFO:teuthology.orchestra.run.smithi006.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-11-28T22:26:01.823 INFO:teuthology.orchestra.run.smithi006.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-11-28T22:26:01.823 INFO:teuthology.orchestra.run.smithi006.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-11-28T22:26:01.823 INFO:teuthology.orchestra.run.smithi006.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-11-28T22:26:01.823 INFO:teuthology.orchestra.run.smithi006.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-11-28T22:26:01.823 INFO:teuthology.orchestra.run.smithi006.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-11-28T22:26:01.828 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/126 2023-11-28T22:26:01.828 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/126 2023-11-28T22:26:01.828 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T22:26:01.834 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:26:01.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T22:26:01.855 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T22:26:01.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T22:26:01.856 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-11-28T22:26:02.609 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:26:02.619 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:26:02.619 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:26:28.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:28.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:58.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:58.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:29.049 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:29.053 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:59.105 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:59.109 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:29.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:29.181 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:59.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:59.237 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:29.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:29.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:59.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:59.348 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:29.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:29.404 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:29.431 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-28T22:30:29.429+0000 7fd4b5852640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 164915) UID: 0 2023-11-28T22:30:29.432 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-28T22:30:29.429+0000 7fef6c324640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 164915) UID: 0 2023-11-28T22:30:29.432 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-28T22:30:29.429+0000 7fe93040a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 164915) UID: 0 2023-11-28T22:30:29.432 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-28T22:30:29.429+0000 7fdf27920640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 164915) UID: 0 2023-11-28T22:33:15.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:33:15.462 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:33:45.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:33:45.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:15.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:15.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:45.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:45.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:15.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:15.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:45.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:45.817 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:16.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:16.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:46.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:46.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:46.761 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-28T22:36:46.758+0000 7f18273dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 164952) UID: 0 2023-11-28T22:36:46.762 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-28T22:36:46.758+0000 7f12f141c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 164952) UID: 0 2023-11-28T22:39:31.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:31.495 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:31.526 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-28T22:39:31.523+0000 7f2a876be640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45121) UID: 0 2023-11-28T22:39:31.526 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T22:39:31.523+0000 7f7b17a67640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45121) UID: 0 2023-11-28T22:39:31.526 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-28T22:39:31.523+0000 7fb8081c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45121) UID: 0 2023-11-28T22:39:31.527 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-28T22:39:31.527+0000 7f7a6b89b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45121) UID: 0 2023-11-28T22:41:43.954 INFO:teuthology.orchestra.run.smithi006.stdout:generic/127 941s 2023-11-28T22:41:43.966 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/127 2023-11-28T22:41:43.966 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:41:43.973 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:44.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:41:44.024 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-11-28T22:41:44.708 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:41:44.719 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:41:44.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:45.315 INFO:teuthology.orchestra.run.smithi006.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:41:45.323 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/128 2023-11-28T22:41:45.323 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/128 2023-11-28T22:41:45.324 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:41:45.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:45.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:41:45.349 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-11-28T22:41:45.736 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:41:45.747 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:41:45.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:46.043 INFO:teuthology.orchestra.run.smithi006.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:41:46.051 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/129 2023-11-28T22:41:46.051 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/129 2023-11-28T22:41:46.051 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:41:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:46.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:41:46.077 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-11-28T22:41:46.448 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:41:46.459 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:41:46.459 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:46.744 INFO:teuthology.orchestra.run.smithi006.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:41:46.752 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/130 2023-11-28T22:41:46.752 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/130 2023-11-28T22:41:46.752 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:41:46.759 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:46.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:41:46.778 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-11-28T22:41:47.144 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:41:47.154 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:41:47.154 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:48.682 INFO:teuthology.orchestra.run.smithi006.stdout:generic/131 1s 2023-11-28T22:41:48.695 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/131 2023-11-28T22:41:48.695 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:41:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:48.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:41:48.721 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-11-28T22:41:49.420 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:41:49.431 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:41:49.431 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:49.742 INFO:teuthology.orchestra.run.smithi006.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:41:49.751 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/132 2023-11-28T22:41:49.751 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/132 2023-11-28T22:41:49.751 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:41:49.757 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:41:49.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:41:49.777 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-11-28T22:41:50.143 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:41:50.154 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:41:50.154 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:42:16.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:16.307 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:46.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:46.372 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:16.414 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:16.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:46.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:46.474 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:16.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:16.541 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:46.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:52.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:22.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:22.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:52.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:52.680 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:55.398 INFO:teuthology.orchestra.run.smithi006.stdout:generic/133 245s 2023-11-28T22:45:55.411 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/133 2023-11-28T22:45:55.411 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:45:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:45:55.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:45:55.475 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-11-28T22:45:56.287 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:45:56.298 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:45:56.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:45:56.662 INFO:teuthology.orchestra.run.smithi006.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:45:56.670 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/134 2023-11-28T22:45:56.670 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/134 2023-11-28T22:45:56.671 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:45:56.677 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:45:56.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:45:56.710 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-11-28T22:45:57.404 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:45:57.414 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:45:57.414 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:45:57.758 INFO:teuthology.orchestra.run.smithi006.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:45:57.766 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/135 2023-11-28T22:45:57.766 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/135 2023-11-28T22:45:57.766 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:45:57.773 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:45:57.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:45:57.793 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-11-28T22:45:58.171 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:45:58.182 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:45:58.182 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:45:58.576 INFO:teuthology.orchestra.run.smithi006.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T22:45:58.584 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/136 2023-11-28T22:45:58.584 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/136 2023-11-28T22:45:58.584 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:45:58.591 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:45:58.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:45:58.629 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-11-28T22:45:59.327 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:45:59.338 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:45:59.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:45:59.708 INFO:teuthology.orchestra.run.smithi006.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:45:59.717 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/137 2023-11-28T22:45:59.717 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/137 2023-11-28T22:45:59.717 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:45:59.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:45:59.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:45:59.782 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-11-28T22:46:00.468 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:00.478 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:00.478 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:00.829 INFO:teuthology.orchestra.run.smithi006.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:00.837 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/138 2023-11-28T22:46:00.837 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/138 2023-11-28T22:46:00.837 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:00.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:00.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:00.876 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-11-28T22:46:01.593 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:01.603 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:01.604 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:01.963 INFO:teuthology.orchestra.run.smithi006.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:01.972 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/139 2023-11-28T22:46:01.972 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/139 2023-11-28T22:46:01.972 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:01.978 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:02.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:02.026 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-11-28T22:46:02.700 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:02.711 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:02.711 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:03.075 INFO:teuthology.orchestra.run.smithi006.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:03.083 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/140 2023-11-28T22:46:03.083 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/140 2023-11-28T22:46:03.083 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:03.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:03.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:03.119 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-11-28T22:46:03.823 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:03.834 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:03.834 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:04.109 INFO:teuthology.orchestra.run.smithi006.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:04.118 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/141 2023-11-28T22:46:04.118 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/141 2023-11-28T22:46:04.118 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:04.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:04.144 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-11-28T22:46:04.531 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:04.542 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:04.542 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:04.916 INFO:teuthology.orchestra.run.smithi006.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:04.924 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/142 2023-11-28T22:46:04.924 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/142 2023-11-28T22:46:04.924 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:04.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:04.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:04.974 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-11-28T22:46:05.648 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:05.658 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:05.658 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:06.024 INFO:teuthology.orchestra.run.smithi006.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/143 2023-11-28T22:46:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/143 2023-11-28T22:46:06.033 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:06.039 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:06.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:06.079 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-11-28T22:46:06.772 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:06.782 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:06.783 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:07.171 INFO:teuthology.orchestra.run.smithi006.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:07.179 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/144 2023-11-28T22:46:07.179 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/144 2023-11-28T22:46:07.179 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:07.186 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:07.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:07.242 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-11-28T22:46:07.912 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:07.923 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:07.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:08.308 INFO:teuthology.orchestra.run.smithi006.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:08.317 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/145 2023-11-28T22:46:08.317 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/145 2023-11-28T22:46:08.317 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:08.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:08.378 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-11-28T22:46:09.052 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:09.063 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:09.417 INFO:teuthology.orchestra.run.smithi006.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/146 2023-11-28T22:46:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/146 2023-11-28T22:46:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:09.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:09.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:09.607 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-11-28T22:46:10.165 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:10.176 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:10.176 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:10.533 INFO:teuthology.orchestra.run.smithi006.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:10.542 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/147 2023-11-28T22:46:10.542 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/147 2023-11-28T22:46:10.542 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:10.548 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:10.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:10.585 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-11-28T22:46:11.276 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:11.286 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:11.286 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:11.662 INFO:teuthology.orchestra.run.smithi006.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:11.671 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/148 2023-11-28T22:46:11.671 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/148 2023-11-28T22:46:11.671 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:11.678 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:11.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:11.715 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-11-28T22:46:12.420 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:12.431 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:12.431 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:12.807 INFO:teuthology.orchestra.run.smithi006.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:12.815 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/149 2023-11-28T22:46:12.815 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/149 2023-11-28T22:46:12.815 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:12.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:12.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:12.859 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-11-28T22:46:13.540 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:13.550 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:13.550 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:13.930 INFO:teuthology.orchestra.run.smithi006.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:13.937 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/150 2023-11-28T22:46:13.937 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/150 2023-11-28T22:46:13.937 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:13.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:13.982 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-11-28T22:46:14.675 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:14.686 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:15.056 INFO:teuthology.orchestra.run.smithi006.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:15.064 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/151 2023-11-28T22:46:15.065 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/151 2023-11-28T22:46:15.065 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:15.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:15.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:15.102 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-11-28T22:46:15.803 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:15.816 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:15.816 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:16.180 INFO:teuthology.orchestra.run.smithi006.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:16.188 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/152 2023-11-28T22:46:16.188 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/152 2023-11-28T22:46:16.188 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:16.195 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:16.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:16.227 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-11-28T22:46:16.903 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:16.914 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:16.914 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:17.285 INFO:teuthology.orchestra.run.smithi006.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:17.294 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/153 2023-11-28T22:46:17.294 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/153 2023-11-28T22:46:17.294 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:17.301 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:17.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:17.344 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-11-28T22:46:18.048 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:18.058 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:18.058 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:18.447 INFO:teuthology.orchestra.run.smithi006.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:18.455 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/154 2023-11-28T22:46:18.455 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/154 2023-11-28T22:46:18.455 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:18.462 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:18.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:18.512 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-11-28T22:46:19.184 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:19.195 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:19.195 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:19.550 INFO:teuthology.orchestra.run.smithi006.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:19.558 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/155 2023-11-28T22:46:19.558 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/155 2023-11-28T22:46:19.558 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:19.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:19.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:19.601 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-11-28T22:46:20.304 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:20.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:20.759 INFO:teuthology.orchestra.run.smithi006.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:20.767 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/156 2023-11-28T22:46:20.767 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/156 2023-11-28T22:46:20.767 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:20.773 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:20.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:20.814 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-11-28T22:46:21.524 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:21.534 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:21.898 INFO:teuthology.orchestra.run.smithi006.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:21.906 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/157 2023-11-28T22:46:21.906 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/157 2023-11-28T22:46:21.906 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:21.913 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:21.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:21.966 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-11-28T22:46:22.669 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:22.680 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:22.680 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:22.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:22.735 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:23.091 INFO:teuthology.orchestra.run.smithi006.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:23.099 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/158 2023-11-28T22:46:23.099 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/158 2023-11-28T22:46:23.099 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:23.105 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:23.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:23.143 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-11-28T22:46:23.812 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:23.823 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:23.823 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:24.208 INFO:teuthology.orchestra.run.smithi006.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-11-28T22:46:24.216 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/159 2023-11-28T22:46:24.216 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/159 2023-11-28T22:46:24.216 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:24.223 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:24.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:24.243 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-11-28T22:46:24.611 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:24.622 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:24.622 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:24.946 INFO:teuthology.orchestra.run.smithi006.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-11-28T22:46:24.954 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/160 2023-11-28T22:46:24.954 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/160 2023-11-28T22:46:24.954 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:24.960 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:24.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:24.981 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-11-28T22:46:25.380 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:25.391 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:25.688 INFO:teuthology.orchestra.run.smithi006.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:25.697 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/161 2023-11-28T22:46:25.697 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/161 2023-11-28T22:46:25.697 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:25.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:25.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:25.725 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-11-28T22:46:26.100 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:26.110 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:26.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:26.397 INFO:teuthology.orchestra.run.smithi006.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:26.405 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/162 2023-11-28T22:46:26.405 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/162 2023-11-28T22:46:26.405 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:26.412 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:26.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:26.432 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-11-28T22:46:26.823 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:26.834 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:26.834 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:27.122 INFO:teuthology.orchestra.run.smithi006.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:27.130 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/163 2023-11-28T22:46:27.130 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/163 2023-11-28T22:46:27.130 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:27.136 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:27.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:27.156 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-11-28T22:46:27.541 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:27.551 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:27.552 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:27.847 INFO:teuthology.orchestra.run.smithi006.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:27.855 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/164 2023-11-28T22:46:27.855 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/164 2023-11-28T22:46:27.855 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:27.862 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:27.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:27.881 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-11-28T22:46:28.255 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:28.266 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:28.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:28.535 INFO:teuthology.orchestra.run.smithi006.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:28.543 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/165 2023-11-28T22:46:28.543 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/165 2023-11-28T22:46:28.543 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:28.550 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:28.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:28.570 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-11-28T22:46:28.964 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:28.974 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:28.975 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:29.259 INFO:teuthology.orchestra.run.smithi006.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:29.267 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/166 2023-11-28T22:46:29.267 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/166 2023-11-28T22:46:29.267 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:29.274 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:29.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:29.293 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-11-28T22:46:29.691 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:29.702 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:29.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:30.012 INFO:teuthology.orchestra.run.smithi006.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:30.021 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/167 2023-11-28T22:46:30.021 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/167 2023-11-28T22:46:30.021 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:30.027 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:30.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:30.048 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-11-28T22:46:30.440 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:30.451 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:30.451 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:30.734 INFO:teuthology.orchestra.run.smithi006.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:30.743 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/168 2023-11-28T22:46:30.743 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/168 2023-11-28T22:46:30.743 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:30.749 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:30.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:30.769 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-11-28T22:46:31.167 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:31.178 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:31.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:31.454 INFO:teuthology.orchestra.run.smithi006.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:31.463 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/169 2023-11-28T22:46:31.463 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/169 2023-11-28T22:46:31.463 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:31.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:31.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:31.489 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-11-28T22:46:31.876 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:31.887 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:31.887 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:32.173 INFO:teuthology.orchestra.run.smithi006.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:32.181 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/170 2023-11-28T22:46:32.181 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/170 2023-11-28T22:46:32.181 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:32.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:32.207 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-11-28T22:46:32.568 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:32.579 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:32.579 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:32.876 INFO:teuthology.orchestra.run.smithi006.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:32.885 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/171 2023-11-28T22:46:32.885 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/171 2023-11-28T22:46:32.885 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:32.891 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:32.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:32.911 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-11-28T22:46:33.279 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:33.289 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:33.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:33.595 INFO:teuthology.orchestra.run.smithi006.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/172 2023-11-28T22:46:33.603 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/172 2023-11-28T22:46:33.604 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:33.610 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:33.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:33.629 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-11-28T22:46:33.995 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:34.006 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:34.006 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:34.299 INFO:teuthology.orchestra.run.smithi006.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:34.308 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/173 2023-11-28T22:46:34.308 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/173 2023-11-28T22:46:34.308 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:34.314 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:34.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:34.335 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-11-28T22:46:34.715 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:34.726 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:34.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:35.017 INFO:teuthology.orchestra.run.smithi006.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:35.026 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/174 2023-11-28T22:46:35.026 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/174 2023-11-28T22:46:35.026 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:35.032 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:35.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:35.052 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-11-28T22:46:35.432 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:35.442 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:35.443 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:35.733 INFO:teuthology.orchestra.run.smithi006.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:35.741 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/175 2023-11-28T22:46:35.742 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/175 2023-11-28T22:46:35.742 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:35.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:35.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:35.767 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-11-28T22:46:36.135 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:36.146 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:36.441 INFO:teuthology.orchestra.run.smithi006.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:36.449 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/176 2023-11-28T22:46:36.449 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/176 2023-11-28T22:46:36.449 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:36.455 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:36.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:36.475 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-11-28T22:46:36.848 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:36.858 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:36.858 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:37.188 INFO:teuthology.orchestra.run.smithi006.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:37.196 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/177 2023-11-28T22:46:37.196 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/177 2023-11-28T22:46:37.196 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:37.203 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:37.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:37.270 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-11-28T22:46:37.677 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:37.688 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:37.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:38.046 INFO:teuthology.orchestra.run.smithi006.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:38.055 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/178 2023-11-28T22:46:38.055 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/178 2023-11-28T22:46:38.055 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:38.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:38.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:38.108 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-11-28T22:46:38.748 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:38.758 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:38.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:39.108 INFO:teuthology.orchestra.run.smithi006.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:39.117 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/179 2023-11-28T22:46:39.117 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/179 2023-11-28T22:46:39.117 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:39.123 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:39.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:39.182 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-11-28T22:46:39.862 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:39.873 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:39.873 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:40.236 INFO:teuthology.orchestra.run.smithi006.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:40.244 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/180 2023-11-28T22:46:40.244 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/180 2023-11-28T22:46:40.244 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:40.251 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:40.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:40.282 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-11-28T22:46:40.975 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:40.986 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:40.986 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:41.360 INFO:teuthology.orchestra.run.smithi006.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:41.368 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/181 2023-11-28T22:46:41.369 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/181 2023-11-28T22:46:41.369 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:41.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:41.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:41.402 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-11-28T22:46:42.108 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:42.119 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:42.476 INFO:teuthology.orchestra.run.smithi006.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T22:46:42.484 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/182 2023-11-28T22:46:42.484 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/182 2023-11-28T22:46:42.485 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:42.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:42.660 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-11-28T22:46:43.223 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:43.234 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:43.234 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:43.532 INFO:teuthology.orchestra.run.smithi006.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:43.541 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/183 2023-11-28T22:46:43.541 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/183 2023-11-28T22:46:43.541 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:43.548 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:43.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:43.567 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-11-28T22:46:43.932 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:43.943 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:43.943 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:44.535 INFO:teuthology.orchestra.run.smithi006.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/184.out.bad) 2023-11-28T22:46:44.540 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/184.out 2023-11-28 21:09:26.554876150 +0000 2023-11-28T22:46:44.540 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/184.out.bad 2023-11-28 22:46:44.528134493 +0000 2023-11-28T22:46:44.540 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1 +1,2 @@ 2023-11-28T22:46:44.541 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 184 2023-11-28T22:46:44.541 INFO:teuthology.orchestra.run.smithi006.stdout: +/tmp/tmp.TCCktrMdx7xfstests-dev/tests/generic/184: line 23: /tmp/tmp.Vq8HeyZOWwtest/null: Permission denied 2023-11-28T22:46:44.546 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/184 2023-11-28T22:46:44.546 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/184 2023-11-28T22:46:44.546 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T22:46:44.553 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:44.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T22:46:44.571 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T22:46:44.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T22:46:44.572 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-11-28T22:46:44.948 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:44.959 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:44.959 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:45.238 INFO:teuthology.orchestra.run.smithi006.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:45.246 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/185 2023-11-28T22:46:45.246 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/185 2023-11-28T22:46:45.246 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:45.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:45.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:45.273 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-11-28T22:46:45.635 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:45.646 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:45.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:45.916 INFO:teuthology.orchestra.run.smithi006.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:45.924 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/186 2023-11-28T22:46:45.924 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/186 2023-11-28T22:46:45.924 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:45.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:45.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:45.951 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-11-28T22:46:46.344 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:46.355 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:46.355 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:46.637 INFO:teuthology.orchestra.run.smithi006.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:46.646 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/187 2023-11-28T22:46:46.646 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/187 2023-11-28T22:46:46.646 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:46.652 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:46.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:46.672 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-11-28T22:46:47.043 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:47.054 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:47.054 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:47.341 INFO:teuthology.orchestra.run.smithi006.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:47.349 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/188 2023-11-28T22:46:47.350 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/188 2023-11-28T22:46:47.350 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:47.356 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:47.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:47.375 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-11-28T22:46:47.760 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:47.771 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:47.772 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:48.067 INFO:teuthology.orchestra.run.smithi006.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:48.076 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/189 2023-11-28T22:46:48.076 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/189 2023-11-28T22:46:48.076 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:48.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:48.102 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-11-28T22:46:48.483 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:48.494 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:48.494 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:48.783 INFO:teuthology.orchestra.run.smithi006.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:48.792 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/190 2023-11-28T22:46:48.792 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/190 2023-11-28T22:46:48.792 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:48.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:48.870 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-11-28T22:46:49.241 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:49.251 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:49.537 INFO:teuthology.orchestra.run.smithi006.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:49.545 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/191 2023-11-28T22:46:49.545 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/191 2023-11-28T22:46:49.546 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:49.552 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:49.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:49.571 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-11-28T22:46:49.948 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:49.959 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:49.959 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:50.267 INFO:teuthology.orchestra.run.smithi006.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-11-28T22:46:50.276 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/192 2023-11-28T22:46:50.276 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/192 2023-11-28T22:46:50.276 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:50.282 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:50.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:50.346 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-11-28T22:46:50.727 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:50.738 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:50.738 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:52.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:52.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:53.138 INFO:teuthology.orchestra.run.smithi006.stdout:generic/193 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/193.out.bad) 2023-11-28T22:46:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/193.out 2023-11-28 21:09:26.554876150 +0000 2023-11-28T22:46:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/193.out.bad 2023-11-28 22:46:53.128050574 +0000 2023-11-28T22:46:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -24,7 +24,6 @@ 2023-11-28T22:46:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-11-28T22:46:53.144 INFO:teuthology.orchestra.run.smithi006.stdout: user: chmod a+r on root owned file (should fail) 2023-11-28T22:46:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-11-28T22:46:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: check that the sgid bit is cleared 2023-11-28T22:46:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: -rw-rw-rw- 2023-11-28T22:46:53.145 INFO:teuthology.orchestra.run.smithi006.stdout: check that suid bit is not cleared 2023-11-28T22:46:53.150 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/193 2023-11-28T22:46:53.150 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/193 2023-11-28T22:46:53.150 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T22:46:53.156 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:53.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T22:46:53.198 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T22:46:53.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T22:46:53.198 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-11-28T22:46:53.897 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:53.907 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:53.908 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:54.188 INFO:teuthology.orchestra.run.smithi006.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:54.197 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/194 2023-11-28T22:46:54.197 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/194 2023-11-28T22:46:54.197 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:54.203 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:54.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:54.223 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-11-28T22:46:54.580 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:54.591 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:54.881 INFO:teuthology.orchestra.run.smithi006.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:54.890 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/195 2023-11-28T22:46:54.890 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/195 2023-11-28T22:46:54.890 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:54.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:54.916 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-11-28T22:46:55.286 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:55.297 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:55.297 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:55.592 INFO:teuthology.orchestra.run.smithi006.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:55.601 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/196 2023-11-28T22:46:55.601 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/196 2023-11-28T22:46:55.601 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:55.607 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:55.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:55.627 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-11-28T22:46:56.009 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:56.020 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:56.020 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:56.308 INFO:teuthology.orchestra.run.smithi006.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:56.316 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/197 2023-11-28T22:46:56.316 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/197 2023-11-28T22:46:56.316 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:56.322 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:56.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:56.342 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-11-28T22:46:56.740 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:56.750 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:56.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:58.093 INFO:teuthology.orchestra.run.smithi006.stdout:generic/198 2s 2023-11-28T22:46:58.106 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/198 2023-11-28T22:46:58.106 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:58.112 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:58.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:58.133 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-11-28T22:46:58.827 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:58.838 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:58.838 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:59.149 INFO:teuthology.orchestra.run.smithi006.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:59.157 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/199 2023-11-28T22:46:59.158 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/199 2023-11-28T22:46:59.158 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:59.164 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:59.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:59.184 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-11-28T22:46:59.556 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:46:59.566 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:46:59.566 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:59.859 INFO:teuthology.orchestra.run.smithi006.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:46:59.868 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/200 2023-11-28T22:46:59.868 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/200 2023-11-28T22:46:59.868 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:46:59.874 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:46:59.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:46:59.894 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-11-28T22:47:00.280 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:47:00.291 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:47:00.291 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:00.578 INFO:teuthology.orchestra.run.smithi006.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:47:00.586 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/201 2023-11-28T22:47:00.586 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/201 2023-11-28T22:47:00.587 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:47:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:00.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:47:00.613 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-11-28T22:47:00.980 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:47:00.991 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:47:00.991 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:01.280 INFO:teuthology.orchestra.run.smithi006.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:47:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/202 2023-11-28T22:47:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/202 2023-11-28T22:47:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:47:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:01.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:47:01.315 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-11-28T22:47:01.679 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:47:01.690 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:47:01.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:01.961 INFO:teuthology.orchestra.run.smithi006.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:47:01.969 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/203 2023-11-28T22:47:01.969 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/203 2023-11-28T22:47:01.970 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:47:01.976 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:01.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:47:01.997 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-11-28T22:47:02.370 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:47:02.380 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:47:02.381 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:03.555 INFO:teuthology.orchestra.run.smithi006.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:47:03.564 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/204 2023-11-28T22:47:03.564 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/204 2023-11-28T22:47:03.564 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:47:03.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:03.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:47:03.592 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-11-28T22:47:03.972 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:47:03.983 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:47:03.983 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:04.268 INFO:teuthology.orchestra.run.smithi006.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:47:04.276 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/205 2023-11-28T22:47:04.276 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/205 2023-11-28T22:47:04.277 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:47:04.283 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:04.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:47:04.302 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-11-28T22:47:04.695 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:47:04.706 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:47:04.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:04.986 INFO:teuthology.orchestra.run.smithi006.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:47:04.995 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/206 2023-11-28T22:47:04.995 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/206 2023-11-28T22:47:04.995 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:47:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:05.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:47:05.020 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-11-28T22:47:05.407 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:47:05.418 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:47:05.418 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:22.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:22.931 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:24.494 INFO:teuthology.orchestra.run.smithi006.stdout:generic/207 19s 2023-11-28T22:47:24.506 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/207 2023-11-28T22:47:24.507 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:47:24.513 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:24.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:47:24.702 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-11-28T22:47:25.272 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:47:25.283 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:47:25.283 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:47:52.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:52.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:23.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:23.061 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:53.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:53.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:23.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:23.167 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:53.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:53.219 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:23.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:23.275 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:45.807 INFO:teuthology.orchestra.run.smithi006.stdout:generic/208 200s 2023-11-28T22:50:45.820 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/208 2023-11-28T22:50:45.820 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:50:45.826 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:50:45.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:50:45.987 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-11-28T22:50:46.603 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:50:46.613 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:50:46.614 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:50:53.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:53.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:57.075 INFO:teuthology.orchestra.run.smithi006.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/209.out.bad) 2023-11-28T22:50:57.124 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/209.out 2023-11-28 21:09:26.558876119 +0000 2023-11-28T22:50:57.125 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/209.out.bad 2023-11-28 22:50:57.049675265 +0000 2023-11-28T22:50:57.125 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,2 +1,2 @@ 2023-11-28T22:50:57.125 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 209 2023-11-28T22:50:57.125 INFO:teuthology.orchestra.run.smithi006.stdout: -test ran for 30 seconds without error 2023-11-28T22:50:57.125 INFO:teuthology.orchestra.run.smithi006.stdout: +reader found old byte at pos 4096 2023-11-28T22:50:57.125 INFO:teuthology.orchestra.run.smithi006.stdout: \ No newline at end of file 2023-11-28T22:50:57.159 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/209 2023-11-28T22:50:57.159 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/209 2023-11-28T22:50:57.159 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T22:50:57.195 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:50:57.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T22:50:57.274 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T22:50:57.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T22:50:57.275 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-11-28T22:50:57.660 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:50:57.670 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:50:57.670 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:50:58.213 INFO:teuthology.orchestra.run.smithi006.stdout:generic/210 1s 2023-11-28T22:50:58.226 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/210 2023-11-28T22:50:58.226 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:50:58.232 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:50:58.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:50:58.268 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-11-28T22:50:58.955 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:50:58.966 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:50:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:50:59.844 INFO:teuthology.orchestra.run.smithi006.stdout:generic/211 1s 2023-11-28T22:50:59.857 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/211 2023-11-28T22:50:59.857 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:50:59.863 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:50:59.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:50:59.883 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-11-28T22:51:00.247 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:00.258 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:00.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:00.698 INFO:teuthology.orchestra.run.smithi006.stdout:generic/212 0s 2023-11-28T22:51:00.711 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/212 2023-11-28T22:51:00.711 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:00.717 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:00.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:00.738 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-11-28T22:51:01.116 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:01.127 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:01.127 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:01.777 INFO:teuthology.orchestra.run.smithi006.stdout:generic/213 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/213.out.bad) 2023-11-28T22:51:01.783 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/213.out 2023-11-28 21:09:26.558876119 +0000 2023-11-28T22:51:01.783 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/213.out.bad 2023-11-28 22:51:01.773629351 +0000 2023-11-28T22:51:01.783 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,4 +1,3 @@ 2023-11-28T22:51:01.783 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 213 2023-11-28T22:51:01.783 INFO:teuthology.orchestra.run.smithi006.stdout: We should get: fallocate: No space left on device 2023-11-28T22:51:01.783 INFO:teuthology.orchestra.run.smithi006.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-11-28T22:51:01.784 INFO:teuthology.orchestra.run.smithi006.stdout: -fallocate: No space left on device 2023-11-28T22:51:01.788 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/213 2023-11-28T22:51:01.788 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/213 2023-11-28T22:51:01.789 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T22:51:01.795 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:01.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T22:51:01.877 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T22:51:01.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T22:51:01.877 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-11-28T22:51:02.675 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:02.692 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:02.692 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:03.697 INFO:teuthology.orchestra.run.smithi006.stdout:generic/214 1s 2023-11-28T22:51:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/214 2023-11-28T22:51:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:03.725 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:03.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:03.756 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-11-28T22:51:04.630 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:04.646 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:04.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:08.716 INFO:teuthology.orchestra.run.smithi006.stdout:generic/215 4s 2023-11-28T22:51:08.741 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/215 2023-11-28T22:51:08.741 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:08.749 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:08.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:08.780 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-11-28T22:51:09.348 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:09.363 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:09.363 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:09.757 INFO:teuthology.orchestra.run.smithi006.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:09.771 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/216 2023-11-28T22:51:09.771 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/216 2023-11-28T22:51:09.771 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:09.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:09.811 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-11-28T22:51:10.366 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:10.382 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:10.776 INFO:teuthology.orchestra.run.smithi006.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:10.788 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/217 2023-11-28T22:51:10.788 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/217 2023-11-28T22:51:10.788 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:10.795 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:10.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:10.822 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-11-28T22:51:11.387 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:11.402 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:11.403 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:11.806 INFO:teuthology.orchestra.run.smithi006.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:11.819 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/218 2023-11-28T22:51:11.819 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/218 2023-11-28T22:51:11.819 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:11.828 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:11.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:11.860 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-11-28T22:51:12.402 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:12.418 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:12.418 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:12.807 INFO:teuthology.orchestra.run.smithi006.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:12.820 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/219 2023-11-28T22:51:12.820 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/219 2023-11-28T22:51:12.821 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:12.829 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:12.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:12.857 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-11-28T22:51:13.421 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:13.438 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:13.439 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:13.862 INFO:teuthology.orchestra.run.smithi006.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:13.873 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/220 2023-11-28T22:51:13.873 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/220 2023-11-28T22:51:13.874 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:13.885 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:13.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:13.917 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-11-28T22:51:14.443 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:14.459 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:14.459 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:15.926 INFO:teuthology.orchestra.run.smithi006.stdout:generic/221 1s 2023-11-28T22:51:15.946 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/221 2023-11-28T22:51:15.946 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:15.956 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:15.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:15.982 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-11-28T22:51:16.513 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:16.528 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:16.928 INFO:teuthology.orchestra.run.smithi006.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:16.941 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/222 2023-11-28T22:51:16.941 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/222 2023-11-28T22:51:16.941 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:17.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:17.015 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-11-28T22:51:17.545 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:17.568 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:17.568 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:17.974 INFO:teuthology.orchestra.run.smithi006.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:17.988 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/223 2023-11-28T22:51:17.988 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/223 2023-11-28T22:51:17.988 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:18.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:18.052 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-11-28T22:51:18.596 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:18.609 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:18.610 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:19.052 INFO:teuthology.orchestra.run.smithi006.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:19.064 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/224 2023-11-28T22:51:19.064 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/224 2023-11-28T22:51:19.064 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:19.077 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:19.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:19.144 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-11-28T22:51:19.695 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:19.707 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:19.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:20.103 INFO:teuthology.orchestra.run.smithi006.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:20.117 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/225 2023-11-28T22:51:20.117 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/225 2023-11-28T22:51:20.117 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:20.125 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:20.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:20.156 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-11-28T22:51:20.711 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:20.727 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:20.727 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:21.134 INFO:teuthology.orchestra.run.smithi006.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:21.146 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/226 2023-11-28T22:51:21.146 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/226 2023-11-28T22:51:21.146 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:21.155 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:21.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:21.185 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-11-28T22:51:21.735 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:21.752 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:21.752 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:22.137 INFO:teuthology.orchestra.run.smithi006.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:22.149 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/227 2023-11-28T22:51:22.149 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/227 2023-11-28T22:51:22.150 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:22.159 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:22.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:22.192 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-11-28T22:51:22.752 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:22.768 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:22.768 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:23.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:23.432 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:23.433 INFO:teuthology.orchestra.run.smithi006.stdout:generic/228 1s 2023-11-28T22:51:23.461 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/228 2023-11-28T22:51:23.461 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:23.470 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:23.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:23.538 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-11-28T22:51:24.346 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:24.361 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:24.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:24.786 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/229 2023-11-28T22:51:24.787 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/229 2023-11-28T22:51:24.787 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:24.796 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:24.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:24.827 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-11-28T22:51:25.386 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:25.402 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:25.825 INFO:teuthology.orchestra.run.smithi006.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:25.839 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/230 2023-11-28T22:51:25.839 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/230 2023-11-28T22:51:25.840 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:25.850 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:25.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:25.880 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-11-28T22:51:26.438 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:26.453 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:26.453 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:26.857 INFO:teuthology.orchestra.run.smithi006.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:26.870 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/231 2023-11-28T22:51:26.870 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/231 2023-11-28T22:51:26.870 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:26.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:26.913 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-11-28T22:51:27.445 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:27.461 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:27.461 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:27.863 INFO:teuthology.orchestra.run.smithi006.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:27.873 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/232 2023-11-28T22:51:27.873 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/232 2023-11-28T22:51:27.874 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:27.880 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:27.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:27.906 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-11-28T22:51:28.466 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:28.483 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:28.483 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:28.893 INFO:teuthology.orchestra.run.smithi006.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:28.906 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/233 2023-11-28T22:51:28.906 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/233 2023-11-28T22:51:28.907 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:28.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:28.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:28.937 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-11-28T22:51:29.479 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:29.500 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:29.500 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:29.921 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/234 2023-11-28T22:51:29.921 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/234 2023-11-28T22:51:29.922 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:29.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:29.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:29.992 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-11-28T22:51:30.549 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:30.565 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:30.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:30.960 INFO:teuthology.orchestra.run.smithi006.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:30.973 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/235 2023-11-28T22:51:30.973 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/235 2023-11-28T22:51:30.973 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:30.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:31.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:31.008 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-11-28T22:51:31.543 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:31.556 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:31.556 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:33.185 INFO:teuthology.orchestra.run.smithi006.stdout:generic/236 2s 2023-11-28T22:51:33.205 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/236 2023-11-28T22:51:33.205 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:33.213 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:33.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:33.282 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-11-28T22:51:34.134 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:34.152 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:34.152 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:34.702 INFO:teuthology.orchestra.run.smithi006.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T22:51:34.714 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/237 2023-11-28T22:51:34.715 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/237 2023-11-28T22:51:34.715 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:34.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:34.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:34.756 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-11-28T22:51:35.337 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:35.353 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:35.353 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:35.766 INFO:teuthology.orchestra.run.smithi006.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:51:35.779 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/238 2023-11-28T22:51:35.780 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/238 2023-11-28T22:51:35.780 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:51:35.788 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:35.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:51:35.851 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-11-28T22:51:36.368 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:51:36.384 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:51:36.384 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:51:53.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:53.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:23.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:23.692 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:54.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:54.085 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:24.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:24.246 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:54.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:54.347 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:13.827 INFO:teuthology.orchestra.run.smithi006.stdout:generic/239 157s 2023-11-28T22:54:13.846 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/239 2023-11-28T22:54:13.846 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:54:13.856 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:54:13.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:54:13.884 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-11-28T22:54:14.749 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:54:14.766 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:54:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:54:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:generic/240 4s 2023-11-28T22:54:18.534 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/240 2023-11-28T22:54:18.534 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:54:18.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:54:18.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:54:18.577 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-11-28T22:54:19.447 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:54:19.462 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:54:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:54:25.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:25.664 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:55.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:55.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:26.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:26.962 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:33.424 INFO:teuthology.orchestra.run.smithi006.stdout:generic/241 74s 2023-11-28T22:55:33.444 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/241 2023-11-28T22:55:33.445 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:55:33.456 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:33.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:55:33.494 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-11-28T22:55:34.378 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:55:34.396 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:55:34.396 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:34.813 INFO:teuthology.orchestra.run.smithi006.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:55:34.829 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/242 2023-11-28T22:55:34.829 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/242 2023-11-28T22:55:34.829 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:55:34.838 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:34.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:55:34.876 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-11-28T22:55:35.418 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:55:35.431 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:55:35.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:35.849 INFO:teuthology.orchestra.run.smithi006.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:55:35.859 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/243 2023-11-28T22:55:35.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/243 2023-11-28T22:55:35.859 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:55:35.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:35.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:55:35.904 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-11-28T22:55:36.439 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:55:36.454 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:55:36.454 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:36.851 INFO:teuthology.orchestra.run.smithi006.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T22:55:36.865 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/244 2023-11-28T22:55:36.865 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/244 2023-11-28T22:55:36.865 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:55:36.878 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:36.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:55:36.911 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-11-28T22:55:37.435 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:55:37.449 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:55:37.449 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:38.449 INFO:teuthology.orchestra.run.smithi006.stdout:generic/245 1s 2023-11-28T22:55:40.580 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/245 2023-11-28T22:55:40.580 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:55:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:40.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:55:40.636 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-11-28T22:55:41.549 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:55:41.569 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:55:41.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:43.773 INFO:teuthology.orchestra.run.smithi006.stdout:generic/246 2s 2023-11-28T22:55:43.881 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/246 2023-11-28T22:55:43.881 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:55:43.891 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:43.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:55:43.934 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-11-28T22:55:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:55:44.795 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:55:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:55:57.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:57.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:28.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:28.077 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:35.030 INFO:teuthology.orchestra.run.smithi006.stdout:generic/247 51s 2023-11-28T22:56:35.050 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/247 2023-11-28T22:56:35.050 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:35.059 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:35.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:35.084 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-11-28T22:56:35.638 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:35.654 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:35.654 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:36.151 INFO:teuthology.orchestra.run.smithi006.stdout:generic/248 1s 2023-11-28T22:56:36.169 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/248 2023-11-28T22:56:36.169 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:36.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:36.212 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-11-28T22:56:36.756 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:36.769 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:41.228 INFO:teuthology.orchestra.run.smithi006.stdout:generic/249 5s 2023-11-28T22:56:41.247 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/249 2023-11-28T22:56:41.248 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:41.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:41.291 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-11-28T22:56:42.139 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:42.158 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:42.611 INFO:teuthology.orchestra.run.smithi006.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:56:42.622 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/250 2023-11-28T22:56:42.622 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/250 2023-11-28T22:56:42.622 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:42.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:42.666 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-11-28T22:56:43.206 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:43.222 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:43.222 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:43.631 INFO:teuthology.orchestra.run.smithi006.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:56:43.642 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/251 2023-11-28T22:56:43.642 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/251 2023-11-28T22:56:43.642 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:43.651 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:43.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:43.683 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-11-28T22:56:44.240 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:44.259 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:44.719 INFO:teuthology.orchestra.run.smithi006.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:56:44.735 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/252 2023-11-28T22:56:44.735 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/252 2023-11-28T22:56:44.735 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:44.744 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:44.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:44.784 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-11-28T22:56:45.337 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:45.760 INFO:teuthology.orchestra.run.smithi006.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:56:45.772 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/253 2023-11-28T22:56:45.772 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/253 2023-11-28T22:56:45.772 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:45.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:45.828 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-11-28T22:56:46.362 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:46.385 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:46.385 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:46.792 INFO:teuthology.orchestra.run.smithi006.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:56:46.806 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/254 2023-11-28T22:56:46.806 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/254 2023-11-28T22:56:46.806 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:46.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:46.858 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-11-28T22:56:47.416 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:47.431 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:50.172 INFO:teuthology.orchestra.run.smithi006.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T22:56:50.184 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/255 2023-11-28T22:56:50.184 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/255 2023-11-28T22:56:50.185 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:50.194 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:50.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:50.404 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-11-28T22:56:51.135 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:51.148 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:51.148 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:53.866 INFO:teuthology.orchestra.run.smithi006.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:56:53.877 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/256 2023-11-28T22:56:53.877 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/256 2023-11-28T22:56:53.877 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:53.886 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:53.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:53.913 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-11-28T22:56:54.455 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:54.472 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:57.072 INFO:teuthology.orchestra.run.smithi006.stdout:generic/257 3s 2023-11-28T22:56:57.091 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/257 2023-11-28T22:56:57.091 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:56:57.103 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:57.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:56:57.236 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-11-28T22:56:58.058 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:56:58.075 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:56:58.075 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:58.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:58.147 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:58.761 INFO:teuthology.orchestra.run.smithi006.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/258.out.bad) 2023-11-28T22:56:58.780 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/258.out 2023-11-28 21:09:26.566876058 +0000 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/258.out.bad 2023-11-28 22:56:58.750112680 +0000 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,5 +1,6 @@ 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 258 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: Creating file with timestamp of Jan 1, 1960 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: Testing for negative seconds since epoch 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: -Remounting to flush cache 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: -Testing for negative seconds since epoch 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: +Timestamp wrapped: 3979351756 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: +Timestamp wrapped 2023-11-28T22:56:58.781 INFO:teuthology.orchestra.run.smithi006.stdout: +(see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/258.full for details) 2023-11-28T22:56:58.788 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/258 2023-11-28T22:56:58.788 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/258 2023-11-28T22:56:58.788 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T22:56:58.799 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:56:58.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T22:56:58.850 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T22:56:58.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T22:56:58.850 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-11-28T22:57:00.057 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:00.068 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:00.369 INFO:teuthology.orchestra.run.smithi006.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:00.378 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/259 2023-11-28T22:57:00.378 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/259 2023-11-28T22:57:00.378 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:00.384 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:00.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:00.405 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-11-28T22:57:00.783 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:00.794 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:00.794 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:01.096 INFO:teuthology.orchestra.run.smithi006.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:01.104 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/260 2023-11-28T22:57:01.104 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/260 2023-11-28T22:57:01.105 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:01.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:01.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:01.130 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-11-28T22:57:01.515 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:01.526 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:01.808 INFO:teuthology.orchestra.run.smithi006.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:01.816 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/261 2023-11-28T22:57:01.817 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/261 2023-11-28T22:57:01.817 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:01.823 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:01.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:01.843 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-11-28T22:57:02.212 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:02.223 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:02.223 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:02.508 INFO:teuthology.orchestra.run.smithi006.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:02.517 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/262 2023-11-28T22:57:02.517 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/262 2023-11-28T22:57:02.517 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:02.523 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:02.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:02.544 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-11-28T22:57:02.927 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:02.938 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:02.938 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:28.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:28.232 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:54.574 INFO:teuthology.orchestra.run.smithi006.stdout:generic/263 52s 2023-11-28T22:57:54.586 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/263 2023-11-28T22:57:54.586 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:54.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:54.630 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-11-28T22:57:55.315 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:55.326 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:55.326 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:55.621 INFO:teuthology.orchestra.run.smithi006.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:55.630 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/264 2023-11-28T22:57:55.630 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/264 2023-11-28T22:57:55.630 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:55.636 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:55.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:55.657 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-11-28T22:57:56.031 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:56.042 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:56.042 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:56.365 INFO:teuthology.orchestra.run.smithi006.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:56.374 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/265 2023-11-28T22:57:56.374 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/265 2023-11-28T22:57:56.374 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:56.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:56.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:56.400 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-11-28T22:57:56.767 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:56.777 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:56.777 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:57.091 INFO:teuthology.orchestra.run.smithi006.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:57.099 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/266 2023-11-28T22:57:57.099 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/266 2023-11-28T22:57:57.099 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:57.105 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:57.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:57.125 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-11-28T22:57:57.512 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:57.523 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:57.523 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:57.849 INFO:teuthology.orchestra.run.smithi006.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:57.857 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/267 2023-11-28T22:57:57.858 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/267 2023-11-28T22:57:57.858 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:57.864 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:57.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:57.883 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-11-28T22:57:58.264 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:58.274 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:58.275 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:58.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:58.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:58.568 INFO:teuthology.orchestra.run.smithi006.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:58.577 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/268 2023-11-28T22:57:58.577 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/268 2023-11-28T22:57:58.577 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:58.583 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:58.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:58.603 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-11-28T22:57:58.979 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:58.989 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:59.269 INFO:teuthology.orchestra.run.smithi006.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:57:59.278 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/269 2023-11-28T22:57:59.278 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/269 2023-11-28T22:57:59.278 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:57:59.284 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:59.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:57:59.306 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-11-28T22:57:59.683 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:57:59.694 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:57:59.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:57:59.995 INFO:teuthology.orchestra.run.smithi006.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T22:58:00.004 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/270 2023-11-28T22:58:00.004 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/270 2023-11-28T22:58:00.004 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:00.010 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:00.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:00.031 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-11-28T22:58:00.403 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:00.413 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:00.414 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:00.717 INFO:teuthology.orchestra.run.smithi006.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:00.725 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/271 2023-11-28T22:58:00.726 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/271 2023-11-28T22:58:00.726 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:00.732 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:00.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:00.802 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-11-28T22:58:01.168 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:01.179 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:01.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:01.485 INFO:teuthology.orchestra.run.smithi006.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:01.493 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/272 2023-11-28T22:58:01.493 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/272 2023-11-28T22:58:01.493 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:01.500 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:01.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:01.573 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-11-28T22:58:01.935 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:01.946 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:01.946 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:02.242 INFO:teuthology.orchestra.run.smithi006.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:02.251 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/273 2023-11-28T22:58:02.251 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/273 2023-11-28T22:58:02.251 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:02.257 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:02.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:02.277 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-11-28T22:58:02.656 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:02.666 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:02.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:02.990 INFO:teuthology.orchestra.run.smithi006.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:02.998 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/274 2023-11-28T22:58:02.998 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/274 2023-11-28T22:58:02.998 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:03.005 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:03.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:03.024 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-11-28T22:58:03.395 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:03.405 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:03.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:03.728 INFO:teuthology.orchestra.run.smithi006.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:03.736 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/275 2023-11-28T22:58:03.736 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/275 2023-11-28T22:58:03.736 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:03.742 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:03.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:03.762 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-11-28T22:58:04.139 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:04.150 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:04.457 INFO:teuthology.orchestra.run.smithi006.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:04.465 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/276 2023-11-28T22:58:04.465 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/276 2023-11-28T22:58:04.465 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:04.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:04.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:04.491 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-11-28T22:58:04.916 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:04.928 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:04.928 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:05.217 INFO:teuthology.orchestra.run.smithi006.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:05.225 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/277 2023-11-28T22:58:05.226 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/277 2023-11-28T22:58:05.226 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:05.232 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:05.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:05.251 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-11-28T22:58:05.631 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:05.642 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:05.932 INFO:teuthology.orchestra.run.smithi006.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:05.940 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/278 2023-11-28T22:58:05.940 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/278 2023-11-28T22:58:05.941 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:05.947 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:06.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:06.002 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-11-28T22:58:06.372 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:06.382 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:06.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:06.701 INFO:teuthology.orchestra.run.smithi006.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:06.709 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/279 2023-11-28T22:58:06.710 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/279 2023-11-28T22:58:06.710 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:06.716 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:06.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:06.802 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-11-28T22:58:07.163 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:07.175 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:07.176 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:07.488 INFO:teuthology.orchestra.run.smithi006.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:07.497 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/280 2023-11-28T22:58:07.497 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/280 2023-11-28T22:58:07.497 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:07.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:07.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:07.565 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-11-28T22:58:07.943 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:07.954 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:07.954 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:08.261 INFO:teuthology.orchestra.run.smithi006.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:08.269 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/281 2023-11-28T22:58:08.270 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/281 2023-11-28T22:58:08.270 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:08.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:08.296 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-11-28T22:58:08.680 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:08.690 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:08.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:09.014 INFO:teuthology.orchestra.run.smithi006.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:09.021 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/282 2023-11-28T22:58:09.022 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/282 2023-11-28T22:58:09.022 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:09.028 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:09.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:09.048 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-11-28T22:58:09.435 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:09.446 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:09.447 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:09.777 INFO:teuthology.orchestra.run.smithi006.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:09.786 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/283 2023-11-28T22:58:09.786 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/283 2023-11-28T22:58:09.786 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:09.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:09.862 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-11-28T22:58:10.224 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:10.235 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:10.235 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:10.576 INFO:teuthology.orchestra.run.smithi006.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:58:10.584 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/284 2023-11-28T22:58:10.584 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/284 2023-11-28T22:58:10.585 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:10.591 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:10.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:10.611 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-11-28T22:58:10.979 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:10.989 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:10.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:13.236 INFO:teuthology.orchestra.run.smithi006.stdout:generic/285 2s 2023-11-28T22:58:13.249 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/285 2023-11-28T22:58:13.249 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:58:13.255 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:13.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:58:13.276 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-11-28T22:58:13.948 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:58:13.959 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:58:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:58:28.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:28.377 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:58.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:58.440 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:06.634 INFO:teuthology.orchestra.run.smithi006.stdout:generic/286 53s 2023-11-28T22:59:06.655 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/286 2023-11-28T22:59:06.655 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:06.662 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:06.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:06.684 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-11-28T22:59:07.497 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:07.508 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:07.508 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:07.821 INFO:teuthology.orchestra.run.smithi006.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:07.830 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/287 2023-11-28T22:59:07.830 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/287 2023-11-28T22:59:07.831 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:07.836 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:07.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:07.856 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-11-28T22:59:08.248 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:08.258 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:08.540 INFO:teuthology.orchestra.run.smithi006.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:08.548 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/288 2023-11-28T22:59:08.549 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/288 2023-11-28T22:59:08.549 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:08.555 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:08.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:08.575 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-11-28T22:59:08.947 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:08.958 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:08.958 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:09.236 INFO:teuthology.orchestra.run.smithi006.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:09.244 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/289 2023-11-28T22:59:09.244 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/289 2023-11-28T22:59:09.244 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:09.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:09.270 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-11-28T22:59:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:09.646 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:09.647 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:09.916 INFO:teuthology.orchestra.run.smithi006.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:09.924 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/290 2023-11-28T22:59:09.924 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/290 2023-11-28T22:59:09.924 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:09.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:09.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:09.953 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-11-28T22:59:10.335 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:10.345 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:10.346 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:10.636 INFO:teuthology.orchestra.run.smithi006.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:10.644 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/291 2023-11-28T22:59:10.644 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/291 2023-11-28T22:59:10.645 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:10.651 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:10.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:10.671 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-11-28T22:59:11.031 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:11.042 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:11.042 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:11.330 INFO:teuthology.orchestra.run.smithi006.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:11.339 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/292 2023-11-28T22:59:11.339 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/292 2023-11-28T22:59:11.339 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:11.345 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:11.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:11.365 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-11-28T22:59:11.744 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:11.754 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:11.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:12.045 INFO:teuthology.orchestra.run.smithi006.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:12.053 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/293 2023-11-28T22:59:12.053 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/293 2023-11-28T22:59:12.053 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:12.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:12.079 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-11-28T22:59:12.455 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:12.466 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:12.466 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:12.761 INFO:teuthology.orchestra.run.smithi006.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:12.770 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/294 2023-11-28T22:59:12.770 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/294 2023-11-28T22:59:12.770 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:12.776 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:12.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:12.796 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-11-28T22:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:13.467 INFO:teuthology.orchestra.run.smithi006.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:13.476 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/295 2023-11-28T22:59:13.476 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/295 2023-11-28T22:59:13.476 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:13.482 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:13.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:13.502 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-11-28T22:59:13.903 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:13.914 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:13.914 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:14.202 INFO:teuthology.orchestra.run.smithi006.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:14.211 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/296 2023-11-28T22:59:14.211 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/296 2023-11-28T22:59:14.211 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:14.217 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:14.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:14.237 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-11-28T22:59:14.614 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:14.625 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:14.909 INFO:teuthology.orchestra.run.smithi006.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:14.917 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/297 2023-11-28T22:59:14.918 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/297 2023-11-28T22:59:14.918 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:14.924 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:14.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:14.943 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-11-28T22:59:15.327 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:15.338 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:15.629 INFO:teuthology.orchestra.run.smithi006.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:15.637 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/298 2023-11-28T22:59:15.638 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/298 2023-11-28T22:59:15.638 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:15.644 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:15.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:15.665 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-11-28T22:59:16.047 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:16.058 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:16.058 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/299 2023-11-28T22:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/299 2023-11-28T22:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:16.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:16.454 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-11-28T22:59:16.820 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:16.831 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:16.831 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:17.123 INFO:teuthology.orchestra.run.smithi006.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:17.131 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/300 2023-11-28T22:59:17.131 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/300 2023-11-28T22:59:17.132 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:17.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:17.157 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-11-28T22:59:17.547 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:17.558 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:17.558 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:17.850 INFO:teuthology.orchestra.run.smithi006.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:17.858 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/301 2023-11-28T22:59:17.859 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/301 2023-11-28T22:59:17.859 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:17.865 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:17.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:17.885 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-11-28T22:59:18.261 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:18.271 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:18.559 INFO:teuthology.orchestra.run.smithi006.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:18.567 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/302 2023-11-28T22:59:18.567 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/302 2023-11-28T22:59:18.568 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:18.574 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:18.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:18.594 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-11-28T22:59:18.971 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:18.982 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:18.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:19.342 INFO:teuthology.orchestra.run.smithi006.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T22:59:19.350 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/303 2023-11-28T22:59:19.350 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/303 2023-11-28T22:59:19.350 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:19.357 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:19.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:19.382 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-11-28T22:59:20.067 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:20.077 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:20.078 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:20.474 INFO:teuthology.orchestra.run.smithi006.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T22:59:20.482 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/304 2023-11-28T22:59:20.483 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/304 2023-11-28T22:59:20.483 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:20.489 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:20.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:20.521 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-11-28T22:59:21.211 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:21.222 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:21.222 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/305 2023-11-28T22:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/305 2023-11-28T22:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:21.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:21.547 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-11-28T22:59:21.928 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:21.939 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:22.218 INFO:teuthology.orchestra.run.smithi006.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:22.227 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/306 2023-11-28T22:59:22.227 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/306 2023-11-28T22:59:22.227 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:22.233 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:22.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:22.252 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-11-28T22:59:22.611 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:22.622 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:22.622 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:22.921 INFO:teuthology.orchestra.run.smithi006.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T22:59:22.930 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/307 2023-11-28T22:59:22.930 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/307 2023-11-28T22:59:22.930 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:22.936 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:22.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:22.956 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-11-28T22:59:23.319 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:23.330 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:23.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:23.663 INFO:teuthology.orchestra.run.smithi006.stdout:generic/308 0s 2023-11-28T22:59:23.676 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/308 2023-11-28T22:59:23.677 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:23.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:23.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:23.734 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-11-28T22:59:24.134 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:24.145 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:24.145 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:25.537 INFO:teuthology.orchestra.run.smithi006.stdout:generic/309 1s 2023-11-28T22:59:25.549 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/309 2023-11-28T22:59:25.550 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T22:59:25.556 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:25.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T22:59:25.606 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-11-28T22:59:26.283 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T22:59:26.293 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T22:59:26.294 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T22:59:28.500 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:28.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:58.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:58.568 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:28.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:28.632 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:57.558 INFO:teuthology.orchestra.run.smithi006.stdout:generic/310 91s 2023-11-28T23:00:57.608 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/310 2023-11-28T23:00:57.609 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:00:57.615 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:00:57.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:00:57.652 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-11-28T23:00:58.883 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:00:58.893 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:00:58.893 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:00:59.254 INFO:teuthology.orchestra.run.smithi006.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:00:59.263 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/311 2023-11-28T23:00:59.263 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/311 2023-11-28T23:00:59.264 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:00:59.269 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:00:59.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:00:59.290 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-11-28T23:00:59.685 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:00:59.694 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:00:59.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:00:59.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:59.825 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:00.006 INFO:teuthology.orchestra.run.smithi006.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/312 2023-11-28T23:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/312 2023-11-28T23:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:00.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:00.042 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-11-28T23:01:00.427 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:00.437 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:00.438 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout:generic/313 4s 2023-11-28T23:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/313 2023-11-28T23:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:05.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:05.046 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-11-28T23:01:05.456 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:05.468 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:05.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:06.314 INFO:teuthology.orchestra.run.smithi006.stdout:generic/314 1s 2023-11-28T23:01:06.327 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/314 2023-11-28T23:01:06.327 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:06.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:06.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:06.355 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-11-28T23:01:06.747 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:06.758 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:06.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:08.275 INFO:teuthology.orchestra.run.smithi006.stdout:generic/315 2s 2023-11-28T23:01:08.290 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/315 2023-11-28T23:01:08.290 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:08.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:08.478 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-11-28T23:01:09.049 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:09.060 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:09.060 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:10.688 INFO:teuthology.orchestra.run.smithi006.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T23:01:10.697 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/316 2023-11-28T23:01:10.697 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/316 2023-11-28T23:01:10.697 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:10.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:10.732 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-11-28T23:01:11.440 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:11.450 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:11.760 INFO:teuthology.orchestra.run.smithi006.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:01:11.768 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/317 2023-11-28T23:01:11.768 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/317 2023-11-28T23:01:11.769 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:11.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:11.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:11.795 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-11-28T23:01:12.190 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:12.201 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:12.202 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:12.516 INFO:teuthology.orchestra.run.smithi006.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:01:12.524 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/318 2023-11-28T23:01:12.525 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/318 2023-11-28T23:01:12.525 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:12.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:12.551 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-11-28T23:01:12.911 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:12.922 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:13.267 INFO:teuthology.orchestra.run.smithi006.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T23:01:13.276 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/319 2023-11-28T23:01:13.276 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/319 2023-11-28T23:01:13.276 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:13.282 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:13.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:13.302 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-11-28T23:01:13.679 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:13.690 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/320 2023-11-28T23:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/320 2023-11-28T23:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:13.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:13.998 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-11-28T23:01:14.379 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:14.390 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:14.390 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:14.707 INFO:teuthology.orchestra.run.smithi006.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/321 2023-11-28T23:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/321 2023-11-28T23:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:14.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:14.742 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-11-28T23:01:15.103 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:15.114 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:15.421 INFO:teuthology.orchestra.run.smithi006.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:01:15.430 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/322 2023-11-28T23:01:15.430 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/322 2023-11-28T23:01:15.430 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:01:15.436 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:15.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:01:15.459 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-11-28T23:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:01:29.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:29.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:59.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:59.949 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:31.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:31.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:01.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:01.351 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:22.454 INFO:teuthology.orchestra.run.smithi006.stdout:generic/323 127s 2023-11-28T23:03:23.091 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/323 2023-11-28T23:03:23.092 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:23.099 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:23.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:23.154 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-11-28T23:03:24.844 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:24.855 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:24.855 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:25.202 INFO:teuthology.orchestra.run.smithi006.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:25.210 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/324 2023-11-28T23:03:25.211 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/324 2023-11-28T23:03:25.211 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:25.217 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:25.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:25.238 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-11-28T23:03:25.611 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:25.622 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:25.622 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:25.954 INFO:teuthology.orchestra.run.smithi006.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:25.963 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/325 2023-11-28T23:03:25.963 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/325 2023-11-28T23:03:25.963 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:25.970 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:25.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:25.990 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-11-28T23:03:26.367 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:26.378 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:26.378 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:26.670 INFO:teuthology.orchestra.run.smithi006.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:26.678 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/326 2023-11-28T23:03:26.678 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/326 2023-11-28T23:03:26.678 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:26.684 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:26.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:26.705 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-11-28T23:03:27.083 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:27.094 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:27.094 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:27.370 INFO:teuthology.orchestra.run.smithi006.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:27.379 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/327 2023-11-28T23:03:27.379 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/327 2023-11-28T23:03:27.379 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:27.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:27.405 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-11-28T23:03:27.768 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:27.779 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:27.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:28.107 INFO:teuthology.orchestra.run.smithi006.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:28.115 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/328 2023-11-28T23:03:28.115 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/328 2023-11-28T23:03:28.115 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:28.122 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:28.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:28.141 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-11-28T23:03:28.528 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:28.538 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:28.538 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:28.861 INFO:teuthology.orchestra.run.smithi006.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:28.869 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/329 2023-11-28T23:03:28.870 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/329 2023-11-28T23:03:28.870 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:28.876 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:28.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:28.896 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-11-28T23:03:29.287 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:29.298 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:29.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:29.582 INFO:teuthology.orchestra.run.smithi006.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:29.591 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/330 2023-11-28T23:03:29.591 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/330 2023-11-28T23:03:29.591 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:29.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:29.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:29.617 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-11-28T23:03:29.975 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:29.986 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:29.986 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:30.293 INFO:teuthology.orchestra.run.smithi006.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:30.301 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/331 2023-11-28T23:03:30.302 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/331 2023-11-28T23:03:30.302 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:30.308 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:30.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:30.328 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-11-28T23:03:30.691 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:30.702 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:30.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:30.992 INFO:teuthology.orchestra.run.smithi006.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:31.000 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/332 2023-11-28T23:03:31.000 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/332 2023-11-28T23:03:31.000 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:31.007 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:31.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:31.027 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-11-28T23:03:31.416 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:31.427 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:31.427 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:31.702 INFO:teuthology.orchestra.run.smithi006.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:31.710 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/333 2023-11-28T23:03:31.711 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/333 2023-11-28T23:03:31.711 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:31.717 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:31.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:31.737 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-11-28T23:03:32.103 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:32.113 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:32.114 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:32.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:32.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:32.340 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-28T23:03:32.337+0000 7fd4b5852640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 287761) UID: 0 2023-11-28T23:03:32.340 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-28T23:03:32.337+0000 7fe93040a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 287761) UID: 0 2023-11-28T23:03:32.341 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-28T23:03:32.337+0000 7fdf27920640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 287761) UID: 0 2023-11-28T23:03:32.341 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-28T23:03:32.337+0000 7fef6c324640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 287761) UID: 0 2023-11-28T23:03:32.382 INFO:teuthology.orchestra.run.smithi006.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:32.391 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/334 2023-11-28T23:03:32.391 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/334 2023-11-28T23:03:32.391 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:32.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:32.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:32.459 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-11-28T23:03:32.891 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:32.902 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:32.903 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:33.243 INFO:teuthology.orchestra.run.smithi006.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:33.251 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/335 2023-11-28T23:03:33.251 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/335 2023-11-28T23:03:33.252 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:33.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:33.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:33.308 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-11-28T23:03:33.695 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:33.706 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:33.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:34.029 INFO:teuthology.orchestra.run.smithi006.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:34.038 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/336 2023-11-28T23:03:34.038 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/336 2023-11-28T23:03:34.038 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:34.044 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:34.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:34.064 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-11-28T23:03:34.521 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:34.531 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:34.532 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:34.848 INFO:teuthology.orchestra.run.smithi006.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:34.857 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/337 2023-11-28T23:03:34.857 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/337 2023-11-28T23:03:34.857 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:34.864 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:34.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:34.886 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-11-28T23:03:35.288 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:35.299 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:35.299 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:35.606 INFO:teuthology.orchestra.run.smithi006.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:35.614 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/338 2023-11-28T23:03:35.614 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/338 2023-11-28T23:03:35.614 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:35.620 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:35.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:35.678 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-11-28T23:03:36.064 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:36.075 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:36.075 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:36.402 INFO:teuthology.orchestra.run.smithi006.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:36.410 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/339 2023-11-28T23:03:36.411 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/339 2023-11-28T23:03:36.411 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:36.417 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:36.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:36.437 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-11-28T23:03:36.818 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:36.828 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:36.828 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:37.144 INFO:teuthology.orchestra.run.smithi006.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:37.152 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/340 2023-11-28T23:03:37.152 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/340 2023-11-28T23:03:37.153 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:37.159 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:37.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:37.178 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-11-28T23:03:37.559 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:37.569 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:37.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:37.903 INFO:teuthology.orchestra.run.smithi006.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:37.912 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/341 2023-11-28T23:03:37.912 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/341 2023-11-28T23:03:37.912 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:37.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:37.939 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-11-28T23:03:38.320 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:38.330 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:38.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:38.668 INFO:teuthology.orchestra.run.smithi006.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:38.676 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/342 2023-11-28T23:03:38.676 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/342 2023-11-28T23:03:38.676 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:38.682 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:38.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:38.703 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-11-28T23:03:39.079 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:39.090 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:39.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:39.390 INFO:teuthology.orchestra.run.smithi006.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/343 2023-11-28T23:03:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/343 2023-11-28T23:03:39.399 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:39.406 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:39.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:39.427 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-11-28T23:03:39.815 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:39.825 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:39.825 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:40.102 INFO:teuthology.orchestra.run.smithi006.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:40.110 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/344 2023-11-28T23:03:40.110 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/344 2023-11-28T23:03:40.111 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:40.117 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:40.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:40.138 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-11-28T23:03:40.527 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:40.538 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:40.538 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:40.816 INFO:teuthology.orchestra.run.smithi006.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:40.824 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/345 2023-11-28T23:03:40.824 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/345 2023-11-28T23:03:40.825 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:40.831 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:40.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:40.851 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-11-28T23:03:41.228 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:41.239 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:41.525 INFO:teuthology.orchestra.run.smithi006.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/346 2023-11-28T23:03:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/346 2023-11-28T23:03:41.534 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:41.540 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:41.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:41.560 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-11-28T23:03:41.963 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:41.974 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:42.643 INFO:teuthology.orchestra.run.smithi006.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:42.651 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/347 2023-11-28T23:03:42.651 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/347 2023-11-28T23:03:42.652 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:42.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:42.680 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-11-28T23:03:43.073 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:43.084 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:43.084 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:43.397 INFO:teuthology.orchestra.run.smithi006.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:43.406 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/348 2023-11-28T23:03:43.406 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/348 2023-11-28T23:03:43.406 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:43.413 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:43.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:43.433 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-11-28T23:03:43.824 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:43.835 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:43.835 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:45.649 INFO:teuthology.orchestra.run.smithi006.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T23:03:45.657 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/349 2023-11-28T23:03:45.658 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/349 2023-11-28T23:03:45.658 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:45.664 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:45.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:45.685 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-11-28T23:03:46.080 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:46.091 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:48.970 INFO:teuthology.orchestra.run.smithi006.stdout:generic/350 2s 2023-11-28T23:03:48.983 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/350 2023-11-28T23:03:48.983 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:48.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:49.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:49.010 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-11-28T23:03:49.374 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:49.385 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:49.385 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:51.066 INFO:teuthology.orchestra.run.smithi006.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-28T23:03:51.075 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/351 2023-11-28T23:03:51.075 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/351 2023-11-28T23:03:51.075 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:51.081 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:51.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:51.125 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-11-28T23:03:51.856 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:51.866 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:51.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:52.192 INFO:teuthology.orchestra.run.smithi006.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:52.201 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/352 2023-11-28T23:03:52.201 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/352 2023-11-28T23:03:52.201 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:52.207 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:52.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:52.227 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-11-28T23:03:52.612 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:52.626 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:52.626 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:53.025 INFO:teuthology.orchestra.run.smithi006.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:53.033 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/353 2023-11-28T23:03:53.033 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/353 2023-11-28T23:03:53.034 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:53.040 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:53.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:53.062 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-11-28T23:03:53.443 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:53.454 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:53.749 INFO:teuthology.orchestra.run.smithi006.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:53.758 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/354 2023-11-28T23:03:53.758 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/354 2023-11-28T23:03:53.758 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:53.764 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:53.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:53.784 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-11-28T23:03:54.172 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:54.183 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:55.992 INFO:teuthology.orchestra.run.smithi006.stdout:generic/355 1s 2023-11-28T23:03:56.005 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/355 2023-11-28T23:03:56.005 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:56.011 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:56.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:56.032 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-11-28T23:03:56.764 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:56.775 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:56.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:57.142 INFO:teuthology.orchestra.run.smithi006.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:57.151 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/356 2023-11-28T23:03:57.151 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/356 2023-11-28T23:03:57.151 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:57.157 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:57.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:57.178 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-11-28T23:03:57.577 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:57.587 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:57.588 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:57.889 INFO:teuthology.orchestra.run.smithi006.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:57.897 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/357 2023-11-28T23:03:57.897 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/357 2023-11-28T23:03:57.897 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:57.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:57.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:57.924 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-11-28T23:03:58.308 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:58.319 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:58.320 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:58.613 INFO:teuthology.orchestra.run.smithi006.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:58.621 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/358 2023-11-28T23:03:58.621 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/358 2023-11-28T23:03:58.621 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:58.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:58.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:58.648 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-11-28T23:03:59.039 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:59.050 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:59.051 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:59.348 INFO:teuthology.orchestra.run.smithi006.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:03:59.357 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/359 2023-11-28T23:03:59.357 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/359 2023-11-28T23:03:59.357 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:03:59.363 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:03:59.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:03:59.384 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-11-28T23:03:59.765 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:03:59.776 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:03:59.776 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:00.605 INFO:teuthology.orchestra.run.smithi006.stdout:generic/360 1s 2023-11-28T23:04:00.618 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/360 2023-11-28T23:04:00.619 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:00.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:00.645 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-11-28T23:04:01.016 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:01.026 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:01.027 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:01.390 INFO:teuthology.orchestra.run.smithi006.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:01.399 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/361 2023-11-28T23:04:01.399 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/361 2023-11-28T23:04:01.399 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:01.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:01.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:01.425 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-11-28T23:04:01.799 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:01.810 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:01.810 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:02.099 INFO:teuthology.orchestra.run.smithi006.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:02.107 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/362 2023-11-28T23:04:02.108 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/362 2023-11-28T23:04:02.108 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:02.114 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:02.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:02.134 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-11-28T23:04:02.523 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:02.534 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:02.534 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:02.810 INFO:teuthology.orchestra.run.smithi006.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:02.819 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/363 2023-11-28T23:04:02.819 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/363 2023-11-28T23:04:02.819 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:02.825 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:02.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:02.846 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-11-28T23:04:03.230 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:03.240 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:03.241 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:03.557 INFO:teuthology.orchestra.run.smithi006.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:03.566 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/364 2023-11-28T23:04:03.566 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/364 2023-11-28T23:04:03.566 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:03.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:03.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:03.594 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-11-28T23:04:03.988 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:03.998 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:03.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:04.285 INFO:teuthology.orchestra.run.smithi006.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:04.295 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/365 2023-11-28T23:04:04.295 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/365 2023-11-28T23:04:04.296 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:04.301 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:04.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:04.323 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-11-28T23:04:04.709 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:04.718 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:04.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:04.997 INFO:teuthology.orchestra.run.smithi006.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:05.006 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/366 2023-11-28T23:04:05.006 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/366 2023-11-28T23:04:05.006 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:05.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:05.033 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-11-28T23:04:05.507 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:05.518 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:05.519 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:05.825 INFO:teuthology.orchestra.run.smithi006.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:05.833 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/367 2023-11-28T23:04:05.834 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/367 2023-11-28T23:04:05.834 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:05.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:05.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:05.860 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-11-28T23:04:06.242 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:06.252 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:06.252 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:06.549 INFO:teuthology.orchestra.run.smithi006.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/368 2023-11-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/368 2023-11-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:06.564 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:06.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:06.584 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-11-28T23:04:06.967 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:06.978 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:06.978 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:07.290 INFO:teuthology.orchestra.run.smithi006.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:07.298 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/369 2023-11-28T23:04:07.299 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/369 2023-11-28T23:04:07.299 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:07.305 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:07.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:07.326 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-11-28T23:04:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:07.719 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:07.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:08.009 INFO:teuthology.orchestra.run.smithi006.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:08.017 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/370 2023-11-28T23:04:08.018 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/370 2023-11-28T23:04:08.018 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:08.024 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:08.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:08.047 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-11-28T23:04:08.431 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:08.442 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:08.443 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/371 2023-11-28T23:04:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/371 2023-11-28T23:04:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:08.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:08.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:08.792 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-11-28T23:04:09.176 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:09.187 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:09.476 INFO:teuthology.orchestra.run.smithi006.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:09.485 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/372 2023-11-28T23:04:09.485 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/372 2023-11-28T23:04:09.486 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:09.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:09.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:09.512 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-11-28T23:04:09.900 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:09.911 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:09.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:10.206 INFO:teuthology.orchestra.run.smithi006.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:10.214 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/373 2023-11-28T23:04:10.215 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/373 2023-11-28T23:04:10.215 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:10.221 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:10.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:10.242 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-11-28T23:04:10.619 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:10.630 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:10.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:10.925 INFO:teuthology.orchestra.run.smithi006.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:10.934 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/374 2023-11-28T23:04:10.934 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/374 2023-11-28T23:04:10.934 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:10.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:10.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:10.960 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-11-28T23:04:11.326 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:11.337 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:11.337 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:11.694 INFO:teuthology.orchestra.run.smithi006.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T23:04:11.702 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/375 2023-11-28T23:04:11.703 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/375 2023-11-28T23:04:11.703 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:11.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:11.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:11.729 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-11-28T23:04:12.141 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:12.151 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:12.151 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:12.563 INFO:teuthology.orchestra.run.smithi006.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:12.571 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/376 2023-11-28T23:04:12.571 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/376 2023-11-28T23:04:12.571 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:12.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:12.597 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-11-28T23:04:12.983 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:12.994 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:12.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:13.296 INFO:teuthology.orchestra.run.smithi006.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:13.304 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/377 2023-11-28T23:04:13.304 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/377 2023-11-28T23:04:13.304 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:13.311 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:13.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:13.330 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-11-28T23:04:13.719 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:13.729 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:15.459 INFO:teuthology.orchestra.run.smithi006.stdout:generic/378 2s 2023-11-28T23:04:15.473 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/378 2023-11-28T23:04:15.473 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:15.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:15.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:15.510 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-11-28T23:04:16.248 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:16.466 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:16.467 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:16.659 INFO:teuthology.orchestra.run.smithi006.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:16.668 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/379 2023-11-28T23:04:16.668 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/379 2023-11-28T23:04:16.668 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:16.674 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:16.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:16.696 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-11-28T23:04:17.072 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:17.083 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:17.402 INFO:teuthology.orchestra.run.smithi006.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:17.410 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/380 2023-11-28T23:04:17.410 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/380 2023-11-28T23:04:17.410 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:17.417 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:17.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:17.437 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-11-28T23:04:17.834 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:17.843 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:17.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:18.137 INFO:teuthology.orchestra.run.smithi006.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:18.146 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/381 2023-11-28T23:04:18.146 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/381 2023-11-28T23:04:18.146 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:18.152 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:18.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:18.173 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-11-28T23:04:18.560 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:18.571 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:18.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:18.882 INFO:teuthology.orchestra.run.smithi006.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:18.891 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/382 2023-11-28T23:04:18.891 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/382 2023-11-28T23:04:18.891 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:18.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:18.918 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-11-28T23:04:19.295 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:19.306 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:19.306 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:19.633 INFO:teuthology.orchestra.run.smithi006.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:19.642 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/383 2023-11-28T23:04:19.642 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/383 2023-11-28T23:04:19.642 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:19.648 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:19.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:19.668 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-11-28T23:04:20.055 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:20.066 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:20.066 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:20.498 INFO:teuthology.orchestra.run.smithi006.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T23:04:20.507 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/384 2023-11-28T23:04:20.507 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/384 2023-11-28T23:04:20.507 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:20.513 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:20.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:20.533 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-11-28T23:04:20.931 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:20.942 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:21.261 INFO:teuthology.orchestra.run.smithi006.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:21.270 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/385 2023-11-28T23:04:21.270 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/385 2023-11-28T23:04:21.270 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:21.276 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:21.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:21.297 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-11-28T23:04:21.676 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:21.686 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:21.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:21.987 INFO:teuthology.orchestra.run.smithi006.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T23:04:21.995 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/386 2023-11-28T23:04:21.996 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/386 2023-11-28T23:04:21.996 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:22.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:22.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:22.023 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-11-28T23:04:22.405 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:22.416 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:22.416 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:22.727 INFO:teuthology.orchestra.run.smithi006.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:22.736 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/387 2023-11-28T23:04:22.737 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/387 2023-11-28T23:04:22.737 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:22.744 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:22.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:22.766 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-11-28T23:04:23.160 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:23.171 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:23.171 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:23.478 INFO:teuthology.orchestra.run.smithi006.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:23.486 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/388 2023-11-28T23:04:23.487 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/388 2023-11-28T23:04:23.487 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:23.493 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:23.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:23.514 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-11-28T23:04:23.902 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:23.913 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:23.913 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:24.220 INFO:teuthology.orchestra.run.smithi006.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-11-28T23:04:24.230 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/389 2023-11-28T23:04:24.230 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/389 2023-11-28T23:04:24.230 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:24.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:24.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:24.259 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-11-28T23:04:24.644 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:24.654 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:24.655 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:24.967 INFO:teuthology.orchestra.run.smithi006.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:04:24.975 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/390 2023-11-28T23:04:24.976 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/390 2023-11-28T23:04:24.976 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:04:24.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:04:25.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:04:25.002 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-11-28T23:04:25.383 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:04:25.394 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:04:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:07.611 INFO:teuthology.orchestra.run.smithi006.stdout:generic/391 42s 2023-11-28T23:05:08.130 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/391 2023-11-28T23:05:08.130 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:08.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:08.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:08.185 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-11-28T23:05:12.185 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:12.195 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:12.195 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:12.717 INFO:teuthology.orchestra.run.smithi006.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/392 2023-11-28T23:05:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/392 2023-11-28T23:05:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:12.732 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:12.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:12.753 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-11-28T23:05:13.129 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:13.140 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:13.688 INFO:teuthology.orchestra.run.smithi006.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:13.697 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/393 2023-11-28T23:05:13.697 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/393 2023-11-28T23:05:13.697 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:13.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:13.724 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-11-28T23:05:14.128 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:14.139 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:14.139 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:14.524 INFO:teuthology.orchestra.run.smithi006.stdout:generic/394 0s 2023-11-28T23:05:14.537 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/394 2023-11-28T23:05:14.537 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:14.544 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:14.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:14.565 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-11-28T23:05:15.287 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:15.297 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:15.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:15.776 INFO:teuthology.orchestra.run.smithi006.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:15.788 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/395 2023-11-28T23:05:15.788 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/395 2023-11-28T23:05:15.789 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:15.799 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:15.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:15.838 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-11-28T23:05:16.400 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:16.411 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:16.773 INFO:teuthology.orchestra.run.smithi006.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:16.782 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/396 2023-11-28T23:05:16.782 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/396 2023-11-28T23:05:16.782 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:16.790 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:16.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:16.812 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-11-28T23:05:17.191 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:17.202 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:17.623 INFO:teuthology.orchestra.run.smithi006.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:17.631 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/397 2023-11-28T23:05:17.631 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/397 2023-11-28T23:05:17.631 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:17.638 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:17.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:17.659 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-11-28T23:05:18.027 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:18.037 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:18.038 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:18.400 INFO:teuthology.orchestra.run.smithi006.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:18.408 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/398 2023-11-28T23:05:18.408 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/398 2023-11-28T23:05:18.408 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:18.414 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:18.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:18.434 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-11-28T23:05:18.851 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:18.863 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:18.863 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:19.242 INFO:teuthology.orchestra.run.smithi006.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:19.250 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/399 2023-11-28T23:05:19.250 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/399 2023-11-28T23:05:19.251 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:19.256 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:19.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:19.278 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-11-28T23:05:19.671 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:19.682 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:19.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:19.974 INFO:teuthology.orchestra.run.smithi006.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T23:05:19.982 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/400 2023-11-28T23:05:19.982 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/400 2023-11-28T23:05:19.983 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:19.989 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:20.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:20.009 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-11-28T23:05:20.434 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:20.445 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:20.445 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:20.727 INFO:teuthology.orchestra.run.smithi006.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:20.735 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/401 2023-11-28T23:05:20.735 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/401 2023-11-28T23:05:20.735 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:20.742 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:20.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:20.811 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-11-28T23:05:21.183 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:21.194 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:21.194 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:21.516 INFO:teuthology.orchestra.run.smithi006.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:21.524 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/402 2023-11-28T23:05:21.524 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/402 2023-11-28T23:05:21.524 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:21.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:21.551 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-11-28T23:05:21.928 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:21.939 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:22.247 INFO:teuthology.orchestra.run.smithi006.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:22.256 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/403 2023-11-28T23:05:22.256 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/403 2023-11-28T23:05:22.256 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:22.262 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:22.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:22.282 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-11-28T23:05:22.667 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:22.678 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:22.678 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:24.265 INFO:teuthology.orchestra.run.smithi006.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-28T23:05:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/404 2023-11-28T23:05:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/404 2023-11-28T23:05:24.274 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:24.282 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:24.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:24.302 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-11-28T23:05:25.063 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:25.073 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:25.074 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:25.584 INFO:teuthology.orchestra.run.smithi006.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:25.592 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/405 2023-11-28T23:05:25.592 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/405 2023-11-28T23:05:25.592 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:25.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:25.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:25.620 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-11-28T23:05:25.991 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:26.002 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:26.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:26.298 INFO:teuthology.orchestra.run.smithi006.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:26.306 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/406 2023-11-28T23:05:26.306 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/406 2023-11-28T23:05:26.307 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:26.312 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:26.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:26.334 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-11-28T23:05:26.721 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:26.731 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:26.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:27.107 INFO:teuthology.orchestra.run.smithi006.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T23:05:27.116 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/407 2023-11-28T23:05:27.116 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/407 2023-11-28T23:05:27.116 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:27.122 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:27.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:27.154 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-11-28T23:05:27.892 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:27.902 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:27.903 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:28.319 INFO:teuthology.orchestra.run.smithi006.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T23:05:28.327 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/408 2023-11-28T23:05:28.327 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/408 2023-11-28T23:05:28.327 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:28.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:28.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:28.386 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-11-28T23:05:29.087 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:29.098 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:29.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:29.437 INFO:teuthology.orchestra.run.smithi006.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:29.446 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/409 2023-11-28T23:05:29.446 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/409 2023-11-28T23:05:29.446 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:29.452 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:29.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:29.473 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-11-28T23:05:29.855 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:29.866 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:29.866 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/410 2023-11-28T23:05:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/410 2023-11-28T23:05:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:30.169 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:30.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:30.191 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-11-28T23:05:30.568 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:30.578 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:30.579 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:30.902 INFO:teuthology.orchestra.run.smithi006.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:30.911 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/411 2023-11-28T23:05:30.911 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/411 2023-11-28T23:05:30.911 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:30.918 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:30.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:30.937 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-11-28T23:05:31.340 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:31.351 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:31.351 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:31.636 INFO:teuthology.orchestra.run.smithi006.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:31.644 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/412 2023-11-28T23:05:31.645 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/412 2023-11-28T23:05:31.645 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:31.651 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:31.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:31.673 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-11-28T23:05:32.059 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:32.069 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:32.070 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:32.410 INFO:teuthology.orchestra.run.smithi006.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:32.419 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/413 2023-11-28T23:05:32.419 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/413 2023-11-28T23:05:32.419 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:32.425 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:32.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:32.444 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-11-28T23:05:32.819 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:32.830 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:32.830 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:33.112 INFO:teuthology.orchestra.run.smithi006.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:33.120 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/414 2023-11-28T23:05:33.120 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/414 2023-11-28T23:05:33.120 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:33.126 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:33.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:33.145 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-11-28T23:05:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:33.538 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:33.538 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:33.834 INFO:teuthology.orchestra.run.smithi006.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:33.843 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/415 2023-11-28T23:05:33.843 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/415 2023-11-28T23:05:33.843 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:33.849 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:33.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:33.869 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-11-28T23:05:34.257 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:34.268 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:34.268 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:34.557 INFO:teuthology.orchestra.run.smithi006.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:34.565 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/416 2023-11-28T23:05:34.566 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/416 2023-11-28T23:05:34.566 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:34.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:34.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:34.592 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-11-28T23:05:34.963 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:34.974 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:34.974 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:35.251 INFO:teuthology.orchestra.run.smithi006.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:35.259 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/417 2023-11-28T23:05:35.259 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/417 2023-11-28T23:05:35.259 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:35.267 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:35.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:35.287 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-11-28T23:05:35.663 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:35.674 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:35.674 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:36.055 INFO:teuthology.orchestra.run.smithi006.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-11-28T23:05:36.064 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/418 2023-11-28T23:05:36.064 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/418 2023-11-28T23:05:36.064 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:36.070 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:36.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:36.091 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-11-28T23:05:36.451 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:36.462 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:36.463 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:36.823 INFO:teuthology.orchestra.run.smithi006.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:36.832 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/419 2023-11-28T23:05:36.832 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/419 2023-11-28T23:05:36.832 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:36.838 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:36.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:36.859 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-11-28T23:05:37.259 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:37.270 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:37.270 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:38.949 INFO:teuthology.orchestra.run.smithi006.stdout:generic/420 1s 2023-11-28T23:05:38.962 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/420 2023-11-28T23:05:38.962 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:38.968 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:39.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:39.018 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-11-28T23:05:39.739 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:39.750 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:39.750 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:40.150 INFO:teuthology.orchestra.run.smithi006.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:40.158 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/421 2023-11-28T23:05:40.159 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/421 2023-11-28T23:05:40.159 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:40.165 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:40.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:40.185 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-11-28T23:05:40.583 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:40.594 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:40.886 INFO:teuthology.orchestra.run.smithi006.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:40.894 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/422 2023-11-28T23:05:40.894 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/422 2023-11-28T23:05:40.894 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:40.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:40.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:40.921 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-11-28T23:05:41.292 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:41.302 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:41.302 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:41.832 INFO:teuthology.orchestra.run.smithi006.stdout:generic/423 0s 2023-11-28T23:05:41.845 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/423 2023-11-28T23:05:41.845 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:41.852 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:41.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:41.926 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-11-28T23:05:42.591 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:42.601 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:42.941 INFO:teuthology.orchestra.run.smithi006.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-11-28T23:05:42.949 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/424 2023-11-28T23:05:42.949 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/424 2023-11-28T23:05:42.949 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:42.956 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:42.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:42.975 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-11-28T23:05:43.349 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:43.381 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:43.381 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:43.636 INFO:teuthology.orchestra.run.smithi006.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:05:43.644 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/425 2023-11-28T23:05:43.644 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/425 2023-11-28T23:05:43.644 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:05:43.651 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:05:43.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:05:43.671 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-11-28T23:05:44.048 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:05:44.058 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:05:44.058 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:12.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:12.328 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:22.056 INFO:teuthology.orchestra.run.smithi006.stdout:generic/426 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/426.out.bad) 2023-11-28T23:06:22.072 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/426.out 2023-11-28 21:09:26.590875870 +0000 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/426.out.bad 2023-11-28 23:06:22.048130397 +0000 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,5 +1,221 @@ 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 426 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: test_file_handles TEST_DIR/426-dir -d 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000808) opened an unlinked file! 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000809) opened an unlinked file! 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000810) opened an unlinked file! 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000811) opened an unlinked file! 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000812) opened an unlinked file! 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000813) opened an unlinked file! 2023-11-28T23:06:22.073 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000814) opened an unlinked file! 2023-11-28T23:06:22.074 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000815) opened an unlinked file! 2023-11-28T23:06:22.074 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000816) opened an unlinked file! 2023-11-28T23:06:22.074 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000817) opened an unlinked file! 2023-11-28T23:06:22.074 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000818) opened an unlinked file! 2023-11-28T23:06:22.074 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000819) opened an unlinked file! 2023-11-28T23:06:22.074 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000820) opened an unlinked file! 2023-11-28T23:06:22.074 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000821) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000822) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000823) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000824) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000825) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000826) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000827) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000828) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000829) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000830) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000831) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000832) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000833) opened an unlinked file! 2023-11-28T23:06:22.075 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000834) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000835) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000836) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000837) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000838) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000839) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000840) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000841) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000842) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000843) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000844) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000845) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000846) opened an unlinked file! 2023-11-28T23:06:22.076 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000847) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000848) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000849) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000850) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000851) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000852) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000853) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000854) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000855) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000856) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000857) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000858) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000859) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000860) opened an unlinked file! 2023-11-28T23:06:22.077 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000861) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000862) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000863) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000864) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000865) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000866) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000867) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000868) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000869) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000870) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000871) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000872) opened an unlinked file! 2023-11-28T23:06:22.078 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000873) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000874) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000875) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000876) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000877) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000878) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000879) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000880) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000881) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000882) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000883) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000884) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000885) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000886) opened an unlinked file! 2023-11-28T23:06:22.079 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000887) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000888) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000889) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000890) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000891) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000892) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000893) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000894) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000895) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000896) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000897) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000898) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000899) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000900) opened an unlinked file! 2023-11-28T23:06:22.080 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000901) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000902) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000903) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000904) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000905) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000906) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000907) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000908) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000909) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000910) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000911) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000912) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000913) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000914) opened an unlinked file! 2023-11-28T23:06:22.081 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000915) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000916) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000917) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000918) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000919) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000920) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000921) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000922) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000923) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000924) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000925) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000926) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000927) opened an unlinked file! 2023-11-28T23:06:22.082 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000928) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000929) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000930) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000931) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000932) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000933) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000934) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000935) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000936) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000937) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000938) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000939) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000940) opened an unlinked file! 2023-11-28T23:06:22.083 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000941) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000942) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000943) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000944) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000945) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000946) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000947) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000948) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000949) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000950) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000951) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000952) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000953) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000954) opened an unlinked file! 2023-11-28T23:06:22.084 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000955) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000956) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000957) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000958) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000959) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000960) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000961) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000962) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000963) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000964) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000965) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000966) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000967) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000968) opened an unlinked file! 2023-11-28T23:06:22.085 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000969) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000970) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000971) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000972) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000973) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000974) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000975) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000976) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000977) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000978) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000979) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000980) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000981) opened an unlinked file! 2023-11-28T23:06:22.086 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000982) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000983) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000984) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000985) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000986) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000987) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000988) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000989) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000990) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000991) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000992) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000993) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000994) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000995) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000996) opened an unlinked file! 2023-11-28T23:06:22.087 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000997) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000998) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file000999) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001000) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001001) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001002) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001003) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001004) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001005) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001006) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001007) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001008) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001009) opened an unlinked file! 2023-11-28T23:06:22.088 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001010) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001011) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001012) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001013) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001014) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001015) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001016) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001017) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001018) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001019) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001020) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001021) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001022) opened an unlinked file! 2023-11-28T23:06:22.089 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/426-dir/file001023) opened an unlinked file! 2023-11-28T23:06:22.090 INFO:teuthology.orchestra.run.smithi006.stdout: test_file_handles TEST_DIR/426-dir 2023-11-28T23:06:22.090 INFO:teuthology.orchestra.run.smithi006.stdout: test_file_handles TEST_DIR/426-dir -l 2023-11-28T23:06:22.090 INFO:teuthology.orchestra.run.smithi006.stdout: test_file_handles TEST_DIR/426-dir -u 2023-11-28T23:06:22.099 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/426 2023-11-28T23:06:22.099 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/426 2023-11-28T23:06:22.099 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T23:06:22.135 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:22.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T23:06:22.199 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T23:06:22.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T23:06:22.200 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-11-28T23:06:24.284 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:24.295 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:24.764 INFO:teuthology.orchestra.run.smithi006.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:06:24.772 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/427 2023-11-28T23:06:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/427 2023-11-28T23:06:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:24.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:24.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:24.800 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-11-28T23:06:25.179 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:25.190 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:25.319 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:25.585 INFO:teuthology.orchestra.run.smithi006.stdout:generic/428 0s 2023-11-28T23:06:25.598 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/428 2023-11-28T23:06:25.598 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:25.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:25.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:25.627 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-11-28T23:06:26.011 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:26.022 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:26.022 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:26.378 INFO:teuthology.orchestra.run.smithi006.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:06:26.386 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/429 2023-11-28T23:06:26.387 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/429 2023-11-28T23:06:26.387 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:26.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:26.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:26.415 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-11-28T23:06:26.820 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:26.830 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:26.831 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:27.420 INFO:teuthology.orchestra.run.smithi006.stdout:generic/430 1s 2023-11-28T23:06:27.433 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/430 2023-11-28T23:06:27.433 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:27.439 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:27.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:27.463 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-11-28T23:06:28.188 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:28.199 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:28.199 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:28.707 INFO:teuthology.orchestra.run.smithi006.stdout:generic/431 0s 2023-11-28T23:06:28.720 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/431 2023-11-28T23:06:28.720 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:28.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:28.748 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-11-28T23:06:29.464 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:29.475 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:29.475 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:30.054 INFO:teuthology.orchestra.run.smithi006.stdout:generic/432 1s 2023-11-28T23:06:30.068 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/432 2023-11-28T23:06:30.068 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:30.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:30.251 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-11-28T23:06:30.831 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:30.841 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:30.842 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:31.328 INFO:teuthology.orchestra.run.smithi006.stdout:generic/433 1s 2023-11-28T23:06:31.340 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/433 2023-11-28T23:06:31.340 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:31.347 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:31.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:31.543 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-11-28T23:06:32.087 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:32.097 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:32.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:32.564 INFO:teuthology.orchestra.run.smithi006.stdout:generic/434 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/434.out.bad) 2023-11-28T23:06:32.569 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/434.out 2023-11-28 21:09:26.590875870 +0000 2023-11-28T23:06:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/434.out.bad 2023-11-28 23:06:32.560020838 +0000 2023-11-28T23:06:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -9,6 +9,6 @@ 2023-11-28T23:06:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: copy_range: Bad file descriptor 2023-11-28T23:06:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-11-28T23:06:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: Try to copy to a device 2023-11-28T23:06:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: -copy_range: Invalid argument 2023-11-28T23:06:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: +/tmp/tmp.Vq8HeyZOWwtest/test-434/dev1: Permission denied 2023-11-28T23:06:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: Try to copy to a fifo 2023-11-28T23:06:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: copy_range: Invalid argument 2023-11-28T23:06:32.575 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/434 2023-11-28T23:06:32.575 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/434 2023-11-28T23:06:32.575 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T23:06:32.582 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:32.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T23:06:32.605 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T23:06:32.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T23:06:32.606 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-11-28T23:06:33.308 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:33.318 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:33.319 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:33.685 INFO:teuthology.orchestra.run.smithi006.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:06:33.694 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/435 2023-11-28T23:06:33.694 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/435 2023-11-28T23:06:33.694 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:33.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:33.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:33.722 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-11-28T23:06:34.095 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:34.106 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:34.106 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:35.456 INFO:teuthology.orchestra.run.smithi006.stdout:generic/436 1s 2023-11-28T23:06:35.470 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/436 2023-11-28T23:06:35.470 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:35.476 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:35.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:35.691 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-11-28T23:06:36.227 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:36.238 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:36.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:37.390 INFO:teuthology.orchestra.run.smithi006.stdout:generic/437 1s 2023-11-28T23:06:37.403 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/437 2023-11-28T23:06:37.403 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:06:37.409 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:37.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:06:37.431 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-11-28T23:06:37.824 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:06:37.834 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:06:37.835 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:06:43.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:43.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:14.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:14.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:44.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:44.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:14.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:14.261 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:24.546 INFO:teuthology.orchestra.run.smithi006.stdout:generic/438 107s 2023-11-28T23:08:24.559 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/438 2023-11-28T23:08:24.559 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:24.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:24.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:24.587 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-11-28T23:08:24.972 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:24.982 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:24.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:25.274 INFO:teuthology.orchestra.run.smithi006.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:25.282 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/439 2023-11-28T23:08:25.282 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/439 2023-11-28T23:08:25.283 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:25.288 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:25.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:25.308 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-11-28T23:08:25.683 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:25.694 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:25.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:26.046 INFO:teuthology.orchestra.run.smithi006.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:26.054 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/440 2023-11-28T23:08:26.054 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/440 2023-11-28T23:08:26.054 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:26.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:26.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:26.080 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-11-28T23:08:26.456 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:26.466 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:26.467 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:26.834 INFO:teuthology.orchestra.run.smithi006.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:26.842 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/441 2023-11-28T23:08:26.842 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/441 2023-11-28T23:08:26.842 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:26.848 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:26.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:26.869 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-11-28T23:08:27.252 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:27.266 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:27.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:27.585 INFO:teuthology.orchestra.run.smithi006.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:27.594 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/442 2023-11-28T23:08:27.594 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/442 2023-11-28T23:08:27.594 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:27.600 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:27.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:27.621 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-11-28T23:08:28.021 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:28.032 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:28.032 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:28.591 INFO:teuthology.orchestra.run.smithi006.stdout:generic/443 0s 2023-11-28T23:08:28.604 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/443 2023-11-28T23:08:28.604 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:28.611 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:28.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:28.633 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-11-28T23:08:29.027 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:29.038 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:29.038 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:29.373 INFO:teuthology.orchestra.run.smithi006.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T23:08:29.382 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/444 2023-11-28T23:08:29.382 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/444 2023-11-28T23:08:29.382 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:29.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:29.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:29.408 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-11-28T23:08:29.791 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:29.802 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:29.802 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:31.025 INFO:teuthology.orchestra.run.smithi006.stdout:generic/445 2s 2023-11-28T23:08:31.038 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/445 2023-11-28T23:08:31.038 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:31.045 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:31.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:31.174 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-11-28T23:08:31.783 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:31.794 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:31.794 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:32.069 INFO:teuthology.orchestra.run.smithi006.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:32.078 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/446 2023-11-28T23:08:32.078 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/446 2023-11-28T23:08:32.078 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:32.085 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:32.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:32.105 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-11-28T23:08:32.460 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:32.470 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:32.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:32.764 INFO:teuthology.orchestra.run.smithi006.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:32.772 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/447 2023-11-28T23:08:32.773 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/447 2023-11-28T23:08:32.773 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:32.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:32.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:32.799 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-11-28T23:08:33.181 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:33.192 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:33.192 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:34.716 INFO:teuthology.orchestra.run.smithi006.stdout:generic/448 1s 2023-11-28T23:08:34.964 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/448 2023-11-28T23:08:34.964 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:34.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:35.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:35.013 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-11-28T23:08:35.676 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:35.687 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:35.687 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:36.242 INFO:teuthology.orchestra.run.smithi006.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:36.248 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/449 2023-11-28T23:08:36.248 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/449 2023-11-28T23:08:36.248 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:36.255 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:36.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:36.275 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-11-28T23:08:36.644 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:36.655 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:36.655 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:38.261 INFO:teuthology.orchestra.run.smithi006.stdout:generic/450 2s 2023-11-28T23:08:38.274 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/450 2023-11-28T23:08:38.274 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:38.281 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:38.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:38.311 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-11-28T23:08:38.987 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:38.998 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:38.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:39.658 INFO:teuthology.orchestra.run.smithi006.stdout:generic/451 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/451.out.bad) 2023-11-28T23:08:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/451.out 2023-11-28 21:09:26.594875839 +0000 2023-11-28T23:08:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/451.out.bad 2023-11-28 23:08:39.654700994 +0000 2023-11-28T23:08:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,2 +1,5 @@ 2023-11-28T23:08:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 451 2023-11-28T23:08:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: +get stale data from buffer read 2023-11-28T23:08:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2023-11-28T23:08:39.664 INFO:teuthology.orchestra.run.smithi006.stdout: +000a0000 2023-11-28T23:08:39.665 INFO:teuthology.orchestra.run.smithi006.stdout: Silence is golden 2023-11-28T23:08:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/451 2023-11-28T23:08:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/451 2023-11-28T23:08:39.670 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T23:08:39.676 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:39.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T23:08:39.695 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T23:08:39.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T23:08:39.696 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-11-28T23:08:40.387 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:40.399 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:40.399 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:40.669 INFO:teuthology.orchestra.run.smithi006.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:40.678 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/452 2023-11-28T23:08:40.679 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/452 2023-11-28T23:08:40.679 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:40.684 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:40.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:40.705 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-11-28T23:08:41.083 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:41.094 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:41.095 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:41.360 INFO:teuthology.orchestra.run.smithi006.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:41.368 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/453 2023-11-28T23:08:41.368 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/453 2023-11-28T23:08:41.368 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:41.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:41.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:41.395 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-11-28T23:08:41.805 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:41.816 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:41.816 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:42.117 INFO:teuthology.orchestra.run.smithi006.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:42.125 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/454 2023-11-28T23:08:42.125 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/454 2023-11-28T23:08:42.125 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:42.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:42.152 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-11-28T23:08:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:42.531 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:42.954 INFO:teuthology.orchestra.run.smithi006.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:42.970 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/455 2023-11-28T23:08:42.970 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/455 2023-11-28T23:08:42.971 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:42.974 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:42.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:42.991 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-11-28T23:08:43.384 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:43.395 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:43.395 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:43.696 INFO:teuthology.orchestra.run.smithi006.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:43.703 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/456 2023-11-28T23:08:43.704 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/456 2023-11-28T23:08:43.704 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:43.710 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:43.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:43.732 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-11-28T23:08:44.108 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:44.119 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:44.119 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:44.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:44.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:44.499 INFO:teuthology.orchestra.run.smithi006.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:44.508 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/457 2023-11-28T23:08:44.508 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/457 2023-11-28T23:08:44.508 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:44.514 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:44.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:44.535 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-11-28T23:08:44.911 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:44.922 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:44.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:45.196 INFO:teuthology.orchestra.run.smithi006.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:45.204 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/458 2023-11-28T23:08:45.204 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/458 2023-11-28T23:08:45.205 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:45.211 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:45.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:45.232 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-11-28T23:08:45.616 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:45.627 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:45.627 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:46.090 INFO:teuthology.orchestra.run.smithi006.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:46.098 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/459 2023-11-28T23:08:46.099 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/459 2023-11-28T23:08:46.099 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:46.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:46.125 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-11-28T23:08:46.507 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:46.518 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:46.518 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:46.805 INFO:teuthology.orchestra.run.smithi006.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:46.814 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/460 2023-11-28T23:08:46.814 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/460 2023-11-28T23:08:46.814 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:46.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:46.840 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-11-28T23:08:47.211 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:47.222 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:47.222 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:47.496 INFO:teuthology.orchestra.run.smithi006.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:47.504 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/461 2023-11-28T23:08:47.505 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/461 2023-11-28T23:08:47.505 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:47.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:47.532 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-11-28T23:08:47.912 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:47.922 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:47.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:48.219 INFO:teuthology.orchestra.run.smithi006.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:48.227 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/462 2023-11-28T23:08:48.227 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/462 2023-11-28T23:08:48.227 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:48.234 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:48.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:48.254 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-11-28T23:08:48.667 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:48.679 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:48.679 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:49.054 INFO:teuthology.orchestra.run.smithi006.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T23:08:49.062 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/463 2023-11-28T23:08:49.062 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/463 2023-11-28T23:08:49.062 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:49.068 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:49.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:49.097 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-11-28T23:08:49.799 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:49.810 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:49.810 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:50.093 INFO:teuthology.orchestra.run.smithi006.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:08:50.102 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/464 2023-11-28T23:08:50.102 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/464 2023-11-28T23:08:50.102 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:08:50.107 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:08:50.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:50.127 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-11-28T23:08:50.523 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:08:50.534 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:08:50.534 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:06.039 INFO:teuthology.orchestra.run.smithi006.stdout:generic/465 15s 2023-11-28T23:09:06.119 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/465 2023-11-28T23:09:06.119 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:09:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:06.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:09:06.225 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-11-28T23:09:06.715 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:09:06.726 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:09:06.727 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:07.030 INFO:teuthology.orchestra.run.smithi006.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:09:07.039 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/466 2023-11-28T23:09:07.039 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/466 2023-11-28T23:09:07.039 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:09:07.045 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:07.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:09:07.065 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-11-28T23:09:07.431 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:09:07.442 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:09:07.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:14.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:14.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:15.136 INFO:teuthology.orchestra.run.smithi006.stdout:generic/467 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/467.out.bad) 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/467.out 2023-11-28 21:09:26.594875839 +0000 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/467.out.bad 2023-11-28 23:09:15.114316985 +0000 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,5 +1,15 @@ 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 467 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000000) opened an unlinked file! 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000001) opened an unlinked file! 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000002) opened an unlinked file! 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000003) opened an unlinked file! 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000004) opened an unlinked file! 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000005) opened an unlinked file! 2023-11-28T23:09:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000006) opened an unlinked file! 2023-11-28T23:09:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000007) opened an unlinked file! 2023-11-28T23:09:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000008) opened an unlinked file! 2023-11-28T23:09:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: +open_by_handle(/tmp/tmp.Vq8HeyZOWwtest/467-dir/file000009) opened an unlinked file! 2023-11-28T23:09:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-11-28T23:09:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-11-28T23:09:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-11-28T23:09:15.184 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/467 2023-11-28T23:09:15.184 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/467 2023-11-28T23:09:15.184 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T23:09:15.229 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:15.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T23:09:15.388 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T23:09:15.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T23:09:15.389 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-11-28T23:09:16.738 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:09:16.748 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:09:16.749 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:17.083 INFO:teuthology.orchestra.run.smithi006.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:09:17.091 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/468 2023-11-28T23:09:17.091 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/468 2023-11-28T23:09:17.092 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:09:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:17.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:09:17.118 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-11-28T23:09:17.479 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:09:17.489 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:09:17.490 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:20.278 INFO:teuthology.orchestra.run.smithi006.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T23:09:20.286 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/469 2023-11-28T23:09:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/469 2023-11-28T23:09:20.287 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:09:20.293 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:20.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:09:20.330 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-11-28T23:09:21.012 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:09:21.023 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:09:21.023 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:21.379 INFO:teuthology.orchestra.run.smithi006.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:09:21.387 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/470 2023-11-28T23:09:21.388 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/470 2023-11-28T23:09:21.388 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:09:21.394 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:21.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:09:21.415 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-11-28T23:09:21.800 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:09:21.811 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:09:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:09:45.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:45.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:16.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:16.386 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:26.733 INFO:teuthology.orchestra.run.smithi006.stdout:generic/471 65s 2023-11-28T23:10:26.746 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/471 2023-11-28T23:10:26.747 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:10:26.752 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:26.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:10:26.773 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-11-28T23:10:27.911 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:10:27.951 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:10:27.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:28.540 INFO:teuthology.orchestra.run.smithi006.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:10:28.548 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/472 2023-11-28T23:10:28.548 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/472 2023-11-28T23:10:28.548 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:10:28.554 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:28.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:10:28.575 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-11-28T23:10:28.980 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:10:28.990 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:10:28.991 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:29.355 INFO:teuthology.orchestra.run.smithi006.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T23:10:29.364 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/473 2023-11-28T23:10:29.364 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/473 2023-11-28T23:10:29.364 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:10:29.370 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:29.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:10:29.391 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-11-28T23:10:29.791 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:10:29.802 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:10:29.802 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:30.096 INFO:teuthology.orchestra.run.smithi006.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:10:30.104 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/474 2023-11-28T23:10:30.104 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/474 2023-11-28T23:10:30.104 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:10:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:30.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:10:30.131 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-11-28T23:10:30.510 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:10:30.518 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:10:30.518 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:30.865 INFO:teuthology.orchestra.run.smithi006.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:10:30.873 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/475 2023-11-28T23:10:30.874 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/475 2023-11-28T23:10:30.874 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:10:30.880 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:30.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:10:30.900 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-11-28T23:10:31.275 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:10:31.286 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:10:31.286 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:31.750 INFO:teuthology.orchestra.run.smithi006.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:10:31.758 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/476 2023-11-28T23:10:31.759 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/476 2023-11-28T23:10:31.759 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:10:31.765 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:31.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:10:31.786 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-11-28T23:10:32.172 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:10:32.183 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:10:32.183 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:46.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:46.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:47.976 INFO:teuthology.orchestra.run.smithi006.stdout:generic/477 15s 2023-11-28T23:10:48.290 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/477 2023-11-28T23:10:48.290 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:10:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:10:48.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:10:48.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-11-28T23:10:49.486 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:10:49.496 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:10:49.496 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:00.480 INFO:teuthology.orchestra.run.smithi006.stdout:generic/478 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/478.out.bad) 2023-11-28T23:11:00.486 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/478.out 2023-11-28 21:09:26.594875839 +0000 2023-11-28T23:11:00.486 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/478.out.bad 2023-11-28 23:11:00.473099689 +0000 2023-11-28T23:11:00.486 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -10,7 +10,7 @@ 2023-11-28T23:11:00.486 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.486 INFO:teuthology.orchestra.run.smithi006.stdout: get wrlck 2023-11-28T23:11:00.486 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.486 INFO:teuthology.orchestra.run.smithi006.stdout: -lock could be placed 2023-11-28T23:11:00.486 INFO:teuthology.orchestra.run.smithi006.stdout: +get wrlck 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -25,19 +25,19 @@ 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: get wrlck 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: -lock could be placed 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: +get wrlck 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.487 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: get rdlck 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: -lock could be placed 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: +get rdlck 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: get rdlck 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: get rdlck 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: get rdlck 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: get rdlck 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: -lock could be placed 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: +get rdlck 2023-11-28T23:11:00.488 INFO:teuthology.orchestra.run.smithi006.stdout: get rdlck 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: get rdlck 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -46,7 +46,7 @@ 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: get rdlck 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: get rdlck 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: -lock could be placed 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: +get rdlck 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.489 INFO:teuthology.orchestra.run.smithi006.stdout: lock could be placed 2023-11-28T23:11:00.492 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/478 2023-11-28T23:11:00.492 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/478 2023-11-28T23:11:00.492 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T23:11:00.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:00.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T23:11:00.522 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T23:11:00.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T23:11:00.522 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-11-28T23:11:00.907 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:00.918 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:00.918 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:01.266 INFO:teuthology.orchestra.run.smithi006.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/479 2023-11-28T23:11:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/479 2023-11-28T23:11:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:01.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:01.301 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-11-28T23:11:01.676 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:01.686 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:01.687 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:01.988 INFO:teuthology.orchestra.run.smithi006.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:01.996 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/480 2023-11-28T23:11:01.996 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/480 2023-11-28T23:11:01.997 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:02.003 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:02.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:02.022 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-11-28T23:11:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:02.406 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:02.406 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:02.723 INFO:teuthology.orchestra.run.smithi006.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:02.731 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/481 2023-11-28T23:11:02.731 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/481 2023-11-28T23:11:02.732 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:02.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:02.757 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-11-28T23:11:03.156 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:03.167 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:03.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:03.603 INFO:teuthology.orchestra.run.smithi006.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:03.611 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/482 2023-11-28T23:11:03.612 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/482 2023-11-28T23:11:03.612 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:03.618 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:03.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:03.638 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-11-28T23:11:04.020 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:04.030 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:04.326 INFO:teuthology.orchestra.run.smithi006.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:04.335 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/483 2023-11-28T23:11:04.335 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/483 2023-11-28T23:11:04.335 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:04.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:04.362 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-11-28T23:11:04.727 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:04.738 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:04.738 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:05.046 INFO:teuthology.orchestra.run.smithi006.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:05.055 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/484 2023-11-28T23:11:05.055 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/484 2023-11-28T23:11:05.055 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:05.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:05.122 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-11-28T23:11:05.503 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:05.514 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:05.514 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:07.090 INFO:teuthology.orchestra.run.smithi006.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-28T23:11:07.098 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/485 2023-11-28T23:11:07.098 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/485 2023-11-28T23:11:07.098 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:07.105 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:07.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:07.124 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-11-28T23:11:07.824 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:07.835 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:07.835 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:08.160 INFO:teuthology.orchestra.run.smithi006.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:08.169 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/486 2023-11-28T23:11:08.169 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/486 2023-11-28T23:11:08.169 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:08.175 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:08.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:08.195 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-11-28T23:11:08.581 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:08.592 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:08.925 INFO:teuthology.orchestra.run.smithi006.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:08.934 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/487 2023-11-28T23:11:08.934 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/487 2023-11-28T23:11:08.934 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:08.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:08.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:08.960 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-11-28T23:11:09.355 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:09.366 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:09.367 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:09.662 INFO:teuthology.orchestra.run.smithi006.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:09.667 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/488 2023-11-28T23:11:09.667 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/488 2023-11-28T23:11:09.667 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:09.674 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:09.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:09.693 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-11-28T23:11:10.060 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:10.071 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:10.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:10.382 INFO:teuthology.orchestra.run.smithi006.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:10.391 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/489 2023-11-28T23:11:10.391 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/489 2023-11-28T23:11:10.391 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:10.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:10.417 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-11-28T23:11:10.803 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:10.814 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:10.814 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:12.142 INFO:teuthology.orchestra.run.smithi006.stdout:generic/490 2s 2023-11-28T23:11:12.155 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/490 2023-11-28T23:11:12.156 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:12.162 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:12.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:12.190 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-11-28T23:11:12.892 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:12.903 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:12.903 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:13.236 INFO:teuthology.orchestra.run.smithi006.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:13.245 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/491 2023-11-28T23:11:13.245 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/491 2023-11-28T23:11:13.245 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:13.252 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:13.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:13.272 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-11-28T23:11:13.648 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:13.659 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:13.659 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:13.944 INFO:teuthology.orchestra.run.smithi006.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:13.952 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/492 2023-11-28T23:11:13.952 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/492 2023-11-28T23:11:13.952 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:14.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:14.038 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-11-28T23:11:14.432 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:14.444 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:14.444 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:14.751 INFO:teuthology.orchestra.run.smithi006.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:14.760 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/493 2023-11-28T23:11:14.760 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/493 2023-11-28T23:11:14.760 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:14.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:14.787 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-11-28T23:11:15.168 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:15.179 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:15.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:15.472 INFO:teuthology.orchestra.run.smithi006.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:15.480 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/494 2023-11-28T23:11:15.480 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/494 2023-11-28T23:11:15.481 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:15.487 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:15.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:15.506 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-11-28T23:11:15.871 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:15.882 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:16.164 INFO:teuthology.orchestra.run.smithi006.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:16.172 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/495 2023-11-28T23:11:16.172 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/495 2023-11-28T23:11:16.173 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:16.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:16.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:16.199 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-11-28T23:11:16.590 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:16.600 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:16.883 INFO:teuthology.orchestra.run.smithi006.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:16.892 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/496 2023-11-28T23:11:16.892 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/496 2023-11-28T23:11:16.892 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:16.898 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:16.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:16.919 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-11-28T23:11:17.304 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:17.315 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:17.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:17.590 INFO:teuthology.orchestra.run.smithi006.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:17.598 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/497 2023-11-28T23:11:17.598 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/497 2023-11-28T23:11:17.598 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:17.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:17.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:17.624 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-11-28T23:11:17.988 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:17.998 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:18.315 INFO:teuthology.orchestra.run.smithi006.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:18.324 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/498 2023-11-28T23:11:18.324 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/498 2023-11-28T23:11:18.324 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:18.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:18.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:18.364 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:18.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:18.390 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-11-28T23:11:18.839 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:18.850 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:19.142 INFO:teuthology.orchestra.run.smithi006.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:19.150 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/499 2023-11-28T23:11:19.151 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/499 2023-11-28T23:11:19.151 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:19.157 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:19.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:19.222 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-11-28T23:11:19.596 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:19.607 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:19.607 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:19.957 INFO:teuthology.orchestra.run.smithi006.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:19.965 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/500 2023-11-28T23:11:19.965 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/500 2023-11-28T23:11:19.965 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:19.972 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:19.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:19.991 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-11-28T23:11:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:20.375 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:20.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:20.715 INFO:teuthology.orchestra.run.smithi006.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:20.723 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/501 2023-11-28T23:11:20.723 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/501 2023-11-28T23:11:20.724 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:20.730 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:20.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:20.751 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-11-28T23:11:21.115 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:21.126 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:21.456 INFO:teuthology.orchestra.run.smithi006.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:21.464 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/502 2023-11-28T23:11:21.465 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/502 2023-11-28T23:11:21.465 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:21.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:21.491 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-11-28T23:11:21.863 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:21.874 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:21.874 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:22.165 INFO:teuthology.orchestra.run.smithi006.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:22.174 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/503 2023-11-28T23:11:22.174 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/503 2023-11-28T23:11:22.174 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:22.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:22.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:22.200 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-11-28T23:11:22.592 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:22.602 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:22.603 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:22.990 INFO:teuthology.orchestra.run.smithi006.stdout:generic/504 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/504.out.bad) 2023-11-28T23:11:22.997 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/504.out 2023-11-28 21:09:26.598875808 +0000 2023-11-28T23:11:22.997 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/504.out.bad 2023-11-28 23:11:22.984841830 +0000 2023-11-28T23:11:22.997 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,2 +1,3 @@ 2023-11-28T23:11:22.997 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 504 2023-11-28T23:11:22.998 INFO:teuthology.orchestra.run.smithi006.stdout: +lock info not found 2023-11-28T23:11:22.998 INFO:teuthology.orchestra.run.smithi006.stdout: Silence is golden 2023-11-28T23:11:23.002 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/504 2023-11-28T23:11:23.002 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/504 2023-11-28T23:11:23.002 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-28T23:11:23.008 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:23.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T23:11:23.028 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T23:11:23.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T23:11:23.028 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-11-28T23:11:23.405 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:23.415 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:23.415 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:23.739 INFO:teuthology.orchestra.run.smithi006.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:23.747 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/505 2023-11-28T23:11:23.747 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/505 2023-11-28T23:11:23.747 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:23.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:23.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:23.773 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-11-28T23:11:24.143 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:24.154 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:24.154 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:24.456 INFO:teuthology.orchestra.run.smithi006.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:24.464 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/506 2023-11-28T23:11:24.464 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/506 2023-11-28T23:11:24.464 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:24.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:24.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:24.491 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-11-28T23:11:24.872 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:24.882 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:24.882 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:25.245 INFO:teuthology.orchestra.run.smithi006.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-11-28T23:11:25.253 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/507 2023-11-28T23:11:25.254 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/507 2023-11-28T23:11:25.254 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:25.260 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:25.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:25.280 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-11-28T23:11:25.655 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:25.666 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:25.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:25.967 INFO:teuthology.orchestra.run.smithi006.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-11-28T23:11:25.975 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/508 2023-11-28T23:11:25.976 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/508 2023-11-28T23:11:25.976 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:25.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:26.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:26.003 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-11-28T23:11:26.376 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:26.386 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:26.387 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:26.679 INFO:teuthology.orchestra.run.smithi006.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:26.688 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/509 2023-11-28T23:11:26.688 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/509 2023-11-28T23:11:26.688 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:26.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:26.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:26.714 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-11-28T23:11:27.088 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:27.098 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:27.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:27.386 INFO:teuthology.orchestra.run.smithi006.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:27.394 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/510 2023-11-28T23:11:27.394 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/510 2023-11-28T23:11:27.395 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:27.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:27.420 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-11-28T23:11:27.792 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:27.803 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:27.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:28.082 INFO:teuthology.orchestra.run.smithi006.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:28.090 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/511 2023-11-28T23:11:28.090 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/511 2023-11-28T23:11:28.090 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:28.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:28.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:28.117 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-11-28T23:11:28.504 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:28.514 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:28.514 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:28.806 INFO:teuthology.orchestra.run.smithi006.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:28.815 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/512 2023-11-28T23:11:28.815 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/512 2023-11-28T23:11:28.815 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:28.821 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:28.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:28.842 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-11-28T23:11:29.240 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:29.251 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:29.251 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:29.535 INFO:teuthology.orchestra.run.smithi006.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:29.543 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/513 2023-11-28T23:11:29.543 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/513 2023-11-28T23:11:29.543 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:29.550 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:29.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:29.602 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-11-28T23:11:29.963 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:29.973 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:29.974 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:30.265 INFO:teuthology.orchestra.run.smithi006.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:30.274 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/514 2023-11-28T23:11:30.274 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/514 2023-11-28T23:11:30.274 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:30.280 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:30.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:30.334 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-11-28T23:11:30.731 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:30.742 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:30.742 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:31.029 INFO:teuthology.orchestra.run.smithi006.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:31.037 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/515 2023-11-28T23:11:31.037 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/515 2023-11-28T23:11:31.037 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:31.044 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:31.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:31.114 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-11-28T23:11:31.496 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:31.507 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:31.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:31.882 INFO:teuthology.orchestra.run.smithi006.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T23:11:31.891 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/516 2023-11-28T23:11:31.891 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/516 2023-11-28T23:11:31.891 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:31.897 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:31.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:31.917 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-11-28T23:11:32.598 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:32.612 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:32.612 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:32.895 INFO:teuthology.orchestra.run.smithi006.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:32.903 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/517 2023-11-28T23:11:32.904 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/517 2023-11-28T23:11:32.904 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:32.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:32.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:32.931 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-11-28T23:11:33.300 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:33.311 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:33.311 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:33.597 INFO:teuthology.orchestra.run.smithi006.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/518 2023-11-28T23:11:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/518 2023-11-28T23:11:33.606 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:33.612 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:33.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:33.674 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-11-28T23:11:34.072 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:34.083 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:34.083 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:34.378 INFO:teuthology.orchestra.run.smithi006.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:34.386 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/519 2023-11-28T23:11:34.386 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/519 2023-11-28T23:11:34.386 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:34.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:34.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:34.412 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-11-28T23:11:34.808 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:34.818 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:34.818 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:35.115 INFO:teuthology.orchestra.run.smithi006.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T23:11:35.124 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/520 2023-11-28T23:11:35.124 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/520 2023-11-28T23:11:35.124 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-28T23:11:35.130 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:35.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:11:35.150 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-11-28T23:11:35.523 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-28T23:11:35.534 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:11:35.535 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-28T23:11:48.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:48.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:18.484 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:18.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:48.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:48.566 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:18.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:18.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:48.784 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:48.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:18.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:18.855 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:48.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:48.907 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:19.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:19.080 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:49.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:49.194 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:19.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:19.250 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:49.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:49.322 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:19.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:19.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:49.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:49.454 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:19.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:19.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:49.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:49.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:19.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:19.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:49.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:49.674 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:19.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:19.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:49.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:49.783 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:19.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:19.837 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:49.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:49.902 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:20.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:20.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:50.829 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:50.833 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:20.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:20.993 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:51.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:51.048 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:21.099 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:21.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:51.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:51.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:21.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:21.272 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:51.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:51.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:51.414 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-28T23:25:51.409+0000 7f2a876be640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45389) UID: 0 2023-11-28T23:25:51.414 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-28T23:25:51.409+0000 7fb8081c7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45389) UID: 0 2023-11-28T23:25:51.414 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-28T23:25:51.409+0000 7f7a6b89b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45389) UID: 0 2023-11-28T23:25:51.415 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-28T23:25:51.409+0000 7f7b17a67640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45389) UID: 0 2023-11-28T23:28:19.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:19.060 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:49.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:49.140 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:19.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:19.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:49.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:49.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:19.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:19.312 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:19.346 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-28T23:30:19.340+0000 7f18273dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 385133) UID: 0 2023-11-28T23:30:19.347 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-28T23:30:19.340+0000 7f12f141c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 385133) UID: 0 2023-11-28T23:33:11.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:11.044 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:41.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:41.105 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:11.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:11.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:41.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:41.233 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:11.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:11.289 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:41.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:41.344 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:11.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:11.407 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:41.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:41.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:11.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:11.520 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:41.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:41.574 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:11.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:11.629 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:41.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:41.702 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:11.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:11.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:41.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:41.845 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:11.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:11.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:41.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:41.956 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:12.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:12.011 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:42.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:42.066 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:12.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:12.123 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:42.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:42.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:12.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:12.267 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:42.334 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:42.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:12.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:12.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:42.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:42.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:12.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:12.604 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:42.780 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:42.784 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:12.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:12.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:42.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:42.902 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:12.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:12.960 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:43.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:43.014 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:13.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:13.065 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:43.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:43.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:13.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:13.232 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:43.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:43.285 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:13.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:13.342 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:43.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:43.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:13.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:13.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:43.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:43.825 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:13.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:13.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:43.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:43.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:14.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:14.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:44.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:44.088 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:14.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:14.171 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:44.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:44.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:14.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:14.276 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:44.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:44.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:14.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:14.384 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:14.413 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-28T23:56:14.407+0000 7fd4b5852640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 385283) UID: 0 2023-11-28T23:56:14.414 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-28T23:56:14.407+0000 7fe93040a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 385283) UID: 0 2023-11-28T23:56:14.414 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-28T23:56:14.407+0000 7fdf27920640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 385283) UID: 0 2023-11-28T23:56:14.414 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-28T23:56:14.407+0000 7fef6c324640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 385283) UID: 0 2023-11-28T23:58:51.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:51.952 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:22.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:22.037 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:52.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:54.498 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:24.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:24.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:28.771 INFO:tasks.ceph.mon.b.smithi031.stderr:2023-11-29T00:00:28.767+0000 7f049b51d640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45641) UID: 0 2023-11-29T00:00:28.771 INFO:tasks.ceph.mon.b.smithi031.stderr:2023-11-29T00:00:28.767+0000 7f049b51d640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:28.772 INFO:tasks.ceph.mon.c.smithi031.stderr:2023-11-29T00:00:28.767+0000 7f3e952ff640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45641) UID: 0 2023-11-29T00:00:28.772 INFO:tasks.ceph.mon.c.smithi031.stderr:2023-11-29T00:00:28.767+0000 7f3e952ff640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:28.772 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-29T00:00:28.767+0000 7f2a876be640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45641) UID: 0 2023-11-29T00:00:28.772 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-29T00:00:28.767+0000 7f7b17a67640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45641) UID: 0 2023-11-29T00:00:28.773 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-29T00:00:28.767+0000 7fb8081c7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45641) UID: 0 2023-11-29T00:00:28.773 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-29T00:00:28.767+0000 7f7a6b89b640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45641) UID: 0 2023-11-29T00:00:28.773 INFO:tasks.ceph.mds.b.smithi031.stderr:2023-11-29T00:00:28.771+0000 7f9074ced640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45641) UID: 0 2023-11-29T00:00:28.774 INFO:tasks.ceph.mds.d.smithi031.stderr:2023-11-29T00:00:28.771+0000 7f445a8c6640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 45641) UID: 0 2023-11-29T00:00:28.807 INFO:tasks.ceph.mon.c.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f3e952ff640 -1 Fail to open '/proc/45642/cmdline' error = (2) No such file or directory 2023-11-29T00:00:28.807 INFO:tasks.ceph.mon.c.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f3e952ff640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:28.807 INFO:tasks.ceph.mon.c.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f3e952ff640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:28.807 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f2a876be640 -1 Fail to open '/proc/45642/cmdline' error = (2) No such file or directory 2023-11-29T00:00:28.807 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f2a876be640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:28.808 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-29T00:00:28.803+0000 7fb8081c7640 -1 Fail to open '/proc/45642/cmdline' error = (2) No such file or directory 2023-11-29T00:00:28.808 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-11-29T00:00:28.803+0000 7fb8081c7640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:28.808 INFO:tasks.ceph.mds.b.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f9074ced640 -1 Fail to read '/proc/45642/cmdline' error = (3) No such process 2023-11-29T00:00:28.808 INFO:tasks.ceph.mds.b.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f9074ced640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:28.808 INFO:tasks.ceph.mon.b.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f049b51d640 -1 Fail to open '/proc/45642/cmdline' error = (2) No such file or directory 2023-11-29T00:00:28.809 INFO:tasks.ceph.mon.b.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f049b51d640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:28.809 INFO:tasks.ceph.mon.b.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f049b51d640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:28.809 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f7b17a67640 -1 Fail to open '/proc/45642/cmdline' error = (2) No such file or directory 2023-11-29T00:00:28.809 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f7b17a67640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:28.809 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f7a6b89b640 -1 Fail to open '/proc/45642/cmdline' error = (2) No such file or directory 2023-11-29T00:00:28.809 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f7a6b89b640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:28.810 INFO:tasks.ceph.mds.d.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f445a8c6640 -1 Fail to read '/proc/45642/cmdline' error = (3) No such process 2023-11-29T00:00:28.810 INFO:tasks.ceph.mds.d.smithi031.stderr:2023-11-29T00:00:28.803+0000 7f445a8c6640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:28.857 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-29T00:00:28.799+0000 7f5f4a49d640 -1 Fail to open '/proc/45641/cmdline' error = (2) No such file or directory 2023-11-29T00:00:28.868 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-29T00:00:28.867+0000 7f5f4a49d640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:28.868 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-29T00:00:28.867+0000 7f5f4a49d640 -1 Fail to open '/proc/45642/cmdline' error = (2) No such file or directory 2023-11-29T00:00:28.868 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-11-29T00:00:28.867+0000 7f5f4a49d640 -1 received signal: Hangup from (PID: 45642) UID: 0 2023-11-29T00:00:31.070 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-11-29T00:00:31.065+0000 7f3739157640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 385367) UID: 0 2023-11-29T00:00:31.070 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-11-29T00:00:31.065+0000 7f3739157640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-11-29T00:00:31.070 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-29T00:00:31.065+0000 7fbf1dfcd640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 385367) UID: 0 2023-11-29T00:00:31.071 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-29T00:00:31.065+0000 7fd4b5852640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 385367) UID: 0 2023-11-29T00:00:31.071 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-29T00:00:31.065+0000 7fef6c324640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 385367) UID: 0 2023-11-29T00:00:31.071 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-29T00:00:31.065+0000 7fe93040a640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 385367) UID: 0 2023-11-29T00:00:31.072 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-29T00:00:31.065+0000 7fdf27920640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 385367) UID: 0 2023-11-29T00:00:31.072 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-29T00:00:31.069+0000 7f12f141c640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 385367) UID: 0 2023-11-29T00:00:31.072 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-29T00:00:31.065+0000 7f18273dd640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 385367) UID: 0 2023-11-29T00:00:31.110 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-29T00:00:31.105+0000 7fbf1dfcd640 -1 Fail to open '/proc/385368/cmdline' error = (2) No such file or directory 2023-11-29T00:00:31.111 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-11-29T00:00:31.105+0000 7fbf1dfcd640 -1 received signal: Hangup from (PID: 385368) UID: 0 2023-11-29T00:00:31.111 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-29T00:00:31.105+0000 7fd4b5852640 -1 Fail to open '/proc/385368/cmdline' error = (3) No such process 2023-11-29T00:00:31.111 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-11-29T00:00:31.105+0000 7fd4b5852640 -1 received signal: Hangup from (PID: 385368) UID: 0 2023-11-29T00:00:31.111 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-11-29T00:00:31.105+0000 7f3739157640 -1 Fail to open '/proc/385368/cmdline' error = (2) No such file or directory 2023-11-29T00:00:31.112 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-11-29T00:00:31.109+0000 7f3739157640 -1 received signal: Hangup from (PID: 385368) UID: 0 2023-11-29T00:00:31.112 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-11-29T00:00:31.109+0000 7f3739157640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-11-29T00:00:31.112 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-29T00:00:31.109+0000 7f12f141c640 -1 Fail to open '/proc/385368/cmdline' error = (2) No such file or directory 2023-11-29T00:00:31.112 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-11-29T00:00:31.109+0000 7f12f141c640 -1 received signal: Hangup from (PID: 385368) UID: 0 2023-11-29T00:00:31.112 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-29T00:00:31.109+0000 7fdf27920640 -1 Fail to open '/proc/385368/cmdline' error = (2) No such file or directory 2023-11-29T00:00:31.112 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-11-29T00:00:31.109+0000 7fdf27920640 -1 received signal: Hangup from (PID: 385368) UID: 0 2023-11-29T00:00:31.113 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-29T00:00:31.109+0000 7fe93040a640 -1 Fail to open '/proc/385368/cmdline' error = (2) No such file or directory 2023-11-29T00:00:31.113 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-11-29T00:00:31.109+0000 7fe93040a640 -1 received signal: Hangup from (PID: 385368) UID: 0 2023-11-29T00:00:31.113 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-29T00:00:31.109+0000 7fef6c324640 -1 Fail to open '/proc/385368/cmdline' error = (2) No such file or directory 2023-11-29T00:00:31.113 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-11-29T00:00:31.109+0000 7fef6c324640 -1 received signal: Hangup from (PID: 385368) UID: 0 2023-11-29T00:00:31.113 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-29T00:00:31.109+0000 7f18273dd640 -1 Fail to open '/proc/385368/cmdline' error = (2) No such file or directory 2023-11-29T00:00:31.113 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-11-29T00:00:31.109+0000 7f18273dd640 -1 received signal: Hangup from (PID: 385368) UID: 0 2023-11-29T00:00:54.608 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:54.612 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:54.633 INFO:teuthology.orchestra.run.smithi031.stderr:error: state file /var/lib/logrotate/status is already locked 2023-11-29T00:00:54.633 INFO:teuthology.orchestra.run.smithi031.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-11-29T00:00:54.633 INFO:teuthology.orchestra.run.smithi006.stderr:error: state file /var/lib/logrotate/status is already locked 2023-11-29T00:00:54.634 INFO:teuthology.orchestra.run.smithi006.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-11-29T00:00:54.636 DEBUG:teuthology.orchestra.run:got remote process result: 3 2023-11-29T00:00:54.642 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T00:03:07.548 INFO:teuthology.orchestra.run.smithi006.stdout:generic/521 3092s 2023-11-29T00:03:07.560 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/521 2023-11-29T00:03:07.560 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:03:07.566 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:03:07.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:03:07.752 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-11-29T00:03:08.361 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:03:08.372 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:03:08.372 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:35.615 INFO:teuthology.orchestra.run.smithi006.stdout:generic/522 2127s 2023-11-29T00:38:35.683 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/522 2023-11-29T00:38:35.683 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:35.689 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:35.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:35.712 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-11-29T00:38:36.556 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:36.566 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:36.566 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:36.890 INFO:teuthology.orchestra.run.smithi006.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:36.898 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/523 2023-11-29T00:38:36.898 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/523 2023-11-29T00:38:36.899 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:36.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:36.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:36.925 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-11-29T00:38:37.302 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:37.312 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:37.313 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:37.614 INFO:teuthology.orchestra.run.smithi006.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:37.622 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/524 2023-11-29T00:38:37.622 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/524 2023-11-29T00:38:37.622 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:37.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:37.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:37.649 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-11-29T00:38:38.030 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:38.041 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:38.041 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:38.334 INFO:teuthology.orchestra.run.smithi006.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:38.342 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/525 2023-11-29T00:38:38.343 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/525 2023-11-29T00:38:38.343 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:38.349 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:38.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:38.370 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-11-29T00:38:38.768 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:38.779 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:38.779 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:39.141 INFO:teuthology.orchestra.run.smithi006.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/526 2023-11-29T00:38:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/526 2023-11-29T00:38:39.149 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:39.156 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:39.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:39.176 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-11-29T00:38:39.561 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:39.572 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:39.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:39.914 INFO:teuthology.orchestra.run.smithi006.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:39.922 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/527 2023-11-29T00:38:39.922 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/527 2023-11-29T00:38:39.922 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:39.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:39.950 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-11-29T00:38:40.320 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:40.331 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:40.331 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:40.674 INFO:teuthology.orchestra.run.smithi006.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-11-29T00:38:40.683 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/528 2023-11-29T00:38:40.683 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/528 2023-11-29T00:38:40.683 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:40.689 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:40.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:40.711 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-11-29T00:38:41.073 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:41.084 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:41.084 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:41.413 INFO:teuthology.orchestra.run.smithi006.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-29T00:38:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/529 2023-11-29T00:38:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/529 2023-11-29T00:38:41.422 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:41.428 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:41.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:41.448 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-11-29T00:38:41.825 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:41.835 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:41.835 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:42.118 INFO:teuthology.orchestra.run.smithi006.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:42.126 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/530 2023-11-29T00:38:42.126 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/530 2023-11-29T00:38:42.126 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:42.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:42.153 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-11-29T00:38:42.529 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:42.540 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:42.818 INFO:teuthology.orchestra.run.smithi006.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:42.827 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/531 2023-11-29T00:38:42.827 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/531 2023-11-29T00:38:42.827 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:42.833 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:42.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:42.855 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-11-29T00:38:43.240 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:43.251 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:43.251 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:43.610 INFO:teuthology.orchestra.run.smithi006.stdout:generic/532 0s 2023-11-29T00:38:43.623 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/532 2023-11-29T00:38:43.623 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:43.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:43.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:43.651 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-11-29T00:38:44.025 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:44.036 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:44.036 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:44.737 INFO:teuthology.orchestra.run.smithi006.stdout:generic/533 0s 2023-11-29T00:38:44.750 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/533 2023-11-29T00:38:44.750 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:44.756 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:44.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:44.775 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-11-29T00:38:45.152 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:45.164 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:45.164 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:45.468 INFO:teuthology.orchestra.run.smithi006.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:45.477 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/534 2023-11-29T00:38:45.477 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/534 2023-11-29T00:38:45.477 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:45.483 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:45.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:45.503 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-11-29T00:38:45.879 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:45.889 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:45.890 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:46.189 INFO:teuthology.orchestra.run.smithi006.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:46.197 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/535 2023-11-29T00:38:46.197 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/535 2023-11-29T00:38:46.197 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:46.203 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:46.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:46.225 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-11-29T00:38:46.608 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:46.619 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:46.619 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:46.919 INFO:teuthology.orchestra.run.smithi006.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:46.927 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/536 2023-11-29T00:38:46.927 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/536 2023-11-29T00:38:46.928 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:46.934 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:46.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:46.955 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-11-29T00:38:47.316 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:47.327 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:47.327 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:47.615 INFO:teuthology.orchestra.run.smithi006.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T00:38:47.624 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/537 2023-11-29T00:38:47.624 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/537 2023-11-29T00:38:47.624 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T00:38:47.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T00:38:47.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:47.650 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-11-29T00:38:48.020 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T00:38:48.031 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:48.031 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:44.730 INFO:teuthology.orchestra.run.smithi006.stdout:generic/538 2696s 2023-11-29T01:23:44.742 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/538 2023-11-29T01:23:44.742 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:44.749 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:44.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:44.796 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-11-29T01:23:45.495 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:45.506 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:45.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:48.019 INFO:teuthology.orchestra.run.smithi006.stdout:generic/539 3s 2023-11-29T01:23:48.032 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/539 2023-11-29T01:23:48.032 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:48.038 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:48.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:48.059 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-11-29T01:23:48.800 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:48.811 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:48.811 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:49.107 INFO:teuthology.orchestra.run.smithi006.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:49.115 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/540 2023-11-29T01:23:49.115 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/540 2023-11-29T01:23:49.116 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:49.122 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:49.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:49.141 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-11-29T01:23:49.512 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:49.522 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:49.523 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:49.813 INFO:teuthology.orchestra.run.smithi006.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:49.822 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/541 2023-11-29T01:23:49.822 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/541 2023-11-29T01:23:49.822 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:49.828 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:49.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:49.848 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-11-29T01:23:50.208 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:50.219 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:50.219 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:50.518 INFO:teuthology.orchestra.run.smithi006.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:50.526 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/542 2023-11-29T01:23:50.526 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/542 2023-11-29T01:23:50.526 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:50.533 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:50.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:50.555 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-11-29T01:23:50.957 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:50.968 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:50.968 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:51.262 INFO:teuthology.orchestra.run.smithi006.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:51.271 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/543 2023-11-29T01:23:51.271 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/543 2023-11-29T01:23:51.271 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:51.277 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:51.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:51.297 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-11-29T01:23:51.672 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:51.683 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:51.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:51.958 INFO:teuthology.orchestra.run.smithi006.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:51.966 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/544 2023-11-29T01:23:51.966 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/544 2023-11-29T01:23:51.966 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:51.972 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:51.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:51.992 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-11-29T01:23:52.373 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:52.383 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:52.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:52.752 INFO:teuthology.orchestra.run.smithi006.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-11-29T01:23:52.761 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/545 2023-11-29T01:23:52.761 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/545 2023-11-29T01:23:52.761 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:52.767 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:52.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:52.787 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-11-29T01:23:53.164 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:53.175 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:53.175 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:53.584 INFO:teuthology.orchestra.run.smithi006.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:53.592 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/546 2023-11-29T01:23:53.593 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/546 2023-11-29T01:23:53.593 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:53.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:53.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:53.619 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-11-29T01:23:54.021 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:54.032 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:54.032 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:54.360 INFO:teuthology.orchestra.run.smithi006.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:54.368 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/547 2023-11-29T01:23:54.368 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/547 2023-11-29T01:23:54.368 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:54.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:54.395 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-11-29T01:23:54.760 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:54.771 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:55.144 INFO:teuthology.orchestra.run.smithi006.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:55.153 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/548 2023-11-29T01:23:55.153 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/548 2023-11-29T01:23:55.153 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:55.160 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:55.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:55.180 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-11-29T01:23:55.555 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:55.566 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:55.567 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:55.935 INFO:teuthology.orchestra.run.smithi006.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:55.944 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/549 2023-11-29T01:23:55.944 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/549 2023-11-29T01:23:55.944 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:55.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:55.973 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-11-29T01:23:56.356 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:56.367 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:56.367 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:56.750 INFO:teuthology.orchestra.run.smithi006.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:56.758 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/550 2023-11-29T01:23:56.758 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/550 2023-11-29T01:23:56.758 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:56.765 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:56.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:56.784 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-11-29T01:23:57.172 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:57.183 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:57.183 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:57.459 INFO:teuthology.orchestra.run.smithi006.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:57.467 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/551 2023-11-29T01:23:57.468 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/551 2023-11-29T01:23:57.468 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:57.474 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:57.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:57.494 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-11-29T01:23:57.884 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:57.896 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:57.896 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:58.212 INFO:teuthology.orchestra.run.smithi006.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:23:58.220 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/552 2023-11-29T01:23:58.221 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/552 2023-11-29T01:23:58.221 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:58.227 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:58.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:58.247 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-11-29T01:23:58.629 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:58.639 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:58.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:59.039 INFO:teuthology.orchestra.run.smithi006.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-11-29T01:23:59.047 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/553 2023-11-29T01:23:59.048 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/553 2023-11-29T01:23:59.048 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:23:59.054 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:23:59.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:23:59.074 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-11-29T01:23:59.772 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:23:59.783 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:23:59.783 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:00.069 INFO:teuthology.orchestra.run.smithi006.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:00.077 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/554 2023-11-29T01:24:00.077 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/554 2023-11-29T01:24:00.077 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:00.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:00.103 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-11-29T01:24:00.489 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:00.499 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:00.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:00.877 INFO:teuthology.orchestra.run.smithi006.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-11-29T01:24:00.885 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/555 2023-11-29T01:24:00.885 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/555 2023-11-29T01:24:00.886 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:00.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:01.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:01.067 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-11-29T01:24:01.633 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:01.644 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:01.928 INFO:teuthology.orchestra.run.smithi006.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:01.936 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/556 2023-11-29T01:24:01.936 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/556 2023-11-29T01:24:01.936 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:01.942 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:01.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:01.962 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-11-29T01:24:02.353 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:02.364 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:02.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:02.654 INFO:teuthology.orchestra.run.smithi006.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:02.663 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/557 2023-11-29T01:24:02.663 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/557 2023-11-29T01:24:02.663 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:02.669 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:02.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:02.689 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-11-29T01:24:03.061 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:03.072 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:03.073 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:03.380 INFO:teuthology.orchestra.run.smithi006.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:03.389 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/558 2023-11-29T01:24:03.389 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/558 2023-11-29T01:24:03.389 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:03.396 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:03.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:03.455 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-11-29T01:24:03.817 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:03.827 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:03.828 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:04.136 INFO:teuthology.orchestra.run.smithi006.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:04.144 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/559 2023-11-29T01:24:04.144 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/559 2023-11-29T01:24:04.145 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:04.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:04.226 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-11-29T01:24:04.597 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:04.608 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:04.883 INFO:teuthology.orchestra.run.smithi006.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:04.891 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/560 2023-11-29T01:24:04.891 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/560 2023-11-29T01:24:04.891 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:04.897 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:04.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:04.918 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-11-29T01:24:05.280 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:05.291 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:05.292 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:05.575 INFO:teuthology.orchestra.run.smithi006.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:05.583 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/561 2023-11-29T01:24:05.583 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/561 2023-11-29T01:24:05.583 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:05.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:05.610 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-11-29T01:24:05.996 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:06.007 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:06.008 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:06.293 INFO:teuthology.orchestra.run.smithi006.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:06.301 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/562 2023-11-29T01:24:06.301 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/562 2023-11-29T01:24:06.301 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:06.308 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:06.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:06.327 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-11-29T01:24:06.733 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:06.744 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:06.744 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:07.066 INFO:teuthology.orchestra.run.smithi006.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:07.074 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/563 2023-11-29T01:24:07.075 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/563 2023-11-29T01:24:07.075 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:07.080 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:07.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:07.100 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-11-29T01:24:07.481 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:07.492 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:07.492 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:08.312 INFO:teuthology.orchestra.run.smithi006.stdout:generic/564 1s 2023-11-29T01:24:08.325 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/564 2023-11-29T01:24:08.325 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:08.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:08.355 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-11-29T01:24:09.040 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:09.050 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:09.051 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:09.369 INFO:teuthology.orchestra.run.smithi006.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:09.377 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/565 2023-11-29T01:24:09.377 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/565 2023-11-29T01:24:09.377 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:09.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:09.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:09.403 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-11-29T01:24:09.788 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:09.799 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:10.112 INFO:teuthology.orchestra.run.smithi006.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:10.120 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/566 2023-11-29T01:24:10.120 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/566 2023-11-29T01:24:10.120 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:10.126 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:10.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:10.146 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-11-29T01:24:10.536 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:10.547 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:10.547 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:10.813 INFO:teuthology.orchestra.run.smithi006.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:10.822 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/567 2023-11-29T01:24:10.822 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/567 2023-11-29T01:24:10.822 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:10.828 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:10.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:10.849 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-11-29T01:24:11.226 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:11.236 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:11.237 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:11.774 INFO:teuthology.orchestra.run.smithi006.stdout:generic/568 0s 2023-11-29T01:24:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/568 2023-11-29T01:24:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:11.924 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:11.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:11.969 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-11-29T01:24:12.412 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:12.423 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:12.423 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:12.797 INFO:teuthology.orchestra.run.smithi006.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:12.805 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/569 2023-11-29T01:24:12.805 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/569 2023-11-29T01:24:12.805 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:12.811 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:12.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:12.831 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-11-29T01:24:13.208 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:13.219 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:13.220 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:13.515 INFO:teuthology.orchestra.run.smithi006.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:13.524 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/570 2023-11-29T01:24:13.524 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/570 2023-11-29T01:24:13.524 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:13.530 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:13.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:13.551 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-11-29T01:24:13.924 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:13.935 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:20.394 INFO:teuthology.orchestra.run.smithi006.stdout:generic/571 7s 2023-11-29T01:24:20.408 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/571 2023-11-29T01:24:20.408 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:20.415 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:20.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:20.598 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-11-29T01:24:21.168 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:21.179 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:21.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:21.470 INFO:teuthology.orchestra.run.smithi006.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:21.479 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/572 2023-11-29T01:24:21.479 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/572 2023-11-29T01:24:21.479 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:21.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:21.505 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-11-29T01:24:21.912 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:21.923 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:21.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:22.233 INFO:teuthology.orchestra.run.smithi006.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:22.242 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/573 2023-11-29T01:24:22.242 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/573 2023-11-29T01:24:22.242 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:22.248 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:22.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:22.268 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-11-29T01:24:22.649 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:22.659 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:22.659 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:22.953 INFO:teuthology.orchestra.run.smithi006.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:22.961 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/574 2023-11-29T01:24:22.961 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/574 2023-11-29T01:24:22.961 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:22.968 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:22.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:22.988 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-11-29T01:24:23.364 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:23.375 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:23.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:23.668 INFO:teuthology.orchestra.run.smithi006.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:23.677 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/575 2023-11-29T01:24:23.677 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/575 2023-11-29T01:24:23.677 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:23.684 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:23.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:23.703 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-11-29T01:24:24.088 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:24.099 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:24.099 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:24.451 INFO:teuthology.orchestra.run.smithi006.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:24.459 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/576 2023-11-29T01:24:24.460 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/576 2023-11-29T01:24:24.460 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:24.466 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:24.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:24.486 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-11-29T01:24:24.880 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:24.891 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:24.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:25.167 INFO:teuthology.orchestra.run.smithi006.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:25.175 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/577 2023-11-29T01:24:25.175 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/577 2023-11-29T01:24:25.176 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:25.182 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:25.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:25.202 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-11-29T01:24:25.594 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:25.604 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:25.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:25.977 INFO:teuthology.orchestra.run.smithi006.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-29T01:24:25.986 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/578 2023-11-29T01:24:25.986 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/578 2023-11-29T01:24:25.986 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:25.992 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:26.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:26.012 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-11-29T01:24:26.401 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:26.412 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:26.412 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:26.738 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/579 2023-11-29T01:24:26.738 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/579 2023-11-29T01:24:26.738 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:26.744 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:26.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:26.764 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-11-29T01:24:27.148 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:27.159 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:27.160 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:27.508 INFO:teuthology.orchestra.run.smithi006.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:27.517 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/580 2023-11-29T01:24:27.517 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/580 2023-11-29T01:24:27.517 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:27.524 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:27.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:27.591 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-11-29T01:24:27.972 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:27.983 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:27.983 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:29.036 INFO:teuthology.orchestra.run.smithi006.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:29.045 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/581 2023-11-29T01:24:29.045 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/581 2023-11-29T01:24:29.045 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:29.051 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:29.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:29.071 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-11-29T01:24:29.443 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:29.454 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:29.454 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:29.816 INFO:teuthology.orchestra.run.smithi006.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:29.824 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/582 2023-11-29T01:24:29.824 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/582 2023-11-29T01:24:29.824 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:29.830 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:29.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:29.850 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-11-29T01:24:30.224 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:30.235 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:30.235 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:30.609 INFO:teuthology.orchestra.run.smithi006.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:30.617 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/583 2023-11-29T01:24:30.618 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/583 2023-11-29T01:24:30.618 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:30.624 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:30.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:30.644 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-11-29T01:24:31.052 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:31.063 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:31.063 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:31.427 INFO:teuthology.orchestra.run.smithi006.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:31.436 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/584 2023-11-29T01:24:31.436 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/584 2023-11-29T01:24:31.436 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:31.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:31.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:31.462 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-11-29T01:24:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:31.867 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:31.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:32.176 INFO:teuthology.orchestra.run.smithi006.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:24:32.185 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/585 2023-11-29T01:24:32.185 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/585 2023-11-29T01:24:32.185 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:32.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:32.211 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-11-29T01:24:32.588 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:32.599 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:32.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:58.502 INFO:teuthology.orchestra.run.smithi006.stdout:generic/586 26s 2023-11-29T01:24:58.515 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/586 2023-11-29T01:24:58.515 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:58.521 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:58.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:58.542 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-11-29T01:24:59.261 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:24:59.272 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:24:59.272 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:59.839 INFO:teuthology.orchestra.run.smithi006.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-29T01:24:59.848 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/587 2023-11-29T01:24:59.848 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/587 2023-11-29T01:24:59.848 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:24:59.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:24:59.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:24:59.875 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-11-29T01:25:00.284 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:00.295 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:00.295 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:00.622 INFO:teuthology.orchestra.run.smithi006.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:00.630 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/588 2023-11-29T01:25:00.631 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/588 2023-11-29T01:25:00.631 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:00.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:00.657 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-11-29T01:25:01.022 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:01.033 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:01.033 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/589 2023-11-29T01:25:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/589 2023-11-29T01:25:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:01.344 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:01.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:01.365 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-11-29T01:25:01.745 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:01.756 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:01.756 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:02.053 INFO:teuthology.orchestra.run.smithi006.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:02.062 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/590 2023-11-29T01:25:02.062 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/590 2023-11-29T01:25:02.062 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:02.068 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:02.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:02.088 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-11-29T01:25:02.488 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:02.499 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:02.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:03.002 INFO:teuthology.orchestra.run.smithi006.stdout:generic/591 0s 2023-11-29T01:25:03.015 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/591 2023-11-29T01:25:03.015 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:03.022 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:03.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:03.192 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-11-29T01:25:03.802 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:03.813 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:03.813 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:04.166 INFO:teuthology.orchestra.run.smithi006.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:04.174 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/592 2023-11-29T01:25:04.174 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/592 2023-11-29T01:25:04.174 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:04.181 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:04.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:04.200 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-11-29T01:25:04.592 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:04.603 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:04.603 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:04.954 INFO:teuthology.orchestra.run.smithi006.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:04.962 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/593 2023-11-29T01:25:04.963 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/593 2023-11-29T01:25:04.963 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:04.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:04.989 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-11-29T01:25:05.368 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:05.379 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:05.379 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:05.685 INFO:teuthology.orchestra.run.smithi006.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:05.693 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/594 2023-11-29T01:25:05.693 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/594 2023-11-29T01:25:05.694 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:05.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:05.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:05.720 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-11-29T01:25:06.116 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:06.127 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:06.127 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:06.475 INFO:teuthology.orchestra.run.smithi006.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:06.484 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/595 2023-11-29T01:25:06.484 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/595 2023-11-29T01:25:06.484 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:06.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:06.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:06.512 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-11-29T01:25:06.977 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:06.988 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:06.988 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:07.302 INFO:teuthology.orchestra.run.smithi006.stdout:generic/596 [not run] accton utility required, skipped this test 2023-11-29T01:25:07.311 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/596 2023-11-29T01:25:07.311 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/596 2023-11-29T01:25:07.311 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:07.317 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:07.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:07.338 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-11-29T01:25:07.720 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:07.731 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:07.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:08.850 INFO:teuthology.orchestra.run.smithi006.stdout:generic/597 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/597.out.bad) 2023-11-29T01:25:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/597.out 2023-11-28 21:09:26.614875683 +0000 2023-11-29T01:25:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/597.out.bad 2023-11-29 01:25:08.845498504 +0000 2023-11-29T01:25:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -4,11 +4,11 @@ 2023-11-29T01:25:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: fs.protected_symlinks = 0 2023-11-29T01:25:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: successfully followed symlink 2023-11-29T01:25:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: fs.protected_symlinks = 1 2023-11-29T01:25:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: -Permission denied 2023-11-29T01:25:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: +successfully followed symlink 2023-11-29T01:25:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: == Test hardlink create protection when 2023-11-29T01:25:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: == process != target owner and process cannot read target 2023-11-29T01:25:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: fs.protected_hardlinks = 0 2023-11-29T01:25:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: -successfully created hardlink 2023-11-29T01:25:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: +Permission denied 2023-11-29T01:25:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: fs.protected_hardlinks = 1 2023-11-29T01:25:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-11-29T01:25:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: +Permission denied 2023-11-29T01:25:08.861 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/597 2023-11-29T01:25:08.861 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/597 2023-11-29T01:25:08.861 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-29T01:25:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:08.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T01:25:08.891 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-29T01:25:08.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-29T01:25:08.891 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-11-29T01:25:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:09.603 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:09.604 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:10.885 INFO:teuthology.orchestra.run.smithi006.stdout:generic/598 - output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/598.out.bad) 2023-11-29T01:25:10.890 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/598.out 2023-11-28 21:09:26.614875683 +0000 2023-11-29T01:25:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/598.out.bad 2023-11-29 01:25:10.881477403 +0000 2023-11-29T01:25:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -5,13 +5,10 @@ 2023-11-29T01:25:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: = only group writable dir 2023-11-29T01:25:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: fs.protected_regular = 1 2023-11-29T01:25:10.891 INFO:teuthology.orchestra.run.smithi006.stdout: = group & world writable dir 2023-11-29T01:25:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: -Permission denied 2023-11-29T01:25:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: = only group writable dir 2023-11-29T01:25:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: fs.protected_regular = 2 2023-11-29T01:25:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: = group & world writable dir 2023-11-29T01:25:10.892 INFO:teuthology.orchestra.run.smithi006.stdout: -Permission denied 2023-11-29T01:25:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: = only group writable dir 2023-11-29T01:25:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: -Permission denied 2023-11-29T01:25:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-11-29T01:25:10.893 INFO:teuthology.orchestra.run.smithi006.stdout: fs.protected_fifos = 0 2023-11-29T01:25:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -19,10 +16,7 @@ 2023-11-29T01:25:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: = only group writable dir 2023-11-29T01:25:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: fs.protected_fifos = 1 2023-11-29T01:25:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: = group & world writable dir 2023-11-29T01:25:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: -Permission denied 2023-11-29T01:25:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: = only group writable dir 2023-11-29T01:25:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: fs.protected_fifos = 2 2023-11-29T01:25:10.895 INFO:teuthology.orchestra.run.smithi006.stdout: = group & world writable dir 2023-11-29T01:25:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: -Permission denied 2023-11-29T01:25:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: = only group writable dir 2023-11-29T01:25:10.896 INFO:teuthology.orchestra.run.smithi006.stdout: -Permission denied 2023-11-29T01:25:10.897 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/598 2023-11-29T01:25:10.897 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/598 2023-11-29T01:25:10.897 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-29T01:25:10.902 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:10.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T01:25:10.923 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-29T01:25:10.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-29T01:25:10.924 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-11-29T01:25:11.621 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:11.632 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:11.632 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:11.901 INFO:teuthology.orchestra.run.smithi006.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:11.910 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/599 2023-11-29T01:25:11.910 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/599 2023-11-29T01:25:11.910 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:11.917 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:11.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:11.937 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-11-29T01:25:12.320 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:12.331 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:12.331 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:12.633 INFO:teuthology.orchestra.run.smithi006.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:12.641 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/600 2023-11-29T01:25:12.641 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/600 2023-11-29T01:25:12.641 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:12.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:12.668 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-11-29T01:25:13.040 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:13.051 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:13.051 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:13.337 INFO:teuthology.orchestra.run.smithi006.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:13.346 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/601 2023-11-29T01:25:13.346 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/601 2023-11-29T01:25:13.346 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:13.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:13.375 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-11-29T01:25:13.760 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:13.771 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:14.128 INFO:teuthology.orchestra.run.smithi006.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:14.136 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/602 2023-11-29T01:25:14.136 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/602 2023-11-29T01:25:14.136 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:14.142 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:14.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:14.165 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-11-29T01:25:14.540 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:14.551 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:14.876 INFO:teuthology.orchestra.run.smithi006.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:14.885 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/603 2023-11-29T01:25:14.885 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/603 2023-11-29T01:25:14.885 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:14.891 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:14.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:14.911 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-11-29T01:25:15.332 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:15.343 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:15.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:15.625 INFO:teuthology.orchestra.run.smithi006.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:15.633 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/604 2023-11-29T01:25:15.633 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/604 2023-11-29T01:25:15.634 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:15.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:15.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:15.660 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-11-29T01:25:16.040 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:16.051 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:16.051 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:16.365 INFO:teuthology.orchestra.run.smithi006.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:16.373 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/605 2023-11-29T01:25:16.374 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/605 2023-11-29T01:25:16.374 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:16.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:16.401 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-11-29T01:25:16.772 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:16.783 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:16.783 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:17.077 INFO:teuthology.orchestra.run.smithi006.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:17.085 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/606 2023-11-29T01:25:17.085 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/606 2023-11-29T01:25:17.086 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:17.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:17.155 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-11-29T01:25:17.540 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:17.551 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:17.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:17.840 INFO:teuthology.orchestra.run.smithi006.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:17.849 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/607 2023-11-29T01:25:17.849 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/607 2023-11-29T01:25:17.849 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:17.855 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:17.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:17.876 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-11-29T01:25:18.264 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:18.276 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:18.553 INFO:teuthology.orchestra.run.smithi006.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:18.561 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/608 2023-11-29T01:25:18.561 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/608 2023-11-29T01:25:18.562 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:18.568 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:18.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:18.588 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-11-29T01:25:18.984 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:18.995 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:18.995 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:19.631 INFO:teuthology.orchestra.run.smithi006.stdout:generic/609 0s 2023-11-29T01:25:19.644 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/609 2023-11-29T01:25:19.644 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:19.650 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:19.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:19.819 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-11-29T01:25:20.403 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:20.414 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:20.414 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:20.712 INFO:teuthology.orchestra.run.smithi006.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:20.721 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/610 2023-11-29T01:25:20.721 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/610 2023-11-29T01:25:20.722 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:20.728 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:20.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:20.748 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-11-29T01:25:21.134 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:21.143 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:21.143 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:21.434 INFO:teuthology.orchestra.run.smithi006.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:21.443 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/611 2023-11-29T01:25:21.443 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/611 2023-11-29T01:25:21.443 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:21.449 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:21.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:21.470 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-11-29T01:25:21.852 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:21.863 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:21.863 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:22.238 INFO:teuthology.orchestra.run.smithi006.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-29T01:25:22.246 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/612 2023-11-29T01:25:22.247 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/612 2023-11-29T01:25:22.247 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:22.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:22.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:22.295 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-11-29T01:25:22.972 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:22.983 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:22.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:23.331 INFO:teuthology.orchestra.run.smithi006.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:23.339 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/613 2023-11-29T01:25:23.340 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/613 2023-11-29T01:25:23.340 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:23.346 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:23.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:23.366 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-11-29T01:25:23.740 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:23.750 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:23.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:24.029 INFO:teuthology.orchestra.run.smithi006.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:24.037 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/614 2023-11-29T01:25:24.037 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/614 2023-11-29T01:25:24.037 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:24.044 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:24.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:24.063 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-11-29T01:25:24.440 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:24.451 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:24.451 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:24.732 INFO:teuthology.orchestra.run.smithi006.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:25:24.741 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/615 2023-11-29T01:25:24.741 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/615 2023-11-29T01:25:24.741 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:25:24.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:25:24.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:25:24.768 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-11-29T01:25:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:25:25.168 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:25:25.168 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:29:18.884 INFO:teuthology.orchestra.run.smithi006.stdout:generic/616 233s 2023-11-29T01:29:18.897 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/616 2023-11-29T01:29:18.897 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:29:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:29:18.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:29:18.979 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-11-29T01:29:19.353 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:29:19.364 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:29:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:19.027 INFO:teuthology.orchestra.run.smithi006.stdout:generic/617 60s 2023-11-29T01:30:19.040 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/617 2023-11-29T01:30:19.040 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:19.047 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:19.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:19.079 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-11-29T01:30:19.760 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:19.771 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:19.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:20.071 INFO:teuthology.orchestra.run.smithi006.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:20.079 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/618 2023-11-29T01:30:20.080 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/618 2023-11-29T01:30:20.080 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:20.086 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:20.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:20.106 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-11-29T01:30:20.484 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:20.495 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:20.495 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:20.777 INFO:teuthology.orchestra.run.smithi006.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:20.785 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/619 2023-11-29T01:30:20.785 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/619 2023-11-29T01:30:20.785 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:20.792 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:20.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:20.812 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-11-29T01:30:21.197 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:21.208 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:21.208 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:21.568 INFO:teuthology.orchestra.run.smithi006.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:21.576 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/620 2023-11-29T01:30:21.576 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/620 2023-11-29T01:30:21.576 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:21.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:21.602 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-11-29T01:30:21.974 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:21.984 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:21.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:22.346 INFO:teuthology.orchestra.run.smithi006.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:22.355 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/621 2023-11-29T01:30:22.355 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/621 2023-11-29T01:30:22.355 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:22.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:22.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:22.381 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-11-29T01:30:22.769 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:22.779 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:22.780 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:23.055 INFO:teuthology.orchestra.run.smithi006.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:23.064 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/622 2023-11-29T01:30:23.065 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/622 2023-11-29T01:30:23.065 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:23.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:23.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:23.091 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-11-29T01:30:23.461 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:23.472 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:23.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:23.964 INFO:teuthology.orchestra.run.smithi006.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:23.973 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/623 2023-11-29T01:30:23.973 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/623 2023-11-29T01:30:23.973 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:23.979 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:23.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:24.000 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-11-29T01:30:24.372 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:24.383 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:24.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:24.681 INFO:teuthology.orchestra.run.smithi006.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:24.689 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/624 2023-11-29T01:30:24.689 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/624 2023-11-29T01:30:24.689 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:24.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:24.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:24.715 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-11-29T01:30:25.088 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:25.099 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:25.099 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:25.383 INFO:teuthology.orchestra.run.smithi006.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:25.391 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/625 2023-11-29T01:30:25.391 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/625 2023-11-29T01:30:25.391 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:25.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:25.418 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-11-29T01:30:25.792 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:25.803 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:25.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:26.094 INFO:teuthology.orchestra.run.smithi006.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:26.102 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/626 2023-11-29T01:30:26.103 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/626 2023-11-29T01:30:26.103 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:26.109 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:26.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:26.130 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-11-29T01:30:26.505 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:26.516 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:26.516 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:26.809 INFO:teuthology.orchestra.run.smithi006.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:26.818 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/627 2023-11-29T01:30:26.818 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/627 2023-11-29T01:30:26.818 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:26.824 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:26.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:26.844 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-11-29T01:30:27.229 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:27.239 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:27.240 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:27.614 INFO:teuthology.orchestra.run.smithi006.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:27.623 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/628 2023-11-29T01:30:27.623 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/628 2023-11-29T01:30:27.623 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:27.629 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:27.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:27.649 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-11-29T01:30:28.049 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:28.060 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:28.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:28.390 INFO:teuthology.orchestra.run.smithi006.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:28.399 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/629 2023-11-29T01:30:28.399 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/629 2023-11-29T01:30:28.399 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:28.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:28.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:28.424 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-11-29T01:30:28.809 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:28.820 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:28.820 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:29.106 INFO:teuthology.orchestra.run.smithi006.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:29.115 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/630 2023-11-29T01:30:29.115 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/630 2023-11-29T01:30:29.115 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:29.121 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:29.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:29.141 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-11-29T01:30:29.516 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:29.527 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:29.527 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:29.829 INFO:teuthology.orchestra.run.smithi006.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:29.838 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/631 2023-11-29T01:30:29.838 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/631 2023-11-29T01:30:29.838 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:29.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:29.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:29.864 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-11-29T01:30:30.264 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:30.275 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:30.275 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:36.535 INFO:teuthology.orchestra.run.smithi006.stdout:generic/632 6s 2023-11-29T01:30:36.549 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/632 2023-11-29T01:30:36.550 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:36.617 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:36.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:36.638 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-11-29T01:30:37.008 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:37.018 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:37.019 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:37.726 INFO:teuthology.orchestra.run.smithi006.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/633.out.bad) 2023-11-29T01:30:37.794 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/633.out 2023-11-28 21:09:26.618875652 +0000 2023-11-29T01:30:37.794 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.TCCktrMdx7xfstests-dev/results//generic/633.out.bad 2023-11-29 01:30:37.678088887 +0000 2023-11-29T01:30:37.795 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,2 +1,5 @@ 2023-11-29T01:30:37.795 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 633 2023-11-29T01:30:37.795 INFO:teuthology.orchestra.run.smithi006.stdout: Silence is golden 2023-11-29T01:30:37.795 INFO:teuthology.orchestra.run.smithi006.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2023-11-29T01:30:37.795 INFO:teuthology.orchestra.run.smithi006.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2023-11-29T01:30:37.795 INFO:teuthology.orchestra.run.smithi006.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2023-11-29T01:30:37.813 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/633 2023-11-29T01:30:37.813 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/633 2023-11-29T01:30:37.814 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-11-29T01:30:37.838 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:37.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T01:30:37.919 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-29T01:30:37.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-29T01:30:37.920 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-11-29T01:30:38.595 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:38.610 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:38.610 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:38.895 INFO:teuthology.orchestra.run.smithi006.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:38.904 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/634 2023-11-29T01:30:38.904 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/634 2023-11-29T01:30:38.904 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:38.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:38.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:38.930 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-11-29T01:30:39.292 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:39.303 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:39.303 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:39.582 INFO:teuthology.orchestra.run.smithi006.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:39.591 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/635 2023-11-29T01:30:39.591 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/635 2023-11-29T01:30:39.591 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:39.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:39.617 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-11-29T01:30:40.008 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:40.019 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:40.019 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:40.300 INFO:teuthology.orchestra.run.smithi006.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:40.308 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/636 2023-11-29T01:30:40.308 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/636 2023-11-29T01:30:40.308 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:40.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:40.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:40.335 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-11-29T01:30:40.720 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:40.731 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:40.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:42.190 INFO:teuthology.orchestra.run.smithi006.stdout:generic/637 2s 2023-11-29T01:30:42.203 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/637 2023-11-29T01:30:42.203 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:42.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:42.231 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-11-29T01:30:42.956 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:42.967 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:42.967 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:43.371 INFO:teuthology.orchestra.run.smithi006.stdout:generic/638 1s 2023-11-29T01:30:43.384 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/638 2023-11-29T01:30:43.384 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:43.390 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:43.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:43.443 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-11-29T01:30:43.822 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:43.833 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:43.833 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:48.121 INFO:teuthology.orchestra.run.smithi006.stdout:generic/639 5s 2023-11-29T01:30:48.135 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/639 2023-11-29T01:30:48.135 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:48.142 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:48.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:48.164 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-11-29T01:30:48.561 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:48.571 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:48.571 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:48.924 INFO:teuthology.orchestra.run.smithi006.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:48.932 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/640 2023-11-29T01:30:48.932 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/640 2023-11-29T01:30:48.932 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:48.939 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:48.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:48.958 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-11-29T01:30:49.340 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:49.350 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:49.351 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:49.631 INFO:teuthology.orchestra.run.smithi006.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:49.639 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/641 2023-11-29T01:30:49.639 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/641 2023-11-29T01:30:49.639 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:49.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:49.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:49.666 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-11-29T01:30:50.056 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:50.066 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:50.067 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:50.384 INFO:teuthology.orchestra.run.smithi006.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:50.393 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/642 2023-11-29T01:30:50.393 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/642 2023-11-29T01:30:50.393 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:50.399 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:50.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:50.419 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-11-29T01:30:50.789 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:50.800 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:50.800 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:51.089 INFO:teuthology.orchestra.run.smithi006.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:51.097 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/643 2023-11-29T01:30:51.098 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/643 2023-11-29T01:30:51.098 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:51.104 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:51.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:51.124 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-11-29T01:30:51.496 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:51.507 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:51.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:51.829 INFO:teuthology.orchestra.run.smithi006.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-11-29T01:30:51.838 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/644 2023-11-29T01:30:51.838 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/644 2023-11-29T01:30:51.839 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:51.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:51.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:51.866 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-11-29T01:30:52.253 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:52.264 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:52.559 INFO:teuthology.orchestra.run.smithi006.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-11-29T01:30:52.568 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/645 2023-11-29T01:30:52.568 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/645 2023-11-29T01:30:52.568 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:52.574 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:52.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:52.594 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-11-29T01:30:53.001 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:53.011 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:53.012 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:53.297 INFO:teuthology.orchestra.run.smithi006.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:53.306 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/646 2023-11-29T01:30:53.306 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/646 2023-11-29T01:30:53.306 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:53.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:53.332 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-11-29T01:30:53.692 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:53.703 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:53.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:54.213 INFO:teuthology.orchestra.run.smithi006.stdout:generic/647 1s 2023-11-29T01:30:54.226 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/647 2023-11-29T01:30:54.226 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:54.233 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:54.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:54.351 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-11-29T01:30:54.960 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:54.971 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:55.302 INFO:teuthology.orchestra.run.smithi006.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T01:30:55.311 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/648 2023-11-29T01:30:55.311 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/648 2023-11-29T01:30:55.311 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:55.317 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:55.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:55.338 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-11-29T01:30:55.721 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:55.732 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:55.732 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:56.120 INFO:teuthology.orchestra.run.smithi006.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-29T01:30:56.128 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/649 2023-11-29T01:30:56.128 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/649 2023-11-29T01:30:56.128 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T01:30:56.134 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T01:30:56.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:30:56.160 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-11-29T01:30:56.842 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T01:30:56.852 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:30:56.852 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:32.399 INFO:teuthology.orchestra.run.smithi006.stdout:generic/650 5856s 2023-11-29T03:08:32.505 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/650 2023-11-29T03:08:32.505 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:32.536 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:32.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:32.605 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-11-29T03:08:34.304 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:34.347 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:34.347 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:35.360 INFO:teuthology.orchestra.run.smithi006.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:08:35.384 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/651 2023-11-29T03:08:35.384 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/651 2023-11-29T03:08:35.384 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:35.402 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:35.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:35.459 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-11-29T03:08:36.788 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:36.830 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:36.831 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:37.880 INFO:teuthology.orchestra.run.smithi006.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:08:37.914 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/652 2023-11-29T03:08:37.914 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/652 2023-11-29T03:08:37.914 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:37.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:37.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:37.998 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-11-29T03:08:39.354 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:39.398 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:39.398 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:40.502 INFO:teuthology.orchestra.run.smithi006.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:08:40.543 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/653 2023-11-29T03:08:40.543 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/653 2023-11-29T03:08:40.544 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:40.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:40.628 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-11-29T03:08:41.903 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:41.936 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:41.936 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:42.920 INFO:teuthology.orchestra.run.smithi006.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:08:42.950 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/654 2023-11-29T03:08:42.950 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/654 2023-11-29T03:08:42.951 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:42.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:43.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:43.032 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-11-29T03:08:44.370 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:44.428 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:44.430 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:45.384 INFO:teuthology.orchestra.run.smithi006.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:08:45.423 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/655 2023-11-29T03:08:45.424 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/655 2023-11-29T03:08:45.424 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:45.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:45.539 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-11-29T03:08:46.742 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:46.777 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:46.777 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:47.822 INFO:teuthology.orchestra.run.smithi006.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2023-11-29T03:08:47.853 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/656 2023-11-29T03:08:47.854 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/656 2023-11-29T03:08:47.854 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:47.882 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:47.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:47.953 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-11-29T03:08:49.359 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:49.405 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:49.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:50.519 INFO:teuthology.orchestra.run.smithi006.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:08:50.553 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/657 2023-11-29T03:08:50.553 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/657 2023-11-29T03:08:50.553 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:50.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:50.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:50.648 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-11-29T03:08:51.936 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:51.959 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:51.959 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:52.919 INFO:teuthology.orchestra.run.smithi006.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:08:52.948 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/658 2023-11-29T03:08:52.948 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/658 2023-11-29T03:08:52.948 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:52.967 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:53.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:53.033 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-11-29T03:08:54.360 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:54.424 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:55.399 INFO:teuthology.orchestra.run.smithi006.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:08:55.429 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/659 2023-11-29T03:08:55.429 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/659 2023-11-29T03:08:55.431 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:55.463 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:55.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:55.525 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-11-29T03:08:56.816 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:56.861 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:56.861 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:57.869 INFO:teuthology.orchestra.run.smithi006.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:08:57.917 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/660 2023-11-29T03:08:57.917 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/660 2023-11-29T03:08:57.920 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:08:57.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:08:58.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:08:58.035 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-11-29T03:08:59.374 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:08:59.416 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:08:59.416 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:00.473 INFO:teuthology.orchestra.run.smithi006.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:00.511 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/661 2023-11-29T03:09:00.512 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/661 2023-11-29T03:09:00.512 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:00.541 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:00.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:00.630 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-11-29T03:09:01.978 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:02.024 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:02.024 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:03.068 INFO:teuthology.orchestra.run.smithi006.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:03.094 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/662 2023-11-29T03:09:03.095 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/662 2023-11-29T03:09:03.095 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:03.124 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:03.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:03.216 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-11-29T03:09:04.512 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:04.556 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:04.556 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:05.553 INFO:teuthology.orchestra.run.smithi006.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:05.575 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/663 2023-11-29T03:09:05.576 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/663 2023-11-29T03:09:05.576 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:05.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:05.692 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-11-29T03:09:07.037 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:07.083 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:07.084 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:08.023 INFO:teuthology.orchestra.run.smithi006.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:08.058 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/664 2023-11-29T03:09:08.059 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/664 2023-11-29T03:09:08.060 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:08.094 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:08.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:08.164 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-11-29T03:09:09.519 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:09.547 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:09.547 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:10.640 INFO:teuthology.orchestra.run.smithi006.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:10.653 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/665 2023-11-29T03:09:10.653 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/665 2023-11-29T03:09:10.653 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:10.681 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:10.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:10.781 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-11-29T03:09:12.113 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:12.170 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:12.173 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:13.165 INFO:teuthology.orchestra.run.smithi006.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:13.177 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/666 2023-11-29T03:09:13.177 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/666 2023-11-29T03:09:13.177 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:13.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:13.296 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-11-29T03:09:14.721 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:14.757 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:15.701 INFO:teuthology.orchestra.run.smithi006.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:15.738 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/667 2023-11-29T03:09:15.739 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/667 2023-11-29T03:09:15.741 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:15.764 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:15.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:15.832 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-11-29T03:09:17.169 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:17.207 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:18.206 INFO:teuthology.orchestra.run.smithi006.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:18.239 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/668 2023-11-29T03:09:18.240 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/668 2023-11-29T03:09:18.240 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:18.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:18.335 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-11-29T03:09:19.714 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:19.757 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:19.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:20.684 INFO:teuthology.orchestra.run.smithi006.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:20.714 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/669 2023-11-29T03:09:20.714 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/669 2023-11-29T03:09:20.714 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:20.736 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:20.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:20.790 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-11-29T03:09:22.162 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:22.203 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:22.203 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:23.266 INFO:teuthology.orchestra.run.smithi006.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:23.298 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/670 2023-11-29T03:09:23.300 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/670 2023-11-29T03:09:23.300 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:23.320 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:23.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:23.384 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-11-29T03:09:24.746 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:24.764 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:24.764 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:25.685 INFO:teuthology.orchestra.run.smithi006.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:25.718 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/671 2023-11-29T03:09:25.719 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/671 2023-11-29T03:09:25.719 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:25.734 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:25.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:25.780 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-11-29T03:09:27.157 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:27.203 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:27.203 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:28.211 INFO:teuthology.orchestra.run.smithi006.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:28.245 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/672 2023-11-29T03:09:28.245 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/672 2023-11-29T03:09:28.245 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:28.270 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:28.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:28.337 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-11-29T03:09:29.742 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:29.763 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:29.763 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:31.597 INFO:teuthology.orchestra.run.smithi006.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:31.627 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/673 2023-11-29T03:09:31.627 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/673 2023-11-29T03:09:31.627 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:31.653 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:31.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:31.715 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-11-29T03:09:32.962 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:32.998 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:32.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:34.229 INFO:teuthology.orchestra.run.smithi006.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:34.258 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/674 2023-11-29T03:09:34.258 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/674 2023-11-29T03:09:34.258 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:34.278 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:34.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:34.323 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-11-29T03:09:35.665 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:35.695 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:35.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:37.136 INFO:teuthology.orchestra.run.smithi006.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T03:09:37.175 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/675 2023-11-29T03:09:37.175 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/675 2023-11-29T03:09:37.175 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T03:09:37.199 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T03:09:37.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:09:37.281 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-11-29T03:09:38.575 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T03:09:38.614 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:09:38.614 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:31.217 INFO:teuthology.orchestra.run.smithi006.stdout:generic/676 3892s 2023-11-29T04:14:31.307 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/676 2023-11-29T04:14:31.307 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:14:31.335 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:31.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:14:31.430 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-11-29T04:14:33.279 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:14:33.301 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:14:33.301 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:34.278 INFO:teuthology.orchestra.run.smithi006.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:14:34.310 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/677 2023-11-29T04:14:34.311 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/677 2023-11-29T04:14:34.311 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:14:34.342 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:34.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:14:34.426 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-11-29T04:14:35.785 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:14:35.827 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:14:35.827 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:37.395 INFO:teuthology.orchestra.run.smithi006.stdout:generic/678 2s 2023-11-29T04:14:37.445 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/678 2023-11-29T04:14:37.445 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:14:37.473 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:37.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:14:37.532 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-11-29T04:14:39.176 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:14:39.226 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:14:39.226 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:40.246 INFO:teuthology.orchestra.run.smithi006.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:14:40.282 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/679 2023-11-29T04:14:40.283 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/679 2023-11-29T04:14:40.283 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:14:40.302 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:40.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:14:40.336 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-11-29T04:14:41.666 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:14:41.709 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:14:41.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:44.301 INFO:teuthology.orchestra.run.smithi006.stdout:generic/680 3s 2023-11-29T04:14:44.330 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/680 2023-11-29T04:14:44.331 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:14:44.353 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:44.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:14:44.406 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-11-29T04:14:46.031 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:14:46.074 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:14:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:47.089 INFO:teuthology.orchestra.run.smithi006.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-29T04:14:47.115 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/681 2023-11-29T04:14:47.116 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/681 2023-11-29T04:14:47.116 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:14:47.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:47.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:14:47.189 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-11-29T04:14:48.494 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:14:48.552 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:14:48.552 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:49.547 INFO:teuthology.orchestra.run.smithi006.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-29T04:14:49.593 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/682 2023-11-29T04:14:49.593 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/682 2023-11-29T04:14:49.593 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:14:49.612 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:49.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:14:49.667 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-11-29T04:14:50.822 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:14:50.857 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:14:50.858 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:52.280 INFO:teuthology.orchestra.run.smithi006.stdout:generic/683 [not run] /tmp/tmp.Vq8HeyZOWwtest: file alloc unit 4194304 larger than op length 65536 2023-11-29T04:14:52.316 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/683 2023-11-29T04:14:52.317 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/683 2023-11-29T04:14:52.317 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:14:52.345 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:14:52.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:14:52.409 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-11-29T04:14:53.708 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:14:53.735 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:14:53.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:00.072 INFO:teuthology.orchestra.run.smithi006.stdout:generic/684 [not run] /tmp/tmp.Vq8HeyZOWwtest: file alloc unit 4194304 larger than op length 65536 2023-11-29T04:15:00.093 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/684 2023-11-29T04:15:00.093 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/684 2023-11-29T04:15:00.093 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:00.126 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:00.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:00.208 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-11-29T04:15:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:01.537 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:01.537 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:07.534 INFO:teuthology.orchestra.run.smithi006.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-29T04:15:07.559 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/685 2023-11-29T04:15:07.560 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/685 2023-11-29T04:15:07.560 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:07.577 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:07.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:07.651 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-11-29T04:15:08.953 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:08.990 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:08.991 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:14.991 INFO:teuthology.orchestra.run.smithi006.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-29T04:15:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/686 2023-11-29T04:15:15.004 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/686 2023-11-29T04:15:15.004 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:15.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:15.137 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-11-29T04:15:16.468 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:16.509 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:16.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:22.483 INFO:teuthology.orchestra.run.smithi006.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-29T04:15:22.519 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/687 2023-11-29T04:15:22.520 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/687 2023-11-29T04:15:22.520 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:22.542 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:22.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:22.611 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-11-29T04:15:24.005 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:24.019 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:25.716 INFO:teuthology.orchestra.run.smithi006.stdout:generic/688 [not run] /tmp/tmp.Vq8HeyZOWwtest: file alloc unit 4194304 larger than op length 65536 2023-11-29T04:15:25.730 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/688 2023-11-29T04:15:25.731 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/688 2023-11-29T04:15:25.731 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:25.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:25.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:25.847 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-11-29T04:15:27.137 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:27.189 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:27.190 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:28.281 INFO:teuthology.orchestra.run.smithi006.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2023-11-29T04:15:28.317 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/689 2023-11-29T04:15:28.317 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/689 2023-11-29T04:15:28.317 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:28.340 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:28.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:28.414 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-11-29T04:15:29.600 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:29.632 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:29.633 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:30.822 INFO:teuthology.orchestra.run.smithi006.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:15:30.861 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/690 2023-11-29T04:15:30.861 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/690 2023-11-29T04:15:30.861 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:30.890 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:30.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:30.970 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-11-29T04:15:32.227 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:32.278 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:32.278 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:33.230 INFO:teuthology.orchestra.run.smithi006.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:15:33.256 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/691 2023-11-29T04:15:33.256 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/691 2023-11-29T04:15:33.256 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:33.284 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:33.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:33.338 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-11-29T04:15:34.639 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:34.671 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:35.705 INFO:teuthology.orchestra.run.smithi006.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:15:35.745 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/692 2023-11-29T04:15:35.745 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/692 2023-11-29T04:15:35.745 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:35.768 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:35.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:35.836 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-11-29T04:15:36.955 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:36.981 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:36.981 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:38.272 INFO:teuthology.orchestra.run.smithi006.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:15:38.287 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/693 2023-11-29T04:15:38.287 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/693 2023-11-29T04:15:38.287 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:38.308 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:38.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:38.370 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-11-29T04:15:39.692 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:39.724 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:39.724 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:42.088 INFO:teuthology.orchestra.run.smithi006.stdout:generic/694 3s 2023-11-29T04:15:42.141 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/694 2023-11-29T04:15:42.141 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:42.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:42.238 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-11-29T04:15:43.548 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:43.581 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:43.581 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:44.548 INFO:teuthology.orchestra.run.smithi006.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:15:44.563 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/695 2023-11-29T04:15:44.563 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/695 2023-11-29T04:15:44.563 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:44.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:44.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:44.642 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-11-29T04:15:46.040 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:46.078 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:47.078 INFO:teuthology.orchestra.run.smithi006.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:15:47.096 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/696 2023-11-29T04:15:47.096 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/696 2023-11-29T04:15:47.097 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:47.127 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:47.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:47.182 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-11-29T04:15:48.579 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:48.617 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:48.617 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:49.914 INFO:teuthology.orchestra.run.smithi006.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-29T04:15:49.938 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/697 2023-11-29T04:15:49.938 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/697 2023-11-29T04:15:49.938 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:49.961 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:50.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:50.054 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-11-29T04:15:51.414 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:51.464 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:51.464 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:52.590 INFO:teuthology.orchestra.run.smithi006.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:15:52.623 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/698 2023-11-29T04:15:52.624 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/698 2023-11-29T04:15:52.624 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:52.651 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:52.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:52.722 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-11-29T04:15:54.036 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:54.077 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:54.078 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:55.306 INFO:teuthology.orchestra.run.smithi006.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:15:55.339 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/699 2023-11-29T04:15:55.340 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/699 2023-11-29T04:15:55.340 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:55.355 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:55.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:55.416 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-11-29T04:15:56.597 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:56.639 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:56.639 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:57.530 INFO:teuthology.orchestra.run.smithi006.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:15:57.552 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/700 2023-11-29T04:15:57.553 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/700 2023-11-29T04:15:57.553 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:15:57.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:15:57.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:15:57.635 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-11-29T04:15:58.876 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:15:58.913 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:15:58.913 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:00.685 INFO:teuthology.orchestra.run.smithi006.stdout:generic/701 2s 2023-11-29T04:16:00.733 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/701 2023-11-29T04:16:00.733 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:00.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:00.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:00.810 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-11-29T04:16:02.493 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:02.535 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:02.535 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:03.484 INFO:teuthology.orchestra.run.smithi006.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:16:03.511 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/702 2023-11-29T04:16:03.512 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/702 2023-11-29T04:16:03.512 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:03.545 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:03.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:03.630 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-11-29T04:16:04.961 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:05.006 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:06.109 INFO:teuthology.orchestra.run.smithi006.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:16:06.138 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/703 2023-11-29T04:16:06.138 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/703 2023-11-29T04:16:06.138 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:06.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:06.240 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-11-29T04:16:07.403 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:07.458 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:07.458 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:08.779 INFO:teuthology.orchestra.run.smithi006.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2023-11-29T04:16:08.794 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/704 2023-11-29T04:16:08.794 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/704 2023-11-29T04:16:08.794 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:08.827 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:08.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:08.864 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-11-29T04:16:10.185 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:10.231 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:10.231 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:11.240 INFO:teuthology.orchestra.run.smithi006.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:16:11.274 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/705 2023-11-29T04:16:11.274 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/705 2023-11-29T04:16:11.274 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:11.300 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:11.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:11.391 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-11-29T04:16:12.775 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:12.821 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:12.821 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:17.598 INFO:teuthology.orchestra.run.smithi006.stdout:generic/706 5s 2023-11-29T04:16:17.643 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/706 2023-11-29T04:16:17.643 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:17.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:17.758 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-11-29T04:16:19.543 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:19.572 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:19.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:20.572 INFO:teuthology.orchestra.run.smithi006.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:16:20.595 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/707 2023-11-29T04:16:20.598 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/707 2023-11-29T04:16:20.598 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:20.623 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:20.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:20.703 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-11-29T04:16:22.031 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:22.062 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:22.062 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:24.283 INFO:teuthology.orchestra.run.smithi006.stdout:generic/708 2s 2023-11-29T04:16:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/708 2023-11-29T04:16:24.338 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:24.366 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:24.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:24.443 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-11-29T04:16:26.256 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:26.294 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:26.294 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:27.560 INFO:teuthology.orchestra.run.smithi006.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:16:27.585 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/709 2023-11-29T04:16:27.585 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/709 2023-11-29T04:16:27.585 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:27.617 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:27.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:27.708 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-11-29T04:16:29.587 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:29.628 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:29.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:30.815 INFO:teuthology.orchestra.run.smithi006.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:16:30.844 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/710 2023-11-29T04:16:30.844 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/710 2023-11-29T04:16:30.844 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:30.855 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:31.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:31.020 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-11-29T04:16:32.826 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:32.853 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:32.853 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:34.095 INFO:teuthology.orchestra.run.smithi006.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:16:34.133 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/711 2023-11-29T04:16:34.134 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/711 2023-11-29T04:16:34.134 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:34.154 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:34.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:34.212 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-11-29T04:16:36.065 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:36.100 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:36.101 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:37.359 INFO:teuthology.orchestra.run.smithi006.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:16:37.389 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/712 2023-11-29T04:16:37.391 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/712 2023-11-29T04:16:37.391 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:37.403 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:37.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:37.561 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-11-29T04:16:39.076 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:39.115 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:39.115 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:40.325 INFO:teuthology.orchestra.run.smithi006.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-11-29T04:16:40.351 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/713 2023-11-29T04:16:40.351 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/713 2023-11-29T04:16:40.351 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:40.366 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:40.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:40.422 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-11-29T04:16:42.231 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:42.275 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:43.512 INFO:teuthology.orchestra.run.smithi006.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:16:43.550 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/714 2023-11-29T04:16:43.553 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/714 2023-11-29T04:16:43.553 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:43.586 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:43.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:43.674 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-11-29T04:16:45.591 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:45.631 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:45.631 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:46.843 INFO:teuthology.orchestra.run.smithi006.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-11-29T04:16:46.870 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/715 2023-11-29T04:16:46.870 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/715 2023-11-29T04:16:46.870 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:46.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:46.953 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-11-29T04:16:48.676 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:48.719 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:49.977 INFO:teuthology.orchestra.run.smithi006.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:16:50.020 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/716 2023-11-29T04:16:50.021 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/716 2023-11-29T04:16:50.021 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:50.041 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:50.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:50.119 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-11-29T04:16:51.883 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:51.913 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:51.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:53.081 INFO:teuthology.orchestra.run.smithi006.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:16:53.114 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/717 2023-11-29T04:16:53.115 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/717 2023-11-29T04:16:53.115 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:53.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:53.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:53.209 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-11-29T04:16:54.925 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:54.966 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:56.152 INFO:teuthology.orchestra.run.smithi006.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:16:56.186 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/718 2023-11-29T04:16:56.187 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/718 2023-11-29T04:16:56.187 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:56.217 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:56.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:56.327 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-11-29T04:16:58.219 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:16:58.272 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:16:58.272 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:59.619 INFO:teuthology.orchestra.run.smithi006.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:16:59.647 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/719 2023-11-29T04:16:59.647 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/719 2023-11-29T04:16:59.647 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:16:59.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:16:59.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:16:59.732 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-11-29T04:17:01.491 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:01.532 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:01.532 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:02.793 INFO:teuthology.orchestra.run.smithi006.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:17:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/720 2023-11-29T04:17:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/720 2023-11-29T04:17:02.816 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:02.832 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:02.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:02.919 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-11-29T04:17:04.864 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:04.898 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:04.899 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:06.066 INFO:teuthology.orchestra.run.smithi006.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-11-29T04:17:06.086 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/721 2023-11-29T04:17:06.086 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/721 2023-11-29T04:17:06.087 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:06.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:06.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:06.173 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-11-29T04:17:07.541 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:07.572 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:07.576 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:08.862 INFO:teuthology.orchestra.run.smithi006.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-29T04:17:08.899 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/722 2023-11-29T04:17:08.900 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/722 2023-11-29T04:17:08.900 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:09.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:09.120 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-11-29T04:17:10.675 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:10.711 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:10.711 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:11.880 INFO:teuthology.orchestra.run.smithi006.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-29T04:17:11.918 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/723 2023-11-29T04:17:11.919 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/723 2023-11-29T04:17:11.919 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:12.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:12.075 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-11-29T04:17:13.764 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:13.795 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:15.029 INFO:teuthology.orchestra.run.smithi006.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-29T04:17:15.049 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/724 2023-11-29T04:17:15.049 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/724 2023-11-29T04:17:15.050 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:15.080 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:15.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:15.138 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-11-29T04:17:16.863 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:16.885 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:16.885 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:18.154 INFO:teuthology.orchestra.run.smithi006.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-29T04:17:18.183 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/725 2023-11-29T04:17:18.184 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/725 2023-11-29T04:17:18.184 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:18.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:18.400 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-11-29T04:17:20.141 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:20.169 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:20.169 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:22.083 INFO:teuthology.orchestra.run.smithi006.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-29T04:17:22.107 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/726 2023-11-29T04:17:22.108 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/726 2023-11-29T04:17:22.114 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:22.133 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:22.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:22.212 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-11-29T04:17:23.947 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:23.980 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:23.980 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:25.430 INFO:teuthology.orchestra.run.smithi006.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-29T04:17:25.453 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/727 2023-11-29T04:17:25.453 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/727 2023-11-29T04:17:25.453 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:25.485 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:25.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:25.628 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-11-29T04:17:27.520 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:27.556 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:27.556 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:33.005 INFO:teuthology.orchestra.run.smithi006.stdout:generic/728 5s 2023-11-29T04:17:33.065 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/728 2023-11-29T04:17:33.065 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:33.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:33.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:33.207 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-11-29T04:17:34.515 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:34.568 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:34.568 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:36.410 INFO:teuthology.orchestra.run.smithi006.stdout:generic/729 2s 2023-11-29T04:17:36.467 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/729 2023-11-29T04:17:36.467 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:36.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:36.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:36.722 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-11-29T04:17:38.277 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:38.302 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:38.303 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:39.389 INFO:teuthology.orchestra.run.smithi006.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2023-11-29T04:17:39.411 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/730 2023-11-29T04:17:39.411 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/730 2023-11-29T04:17:39.411 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:39.422 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:39.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:39.483 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-11-29T04:17:40.828 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:40.869 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:40.869 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:41.901 INFO:teuthology.orchestra.run.smithi006.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2023-11-29T04:17:41.935 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/731 2023-11-29T04:17:41.936 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/731 2023-11-29T04:17:41.938 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:42.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:42.048 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.TCCktrMdx7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2023-11-29T04:17:43.319 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph-fuse 2023-11-29T04:17:43.360 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T04:17:43.360 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:44.424 INFO:teuthology.orchestra.run.smithi006.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2023-11-29T04:17:44.452 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/732 2023-11-29T04:17:44.453 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/732 2023-11-29T04:17:44.453 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-11-29T04:17:44.467 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:44.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T04:17:44.522 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 16========================================================= 2023-11-29T04:17:44.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo userdel --force --remove fsgqa 2023-11-29T04:17:44.716 INFO:teuthology.orchestra.run.smithi006.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-11-29T04:17:45.072 DEBUG:teuthology.orchestra.run.smithi006:> sudo userdel --force --remove 123456-fsgqa 2023-11-29T04:17:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-11-29T04:17:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-11-29T04:17:45.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo groupdel fsgqa 2023-11-29T04:17:45.596 INFO:teuthology.orchestra.run.smithi006.stderr:groupdel: group 'fsgqa' does not exist 2023-11-29T04:17:45.603 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-11-29T04:17:45.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:17:45.604 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.TCCktrMdx7xfstests-dev/results) 2023-11-29T04:17:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2023-11-29T04:17:45.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T04:17:45.651 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.TCCktrMdx7xfstests-dev 2023-11-29T04:17:45.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf /tmp/tmp.TCCktrMdx7xfstests-dev 2023-11-29T04:17:46.875 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T04:17:46.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T04:17:47.105 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T04:17:47.354 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T04:17:47.354 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-29T04:17:47.354 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T04:17:47.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3628 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T04:17:47.406 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-11-29T04:17:47.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:17:47.406 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T04:17:47.503 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-29T04:17:47.503 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T04:17:47.525 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T04:17:47.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-29T04:17:47.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:17:47.525 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-29T04:17:47.589 INFO:teuthology.orchestra.run.smithi031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-29T04:17:47.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T04:17:47.590 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-29T04:17:47.590 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T04:17:47.630 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3628 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T04:17:47.631 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-11-29T04:17:47.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:17:47.631 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-29T04:17:47.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T04:17:47.714 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-29T04:17:47.715 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-29T04:17:47.715 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T04:17:47.726 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T04:17:47.726 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2023-11-29T04:17:47.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:17:47.726 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-29T04:17:47.782 INFO:teuthology.orchestra.run.smithi031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-29T04:17:47.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T04:17:47.784 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T04:17:48.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.937+0000 7f50b60d6640 1 Processor -- start 2023-11-29T04:17:48.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50b60d6640 1 -- start start 2023-11-29T04:17:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50b60d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00717e0 0x7f50b00b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50b60d6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b0070a20 con 0x7f50b00b2bf0 2023-11-29T04:17:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50b60d6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b0070d00 con 0x7f50b0071e20 2023-11-29T04:17:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50b60d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0070fe0 con 0x7f50b00717e0 2023-11-29T04:17:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50aeffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00717e0 0x7f50b00b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50aeffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00717e0 0x7f50b00b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43170/0 (socket says 172.21.15.6:43170) 2023-11-29T04:17:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50aeffd640 1 -- 172.21.15.6:0/846826982 learned_addr learned my addr 172.21.15.6:0/846826982 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:48.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50aeffd640 1 -- 172.21.15.6:0/846826982 >> v1:172.21.15.31:6789/0 conn(0x7f50b0071e20 legacy=0x7f50b0072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:48.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50aeffd640 1 -- 172.21.15.6:0/846826982 >> v1:172.21.15.6:6789/0 conn(0x7f50b00b2bf0 legacy=0x7f50b006c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:17:48.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.945+0000 7f50aeffd640 1 -- 172.21.15.6:0/846826982 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00712c0 con 0x7f50b00717e0 2023-11-29T04:17:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50aeffd640 1 --2- 172.21.15.6:0/846826982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00717e0 0x7f50b00b26b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f50a40098a0 tx=0x7f50a401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=566cd559aca41944 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50ae7fc640 1 -- 172.21.15.6:0/846826982 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40a7070 con 0x7f50b00717e0 2023-11-29T04:17:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50ae7fc640 1 -- 172.21.15.6:0/846826982 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a40ab430 con 0x7f50b00717e0 2023-11-29T04:17:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50ae7fc640 1 -- 172.21.15.6:0/846826982 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40ab7c0 con 0x7f50b00717e0 2023-11-29T04:17:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50b60d6640 1 -- 172.21.15.6:0/846826982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00717e0 msgr2=0x7f50b00b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50b60d6640 1 --2- 172.21.15.6:0/846826982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00717e0 0x7f50b00b26b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f50a40098a0 tx=0x7f50a401c520 comp rx=0 tx=0).stop 2023-11-29T04:17:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50b60d6640 1 -- 172.21.15.6:0/846826982 shutdown_connections 2023-11-29T04:17:48.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50b60d6640 1 --2- 172.21.15.6:0/846826982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00717e0 0x7f50b00b26b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50b60d6640 1 -- 172.21.15.6:0/846826982 >> 172.21.15.6:0/846826982 conn(0x7f50b006a750 msgr2=0x7f50b006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50b60d6640 1 -- 172.21.15.6:0/846826982 shutdown_connections 2023-11-29T04:17:48.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.953+0000 7f50b60d6640 1 -- 172.21.15.6:0/846826982 wait complete. 2023-11-29T04:17:48.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.961+0000 7f50b60d6640 1 Processor -- start 2023-11-29T04:17:48.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.961+0000 7f50b60d6640 1 -- start start 2023-11-29T04:17:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50b60d6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00717e0 0x7f50b0141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50b60d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50b0071e20 0x7f50b015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50b60d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00b2bf0 0x7f50b015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:48.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50b60d6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0141b50 con 0x7f50b00717e0 2023-11-29T04:17:48.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50b60d6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0155640 con 0x7f50b0071e20 2023-11-29T04:17:48.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50b60d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b0155920 con 0x7f50b00b2bf0 2023-11-29T04:17:48.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50aeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50b0071e20 0x7f50b015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:48.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50aeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50b0071e20 0x7f50b015b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:52096/0 (socket says 172.21.15.6:52096) 2023-11-29T04:17:48.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50aeffd640 1 -- 172.21.15.6:0/3816314042 learned_addr learned my addr 172.21.15.6:0/3816314042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:48.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.969+0000 7f50affff640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00b2bf0 0x7f50b015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f50aeffd640 1 -- 172.21.15.6:0/3816314042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00b2bf0 msgr2=0x7f50b015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f50aeffd640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00b2bf0 0x7f50b015a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f50aeffd640 1 -- 172.21.15.6:0/3816314042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00717e0 msgr2=0x7f50b0141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f50aeffd640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00717e0 0x7f50b0141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f50aeffd640 1 -- 172.21.15.6:0/3816314042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40094d0 con 0x7f50b0071e20 2023-11-29T04:17:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f50aeffd640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50b0071e20 0x7f50b015b360 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f50a40ad040 tx=0x7f50a40192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f5097fff640 1 -- 172.21.15.6:0/3816314042 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40bc070 con 0x7f50b0071e20 2023-11-29T04:17:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f5097fff640 1 -- 172.21.15.6:0/3816314042 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a40b4630 con 0x7f50b0071e20 2023-11-29T04:17:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f5097fff640 1 -- 172.21.15.6:0/3816314042 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a40b4a00 con 0x7f50b0071e20 2023-11-29T04:17:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b0155c00 con 0x7f50b0071e20 2023-11-29T04:17:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.973+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b01561c0 con 0x7f50b0071e20 2023-11-29T04:17:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.977+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b01563e0 con 0x7f50b0071e20 2023-11-29T04:17:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.981+0000 7f5097fff640 1 -- 172.21.15.6:0/3816314042 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f50a40b4b60 con 0x7f50b0071e20 2023-11-29T04:17:48.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.981+0000 7f5097fff640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f509c0664f0 0x7f509c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:48.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.981+0000 7f5097fff640 1 -- 172.21.15.6:0/3816314042 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50a411d740 con 0x7f50b0071e20 2023-11-29T04:17:48.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.985+0000 7f50af7fe640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f509c0664f0 0x7f509c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.985+0000 7f50af7fe640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f509c0664f0 0x7f509c0689b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f50a0000f70 tx=0x7f50a00079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:48.989+0000 7f5097fff640 1 -- 172.21.15.6:0/3816314042 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50a40ead30 con 0x7f50b0071e20 2023-11-29T04:17:50.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.005+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50b01563e0 con 0x7f50b0071e20 2023-11-29T04:17:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.037+0000 7f5097fff640 1 -- 172.21.15.6:0/3816314042 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4901 (secure 0 0 0) 0x7f50a411be60 con 0x7f50b0071e20 2023-11-29T04:17:50.043 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:50.044 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1525667557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1525667557},{"type":"v1","addr":"172.21.15.31:6834","nonce":1525667557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/71303197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":71303197},{"type":"v1","addr":"172.21.15.31:6835","nonce":71303197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/4130466882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":4130466882},{"type":"v1","addr":"172.21.15.6:6837","nonce":4130466882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:09:13.024455+0000","modified":"2023-11-28T21:09:16.059795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5190":{"gid":5190,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2805255705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2805255705},{"type":"v1","addr":"172.21.15.6:6835","nonce":2805255705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T04:17:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-11-29T04:17:50.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.049+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f509c0664f0 msgr2=0x7f509c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:50.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.049+0000 7f50b60d6640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f509c0664f0 0x7f509c0689b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f50a0000f70 tx=0x7f50a00079c0 comp rx=0 tx=0).stop 2023-11-29T04:17:50.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.049+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50b0071e20 msgr2=0x7f50b015b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:50.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.049+0000 7f50b60d6640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50b0071e20 0x7f50b015b360 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f50a40ad040 tx=0x7f50a40192c0 comp rx=0 tx=0).stop 2023-11-29T04:17:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.057+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 shutdown_connections 2023-11-29T04:17:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.057+0000 7f50b60d6640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f509c0664f0 0x7f509c0689b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.057+0000 7f50b60d6640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50b00b2bf0 0x7f50b015a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.057+0000 7f50b60d6640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50b0071e20 0x7f50b015b360 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.057+0000 7f50b60d6640 1 --2- 172.21.15.6:0/3816314042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b00717e0 0x7f50b0141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.057+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 >> 172.21.15.6:0/3816314042 conn(0x7f50b006a750 msgr2=0x7f50b00af320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.057+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 shutdown_connections 2023-11-29T04:17:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.057+0000 7f50b60d6640 1 -- 172.21.15.6:0/3816314042 wait complete. 2023-11-29T04:17:50.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T04:17:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.765+0000 7f20b4f72640 1 Processor -- start 2023-11-29T04:17:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.765+0000 7f20b4f72640 1 -- start start 2023-11-29T04:17:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.773+0000 7f20add9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f20b0161c50 0x7f20b0070ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:50250/0 (socket says 172.21.15.6:50250) 2023-11-29T04:17:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.773+0000 7f20b4f72640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b016a550 0x7f20b016c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.773+0000 7f20b4f72640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b00b32d0 con 0x7f20b00ce680 2023-11-29T04:17:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.773+0000 7f20b4f72640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b00b26c0 con 0x7f20b0161c50 2023-11-29T04:17:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.773+0000 7f20b4f72640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b006d580 con 0x7f20b016a550 2023-11-29T04:17:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.773+0000 7f20add9b640 1 -- 172.21.15.6:0/1104113194 learned_addr learned my addr 172.21.15.6:0/1104113194 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:17:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.777+0000 7f20aed9d640 1 --2- 172.21.15.6:0/1104113194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b016a550 0x7f20b016c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.777+0000 7f20ad59a640 1 -- 172.21.15.6:0/1104113194 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494605591 0 0) 0x7f20b00b26c0 con 0x7f20b0161c50 2023-11-29T04:17:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.777+0000 7f20ad59a640 1 -- 172.21.15.6:0/1104113194 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2098003530 con 0x7f20b0161c50 2023-11-29T04:17:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.777+0000 7f20aed9d640 1 -- 172.21.15.6:0/1104113194 >> v1:172.21.15.31:6789/0 conn(0x7f20b0161c50 legacy=0x7f20b0070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.777+0000 7f20aed9d640 1 -- 172.21.15.6:0/1104113194 >> v1:172.21.15.6:6789/0 conn(0x7f20b00ce680 legacy=0x7f20b00703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:17:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.777+0000 7f20aed9d640 1 -- 172.21.15.6:0/1104113194 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00b29a0 con 0x7f20b016a550 2023-11-29T04:17:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.781+0000 7f20aed9d640 1 --2- 172.21.15.6:0/1104113194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b016a550 0x7f20b016c940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f20a00097f0 tx=0x7f20a001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b081c00beaca69b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.781+0000 7f20ad59a640 1 -- 172.21.15.6:0/1104113194 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a00ab600 con 0x7f20b016a550 2023-11-29T04:17:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.781+0000 7f20ad59a640 1 -- 172.21.15.6:0/1104113194 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a00a7050 con 0x7f20b016a550 2023-11-29T04:17:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.781+0000 7f20ad59a640 1 -- 172.21.15.6:0/1104113194 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a00ab980 con 0x7f20b016a550 2023-11-29T04:17:50.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.785+0000 7f20b4f72640 1 -- 172.21.15.6:0/1104113194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b016a550 msgr2=0x7f20b016c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:50.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.785+0000 7f20b4f72640 1 --2- 172.21.15.6:0/1104113194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b016a550 0x7f20b016c940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f20a00097f0 tx=0x7f20a001c480 comp rx=0 tx=0).stop 2023-11-29T04:17:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.785+0000 7f20b4f72640 1 -- 172.21.15.6:0/1104113194 shutdown_connections 2023-11-29T04:17:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.785+0000 7f20b4f72640 1 --2- 172.21.15.6:0/1104113194 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b016a550 0x7f20b016c940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.785+0000 7f20b4f72640 1 -- 172.21.15.6:0/1104113194 >> 172.21.15.6:0/1104113194 conn(0x7f20b006a750 msgr2=0x7f20b006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:50.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.793+0000 7f20b4f72640 1 -- 172.21.15.6:0/1104113194 shutdown_connections 2023-11-29T04:17:50.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.793+0000 7f20b4f72640 1 -- 172.21.15.6:0/1104113194 wait complete. 2023-11-29T04:17:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.801+0000 7f20b4f72640 1 Processor -- start 2023-11-29T04:17:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.801+0000 7f20b4f72640 1 -- start start 2023-11-29T04:17:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.805+0000 7f20b4f72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b00ce680 0x7f20b00b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.805+0000 7f20b4f72640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b0161c50 0x7f20b014c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.805+0000 7f20b4f72640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20b016a550 0x7f20b0146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.805+0000 7f20b4f72640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b01591d0 con 0x7f20b00ce680 2023-11-29T04:17:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.805+0000 7f20b4f72640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b014cf30 con 0x7f20b016a550 2023-11-29T04:17:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.805+0000 7f20b4f72640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00b0b10 con 0x7f20b0161c50 2023-11-29T04:17:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.805+0000 7f20add9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b0161c50 0x7f20b014c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.805+0000 7f20add9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b0161c50 0x7f20b014c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43194/0 (socket says 172.21.15.6:43194) 2023-11-29T04:17:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.805+0000 7f20add9b640 1 -- 172.21.15.6:0/497641476 learned_addr learned my addr 172.21.15.6:0/497641476 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:50.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f20ae59c640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b00ce680 0x7f20b00b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:50.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f20add9b640 1 -- 172.21.15.6:0/497641476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20b016a550 msgr2=0x7f20b0146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:50.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f20add9b640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20b016a550 0x7f20b0146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:50.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f20add9b640 1 -- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b00ce680 msgr2=0x7f20b00b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:50.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f20add9b640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b00ce680 0x7f20b00b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:50.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f20add9b640 1 -- 172.21.15.6:0/497641476 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0009420 con 0x7f20b0161c50 2023-11-29T04:17:50.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f20add9b640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b0161c50 0x7f20b014c9f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c450 tx=0x7f20a400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:50.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f209effd640 1 -- 172.21.15.6:0/497641476 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4005cf0 con 0x7f20b0161c50 2023-11-29T04:17:50.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f209effd640 1 -- 172.21.15.6:0/497641476 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a4005e50 con 0x7f20b0161c50 2023-11-29T04:17:50.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f209effd640 1 -- 172.21.15.6:0/497641476 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4007270 con 0x7f20b0161c50 2023-11-29T04:17:50.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b00b0df0 con 0x7f20b0161c50 2023-11-29T04:17:50.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.809+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b0158e60 con 0x7f20b0161c50 2023-11-29T04:17:50.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.813+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2094005260 con 0x7f20b0161c50 2023-11-29T04:17:50.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.813+0000 7f209effd640 1 -- 172.21.15.6:0/497641476 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20a40073d0 con 0x7f20b0161c50 2023-11-29T04:17:50.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.813+0000 7f209effd640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2090066470 0x7f2090068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:50.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.817+0000 7f209effd640 1 -- 172.21.15.6:0/497641476 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20a40832e0 con 0x7f20b0161c50 2023-11-29T04:17:50.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.817+0000 7f20ae59c640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2090066470 0x7f2090068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:50.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.817+0000 7f20ae59c640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2090066470 0x7f2090068930 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009f20 tx=0x7f20a80094d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:50.825+0000 7f209effd640 1 -- 172.21.15.6:0/497641476 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20a4050770 con 0x7f20b0161c50 2023-11-29T04:17:51.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.629+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2094005510 con 0x7f20b0161c50 2023-11-29T04:17:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.689+0000 7f209effd640 1 -- 172.21.15.6:0/497641476 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f20a4053d90 con 0x7f20b0161c50 2023-11-29T04:17:51.692 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:51.692 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:09:14.652293+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:09:10.815928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T21:09:12.024583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T04:17:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2090066470 msgr2=0x7f2090068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2090066470 0x7f2090068930 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009f20 tx=0x7f20a80094d0 comp rx=0 tx=0).stop 2023-11-29T04:17:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b0161c50 msgr2=0x7f20b014c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b0161c50 0x7f20b014c9f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c450 tx=0x7f20a400c910 comp rx=0 tx=0).stop 2023-11-29T04:17:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 shutdown_connections 2023-11-29T04:17:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f2090066470 0x7f2090068930 secure :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009f20 tx=0x7f20a80094d0 comp rx=0 tx=0).stop 2023-11-29T04:17:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20b016a550 0x7f20b0146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20b0161c50 0x7f20b014c9f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 --2- 172.21.15.6:0/497641476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b00ce680 0x7f20b00b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.697+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 >> 172.21.15.6:0/497641476 conn(0x7f20b006a750 msgr2=0x7f20b00703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:51.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.701+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 shutdown_connections 2023-11-29T04:17:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:51.701+0000 7f20b4f72640 1 -- 172.21.15.6:0/497641476 wait complete. 2023-11-29T04:17:51.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T21:07:56.713465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T21:09:10.815928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T21:09:12.024583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T04:17:51.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T04:17:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.377+0000 7f1d899d0640 1 Processor -- start 2023-11-29T04:17:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.377+0000 7f1d899d0640 1 -- start start 2023-11-29T04:17:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.377+0000 7f1d899d0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8414a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.377+0000 7f1d899d0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8406d000 con 0x7f1d8414a490 2023-11-29T04:17:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.381+0000 7f1d899d0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8406c760 con 0x7f1d8406c0f0 2023-11-29T04:17:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.381+0000 7f1d899d0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8406c580 con 0x7f1d840cf410 2023-11-29T04:17:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.381+0000 7f1d889ce640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1d8414a490 0x7f1d840ced00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44202/0 (socket says 172.21.15.6:44202) 2023-11-29T04:17:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.381+0000 7f1d889ce640 1 -- 172.21.15.6:0/442556389 learned_addr learned my addr 172.21.15.6:0/442556389 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:17:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.381+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/442556389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8414a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.381+0000 7f1d7bfff640 1 -- 172.21.15.6:0/442556389 >> v1:172.21.15.31:6789/0 conn(0x7f1d8406c0f0 legacy=0x7f1d840b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.381+0000 7f1d7bfff640 1 -- 172.21.15.6:0/442556389 >> v1:172.21.15.6:6789/0 conn(0x7f1d8414a490 legacy=0x7f1d840ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.381+0000 7f1d7bfff640 1 -- 172.21.15.6:0/442556389 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8406ca40 con 0x7f1d840cf410 2023-11-29T04:17:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.393+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/442556389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8414a870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1d740097f0 tx=0x7f1d7401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebae63785d532e38 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.393+0000 7f1d7b7fe640 1 -- 172.21.15.6:0/442556389 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740ab600 con 0x7f1d840cf410 2023-11-29T04:17:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.393+0000 7f1d7b7fe640 1 -- 172.21.15.6:0/442556389 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d740a7050 con 0x7f1d840cf410 2023-11-29T04:17:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.393+0000 7f1d7b7fe640 1 -- 172.21.15.6:0/442556389 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740ab980 con 0x7f1d840cf410 2023-11-29T04:17:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.397+0000 7f1d899d0640 1 -- 172.21.15.6:0/442556389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 msgr2=0x7f1d8414a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.397+0000 7f1d899d0640 1 --2- 172.21.15.6:0/442556389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8414a870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1d740097f0 tx=0x7f1d7401c430 comp rx=0 tx=0).stop 2023-11-29T04:17:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.397+0000 7f1d899d0640 1 -- 172.21.15.6:0/442556389 shutdown_connections 2023-11-29T04:17:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.397+0000 7f1d899d0640 1 --2- 172.21.15.6:0/442556389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8414a870 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.397+0000 7f1d899d0640 1 -- 172.21.15.6:0/442556389 >> 172.21.15.6:0/442556389 conn(0x7f1d8406a750 msgr2=0x7f1d8406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.397+0000 7f1d899d0640 1 -- 172.21.15.6:0/442556389 shutdown_connections 2023-11-29T04:17:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.397+0000 7f1d899d0640 1 -- 172.21.15.6:0/442556389 wait complete. 2023-11-29T04:17:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.401+0000 7f1d899d0640 1 Processor -- start 2023-11-29T04:17:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.401+0000 7f1d899d0640 1 -- start start 2023-11-29T04:17:52.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.405+0000 7f1d899d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8406c0f0 0x7f1d8415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:52.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.405+0000 7f1d899d0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:52.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.405+0000 7f1d899d0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d8414a490 0x7f1d84143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:52.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.405+0000 7f1d899d0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8415e1c0 con 0x7f1d8406c0f0 2023-11-29T04:17:52.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.405+0000 7f1d899d0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8415e3f0 con 0x7f1d8414a490 2023-11-29T04:17:52.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.405+0000 7f1d899d0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8415e6d0 con 0x7f1d840cf410 2023-11-29T04:17:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d889ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8406c0f0 0x7f1d8415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d889ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8406c0f0 0x7f1d8415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34694/0 (socket says 172.21.15.6:34694) 2023-11-29T04:17:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d889ce640 1 -- 172.21.15.6:0/2982006138 learned_addr learned my addr 172.21.15.6:0/2982006138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d891cf640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d8414a490 0x7f1d84143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d889ce640 1 -- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 msgr2=0x7f1d8415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d889ce640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8415b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d889ce640 1 -- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d8414a490 msgr2=0x7f1d84143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d889ce640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d8414a490 0x7f1d84143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d889ce640 1 -- 172.21.15.6:0/2982006138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74009420 con 0x7f1d8406c0f0 2023-11-29T04:17:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d891cf640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d8414a490 0x7f1d84143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:17:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8415b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T04:17:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d889ce640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8406c0f0 0x7f1d8415dc80 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000cbc0 tx=0x7f1d8000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d797fa640 1 -- 172.21.15.6:0/2982006138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8000aca0 con 0x7f1d8406c0f0 2023-11-29T04:17:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d797fa640 1 -- 172.21.15.6:0/2982006138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8000ae00 con 0x7f1d8406c0f0 2023-11-29T04:17:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d797fa640 1 -- 172.21.15.6:0/2982006138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80012600 con 0x7f1d8406c0f0 2023-11-29T04:17:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d840b3230 con 0x7f1d8406c0f0 2023-11-29T04:17:52.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.409+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8415ec90 con 0x7f1d8406c0f0 2023-11-29T04:17:52.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.413+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8404e850 con 0x7f1d8406c0f0 2023-11-29T04:17:52.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.413+0000 7f1d797fa640 1 -- 172.21.15.6:0/2982006138 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d80007070 con 0x7f1d8406c0f0 2023-11-29T04:17:52.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.417+0000 7f1d797fa640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1d70066470 0x7f1d70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:52.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.417+0000 7f1d797fa640 1 -- 172.21.15.6:0/2982006138 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d80083d50 con 0x7f1d8406c0f0 2023-11-29T04:17:52.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.425+0000 7f1d797fa640 1 -- 172.21.15.6:0/2982006138 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d800511e0 con 0x7f1d8406c0f0 2023-11-29T04:17:52.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.425+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1d70066470 0x7f1d70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:52.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.425+0000 7f1d7bfff640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1d70066470 0x7f1d70068930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1d740ad000 tx=0x7f1d74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:52.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.945+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d8416d150 con 0x7f1d8406c0f0 2023-11-29T04:17:52.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.957+0000 7f1d797fa640 1 -- 172.21.15.6:0/2982006138 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d800170a0 con 0x7f1d8406c0f0 2023-11-29T04:17:52.971 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-11-29T04:17:52.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1d70066470 msgr2=0x7f1d70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:52.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1d70066470 0x7f1d70068930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1d740ad000 tx=0x7f1d74008040 comp rx=0 tx=0).stop 2023-11-29T04:17:52.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8406c0f0 msgr2=0x7f1d8415dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:52.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8406c0f0 0x7f1d8415dc80 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000cbc0 tx=0x7f1d8000a060 comp rx=0 tx=0).stop 2023-11-29T04:17:52.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 shutdown_connections 2023-11-29T04:17:52.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f1d70066470 0x7f1d70068930 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:52.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d8414a490 0x7f1d84143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1d840cf410 0x7f1d8415b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 --2- 172.21.15.6:0/2982006138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8406c0f0 0x7f1d8415dc80 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 >> 172.21.15.6:0/2982006138 conn(0x7f1d8406a750 msgr2=0x7f1d8406ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 shutdown_connections 2023-11-29T04:17:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:52.973+0000 7f1d899d0640 1 -- 172.21.15.6:0/2982006138 wait complete. 2023-11-29T04:17:53.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T04:17:53.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.317+0000 7fd0d54d6640 1 Processor -- start 2023-11-29T04:17:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.317+0000 7fd0d54d6640 1 -- start start 2023-11-29T04:17:53.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.321+0000 7fd0d54d6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0d01426b0 0x7fd0d00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:53.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.321+0000 7fd0d54d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 0x7fd0d0141060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.321+0000 7fd0d54d6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d0140030 con 0x7fd0d0159170 2023-11-29T04:17:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.321+0000 7fd0d54d6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d00b29d0 con 0x7fd0d01426b0 2023-11-29T04:17:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.321+0000 7fd0d54d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00cff30 con 0x7fd0d00b2540 2023-11-29T04:17:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.325+0000 7fd0cf7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 0x7fd0d0141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.325+0000 7fd0cf7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 0x7fd0d0141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43222/0 (socket says 172.21.15.6:43222) 2023-11-29T04:17:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.325+0000 7fd0ceffd640 1 --1- 172.21.15.6:0/4176835123 >> v1:172.21.15.6:6789/0 conn(0x7fd0d0159170 0x7fd0d00cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44204/0 (socket says 172.21.15.6:44204) 2023-11-29T04:17:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.325+0000 7fd0cf7fe640 1 -- 172.21.15.6:0/4176835123 learned_addr learned my addr 172.21.15.6:0/4176835123 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.325+0000 7fd0ce7fc640 1 --2- 172.21.15.6:0/4176835123 >> v2:172.21.15.31:3300/0 conn(0x7fd0d01426b0 0x7fd0d00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:53.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.325+0000 7fd0cf7fe640 1 -- 172.21.15.6:0/4176835123 >> v2:172.21.15.31:3300/0 conn(0x7fd0d01426b0 msgr2=0x7fd0d00b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:17:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.325+0000 7fd0cf7fe640 1 --2- 172.21.15.6:0/4176835123 >> v2:172.21.15.31:3300/0 conn(0x7fd0d01426b0 0x7fd0d00b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.325+0000 7fd0cf7fe640 1 -- 172.21.15.6:0/4176835123 >> v1:172.21.15.6:6789/0 conn(0x7fd0d0159170 legacy=0x7fd0d00cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.325+0000 7fd0cf7fe640 1 -- 172.21.15.6:0/4176835123 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d01402a0 con 0x7fd0d00b2540 2023-11-29T04:17:53.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.329+0000 7fd0cf7fe640 1 --2- 172.21.15.6:0/4176835123 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 0x7fd0d0141060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009e80 tx=0x7fd0c801c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab6c3a806f3b67ac server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:53.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.329+0000 7fd0cdffb640 1 -- 172.21.15.6:0/4176835123 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c80a5880 con 0x7fd0d00b2540 2023-11-29T04:17:53.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.329+0000 7fd0cdffb640 1 -- 172.21.15.6:0/4176835123 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c80a59e0 con 0x7fd0d00b2540 2023-11-29T04:17:53.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.329+0000 7fd0cdffb640 1 -- 172.21.15.6:0/4176835123 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c80a5d70 con 0x7fd0d00b2540 2023-11-29T04:17:53.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.333+0000 7fd0d54d6640 1 -- 172.21.15.6:0/4176835123 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 msgr2=0x7fd0d0141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:53.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.333+0000 7fd0d54d6640 1 --2- 172.21.15.6:0/4176835123 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 0x7fd0d0141060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009e80 tx=0x7fd0c801c9c0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.337+0000 7fd0d54d6640 1 -- 172.21.15.6:0/4176835123 shutdown_connections 2023-11-29T04:17:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.337+0000 7fd0d54d6640 1 --2- 172.21.15.6:0/4176835123 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 0x7fd0d0141060 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.337+0000 7fd0d54d6640 1 --2- 172.21.15.6:0/4176835123 >> v2:172.21.15.31:3300/0 conn(0x7fd0d01426b0 0x7fd0d00b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.337+0000 7fd0d54d6640 1 -- 172.21.15.6:0/4176835123 >> 172.21.15.6:0/4176835123 conn(0x7fd0d00b4520 msgr2=0x7fd0d00b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.337+0000 7fd0d54d6640 1 -- 172.21.15.6:0/4176835123 shutdown_connections 2023-11-29T04:17:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.337+0000 7fd0d54d6640 1 -- 172.21.15.6:0/4176835123 wait complete. 2023-11-29T04:17:53.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0d54d6640 1 Processor -- start 2023-11-29T04:17:53.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0d54d6640 1 -- start start 2023-11-29T04:17:53.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0d54d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 0x7fd0d0145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:53.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0d54d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d01426b0 0x7fd0d00988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:53.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0d54d6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0159170 0x7fd0d00ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:53.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0d54d6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0145890 con 0x7fd0d0159170 2023-11-29T04:17:53.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0d54d6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0098e00 con 0x7fd0d01426b0 2023-11-29T04:17:53.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0d54d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00ce900 con 0x7fd0d00b2540 2023-11-29T04:17:53.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0ce7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d01426b0 0x7fd0d00988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:53.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0ce7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d01426b0 0x7fd0d00988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:52128/0 (socket says 172.21.15.6:52128) 2023-11-29T04:17:53.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.345+0000 7fd0ce7fc640 1 -- 172.21.15.6:0/3394546705 learned_addr learned my addr 172.21.15.6:0/3394546705 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:53.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.349+0000 7fd0ce7fc640 1 -- 172.21.15.6:0/3394546705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 msgr2=0x7fd0d0145350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-29T04:17:53.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.349+0000 7fd0ce7fc640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 0x7fd0d0145350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.349+0000 7fd0ce7fc640 1 -- 172.21.15.6:0/3394546705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0159170 msgr2=0x7fd0d00ce3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T04:17:53.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.349+0000 7fd0ce7fc640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0159170 0x7fd0d00ce3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.349+0000 7fd0ce7fc640 1 -- 172.21.15.6:0/3394546705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8009b30 con 0x7fd0d01426b0 2023-11-29T04:17:53.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.349+0000 7fd0ce7fc640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d01426b0 0x7fd0d00988c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400d7d0 tx=0x7fd0c400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:53.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.353+0000 7fd0b77fe640 1 -- 172.21.15.6:0/3394546705 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4018070 con 0x7fd0d01426b0 2023-11-29T04:17:53.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.353+0000 7fd0b77fe640 1 -- 172.21.15.6:0/3394546705 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c4004020 con 0x7fd0d01426b0 2023-11-29T04:17:53.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.353+0000 7fd0b77fe640 1 -- 172.21.15.6:0/3394546705 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40041b0 con 0x7fd0d01426b0 2023-11-29T04:17:53.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.353+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d015a9c0 con 0x7fd0d01426b0 2023-11-29T04:17:53.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.353+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d015af80 con 0x7fd0d01426b0 2023-11-29T04:17:53.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.357+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d00b1bd0 con 0x7fd0d01426b0 2023-11-29T04:17:53.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.361+0000 7fd0b77fe640 1 -- 172.21.15.6:0/3394546705 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0c4004310 con 0x7fd0d01426b0 2023-11-29T04:17:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.365+0000 7fd0b77fe640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0bc0664f0 0x7fd0bc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.365+0000 7fd0b77fe640 1 -- 172.21.15.6:0/3394546705 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0c4083c90 con 0x7fd0d01426b0 2023-11-29T04:17:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.365+0000 7fd0ceffd640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0bc0664f0 0x7fd0bc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.369+0000 7fd0b77fe640 1 -- 172.21.15.6:0/3394546705 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0c40510f0 con 0x7fd0d01426b0 2023-11-29T04:17:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.369+0000 7fd0ceffd640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0bc0664f0 0x7fd0bc0689b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0000f70 tx=0x7fd0c0007a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.653+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0d004e930 con 0x7fd0d01426b0 2023-11-29T04:17:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.673+0000 7fd0b77fe640 1 -- 172.21.15.6:0/3394546705 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0c4054710 con 0x7fd0d01426b0 2023-11-29T04:17:53.677 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-11-29T04:17:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0bc0664f0 msgr2=0x7fd0bc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0bc0664f0 0x7fd0bc0689b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0000f70 tx=0x7fd0c0007a10 comp rx=0 tx=0).stop 2023-11-29T04:17:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d01426b0 msgr2=0x7fd0d00988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d01426b0 0x7fd0d00988c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400d7d0 tx=0x7fd0c400dc90 comp rx=0 tx=0).stop 2023-11-29T04:17:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 shutdown_connections 2023-11-29T04:17:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd0bc0664f0 0x7fd0bc0689b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0159170 0x7fd0d00ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d01426b0 0x7fd0d00988c0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 --2- 172.21.15.6:0/3394546705 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d00b2540 0x7fd0d0145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 >> 172.21.15.6:0/3394546705 conn(0x7fd0d00b4520 msgr2=0x7fd0d006e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 shutdown_connections 2023-11-29T04:17:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:53.681+0000 7fd0d54d6640 1 -- 172.21.15.6:0/3394546705 wait complete. 2023-11-29T04:17:53.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T04:17:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.345+0000 7fc2b61e6640 1 Processor -- start 2023-11-29T04:17:54.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.345+0000 7fc2b61e6640 1 -- start start 2023-11-29T04:17:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.349+0000 7fc2b61e6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00d3860 0x7fc2b00b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2b61e6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc2b00b2ff0 0x7fc2b01600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2b61e6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b00d3cc0 con 0x7fc2b015fcf0 2023-11-29T04:17:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2b61e6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b00d3ef0 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2b61e6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00cf5d0 con 0x7fc2b00d3860 2023-11-29T04:17:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2aeffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00d3860 0x7fc2b00b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2aeffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00d3860 0x7fc2b00b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43244/0 (socket says 172.21.15.6:43244) 2023-11-29T04:17:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2aeffd640 1 -- 172.21.15.6:0/509780533 learned_addr learned my addr 172.21.15.6:0/509780533 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2affff640 1 --2- 172.21.15.6:0/509780533 >> v2:172.21.15.6:3300/0 conn(0x7fc2b00b2ff0 0x7fc2b01600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2aeffd640 1 -- 172.21.15.6:0/509780533 >> v2:172.21.15.6:3300/0 conn(0x7fc2b00b2ff0 msgr2=0x7fc2b01600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:17:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2aeffd640 1 --2- 172.21.15.6:0/509780533 >> v2:172.21.15.6:3300/0 conn(0x7fc2b00b2ff0 0x7fc2b01600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2aeffd640 1 -- 172.21.15.6:0/509780533 >> v1:172.21.15.6:6789/0 conn(0x7fc2b015fcf0 legacy=0x7fc2b00ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:54.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.353+0000 7fc2aeffd640 1 -- 172.21.15.6:0/509780533 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b00cea30 con 0x7fc2b00d3860 2023-11-29T04:17:54.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.357+0000 7fc2aeffd640 1 --2- 172.21.15.6:0/509780533 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00d3860 0x7fc2b00b2ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc298009e50 tx=0x7fc29801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fe0f90a967a6999 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:54.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.357+0000 7fc2ae7fc640 1 -- 172.21.15.6:0/509780533 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980a5730 con 0x7fc2b00d3860 2023-11-29T04:17:54.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.357+0000 7fc2ae7fc640 1 -- 172.21.15.6:0/509780533 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2980a5890 con 0x7fc2b00d3860 2023-11-29T04:17:54.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.357+0000 7fc2ae7fc640 1 -- 172.21.15.6:0/509780533 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980a5c20 con 0x7fc2b00d3860 2023-11-29T04:17:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.361+0000 7fc2b61e6640 1 -- 172.21.15.6:0/509780533 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00d3860 msgr2=0x7fc2b00b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:54.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.361+0000 7fc2b61e6640 1 --2- 172.21.15.6:0/509780533 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00d3860 0x7fc2b00b2ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc298009e50 tx=0x7fc29801c980 comp rx=0 tx=0).stop 2023-11-29T04:17:54.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.361+0000 7fc2b61e6640 1 -- 172.21.15.6:0/509780533 shutdown_connections 2023-11-29T04:17:54.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.361+0000 7fc2b61e6640 1 --2- 172.21.15.6:0/509780533 >> v2:172.21.15.6:3300/0 conn(0x7fc2b00b2ff0 0x7fc2b01600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:54.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.361+0000 7fc2b61e6640 1 --2- 172.21.15.6:0/509780533 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00d3860 0x7fc2b00b2ab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:54.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.361+0000 7fc2b61e6640 1 -- 172.21.15.6:0/509780533 >> 172.21.15.6:0/509780533 conn(0x7fc2b009c480 msgr2=0x7fc2b00d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:54.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.361+0000 7fc2b61e6640 1 -- 172.21.15.6:0/509780533 shutdown_connections 2023-11-29T04:17:54.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.365+0000 7fc2b61e6640 1 -- 172.21.15.6:0/509780533 wait complete. 2023-11-29T04:17:54.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.373+0000 7fc2b61e6640 1 Processor -- start 2023-11-29T04:17:54.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.377+0000 7fc2b61e6640 1 -- start start 2023-11-29T04:17:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2b61e6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00b2ff0 0x7fc2b01fa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:54.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2b61e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2b00d3860 0x7fc2b015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:54.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2b61e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2b015fcf0 0x7fc2b015d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2b61e6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00c8110 con 0x7fc2b015fcf0 2023-11-29T04:17:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2b61e6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00b8e80 con 0x7fc2b00d3860 2023-11-29T04:17:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2b61e6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00c8360 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2af7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00b2ff0 0x7fc2b01fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2aeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2b00d3860 0x7fc2b015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2af7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00b2ff0 0x7fc2b01fa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43254/0 (socket says 172.21.15.6:43254) 2023-11-29T04:17:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2aeffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2b00d3860 0x7fc2b015cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:52136/0 (socket says 172.21.15.6:52136) 2023-11-29T04:17:54.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2af7fe640 1 -- 172.21.15.6:0/184195838 learned_addr learned my addr 172.21.15.6:0/184195838 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2affff640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2b015fcf0 0x7fc2b015d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2af7fe640 1 -- 172.21.15.6:0/184195838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2b00d3860 msgr2=0x7fc2b015cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2af7fe640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2b00d3860 0x7fc2b015cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2af7fe640 1 -- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2b015fcf0 msgr2=0x7fc2b015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:54.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2af7fe640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2b015fcf0 0x7fc2b015d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:54.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2af7fe640 1 -- 172.21.15.6:0/184195838 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc298009b30 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.385+0000 7fc2aeffd640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2b00d3860 0x7fc2b015cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-11-29T04:17:54.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.389+0000 7fc2af7fe640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00b2ff0 0x7fc2b01fa250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800c440 tx=0x7fc2a8001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.389+0000 7fc2a7fff640 1 -- 172.21.15.6:0/184195838 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a80052d0 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.389+0000 7fc2a7fff640 1 -- 172.21.15.6:0/184195838 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a8005450 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.389+0000 7fc2a7fff640 1 -- 172.21.15.6:0/184195838 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8003840 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.389+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b00c8640 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.389+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b015d100 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.393+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b00c8af0 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.401+0000 7fc2a7fff640 1 -- 172.21.15.6:0/184195838 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2a80039a0 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.405+0000 7fc2a7fff640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc2940664c0 0x7fc294068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:54.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.405+0000 7fc2a7fff640 1 -- 172.21.15.6:0/184195838 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2a8083320 con 0x7fc2b00b2ff0 2023-11-29T04:17:54.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.405+0000 7fc2aeffd640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc2940664c0 0x7fc294068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:54.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.405+0000 7fc2aeffd640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc2940664c0 0x7fc294068980 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc2980ae000 tx=0x7fc2980a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:54.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:54.409+0000 7fc2a7fff640 1 -- 172.21.15.6:0/184195838 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2a8050940 con 0x7fc2b00b2ff0 2023-11-29T04:17:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.261+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2b004e930 con 0x7fc2b00b2ff0 2023-11-29T04:17:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.261+0000 7fc2a7fff640 1 -- 172.21.15.6:0/184195838 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2a8017020 con 0x7fc2b00b2ff0 2023-11-29T04:17:55.271 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-11-29T04:17:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc2940664c0 msgr2=0x7fc294068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc2940664c0 0x7fc294068980 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc2980ae000 tx=0x7fc2980a7070 comp rx=0 tx=0).stop 2023-11-29T04:17:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00b2ff0 msgr2=0x7fc2b01fa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:55.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00b2ff0 0x7fc2b01fa250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800c440 tx=0x7fc2a8001e80 comp rx=0 tx=0).stop 2023-11-29T04:17:55.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 shutdown_connections 2023-11-29T04:17:55.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fc2940664c0 0x7fc294068980 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2b015fcf0 0x7fc2b015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2b00d3860 0x7fc2b015cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 --2- 172.21.15.6:0/184195838 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2b00b2ff0 0x7fc2b01fa250 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.273+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 >> 172.21.15.6:0/184195838 conn(0x7fc2b009c480 msgr2=0x7fc2b00ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:55.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.277+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 shutdown_connections 2023-11-29T04:17:55.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.277+0000 7fc2b61e6640 1 -- 172.21.15.6:0/184195838 wait complete. 2023-11-29T04:17:55.313 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T04:17:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.549+0000 7f651a396640 1 Processor -- start 2023-11-29T04:17:55.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.549+0000 7f651a396640 1 -- start start 2023-11-29T04:17:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f651a396640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6514158770 0x7f65140ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f651a396640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f65141657f0 0x7f6514161af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f651a396640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651406ac70 con 0x7f651406d610 2023-11-29T04:17:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f651a396640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651406daf0 con 0x7f6514158770 2023-11-29T04:17:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f651a396640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651406ddd0 con 0x7f65141657f0 2023-11-29T04:17:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f6513fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6514158770 0x7f65140ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f6513fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6514158770 0x7f65140ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34710/0 (socket says 172.21.15.6:34710) 2023-11-29T04:17:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f6513fff640 1 -- 172.21.15.6:0/401360886 learned_addr learned my addr 172.21.15.6:0/401360886 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f65137fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f651406d610 0x7f65141650e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:50270/0 (socket says 172.21.15.6:50270) 2023-11-29T04:17:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f6513fff640 1 -- 172.21.15.6:0/401360886 >> v2:172.21.15.31:3300/0 conn(0x7f65141657f0 msgr2=0x7f6514161af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T04:17:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f6513fff640 1 --2- 172.21.15.6:0/401360886 >> v2:172.21.15.31:3300/0 conn(0x7f65141657f0 0x7f6514161af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f6513fff640 1 -- 172.21.15.6:0/401360886 >> v1:172.21.15.31:6789/0 conn(0x7f651406d610 legacy=0x7f65141650e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.553+0000 7f6513fff640 1 -- 172.21.15.6:0/401360886 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651406a620 con 0x7f6514158770 2023-11-29T04:17:55.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f6513fff640 1 --2- 172.21.15.6:0/401360886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6514158770 0x7f65140ae750 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f6514071d20 tx=0x7f650801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e68716e3c9678 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f6512ffd640 1 -- 172.21.15.6:0/401360886 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080aa670 con 0x7f6514158770 2023-11-29T04:17:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f6512ffd640 1 -- 172.21.15.6:0/401360886 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65080aa7d0 con 0x7f6514158770 2023-11-29T04:17:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f6512ffd640 1 -- 172.21.15.6:0/401360886 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080aab60 con 0x7f6514158770 2023-11-29T04:17:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f651a396640 1 -- 172.21.15.6:0/401360886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6514158770 msgr2=0x7f65140ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f651a396640 1 --2- 172.21.15.6:0/401360886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6514158770 0x7f65140ae750 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f6514071d20 tx=0x7f650801c4f0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f651a396640 1 -- 172.21.15.6:0/401360886 shutdown_connections 2023-11-29T04:17:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f651a396640 1 --2- 172.21.15.6:0/401360886 >> v2:172.21.15.31:3300/0 conn(0x7f65141657f0 0x7f6514161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f651a396640 1 --2- 172.21.15.6:0/401360886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6514158770 0x7f65140ae750 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f651a396640 1 -- 172.21.15.6:0/401360886 >> 172.21.15.6:0/401360886 conn(0x7f65140cf7b0 msgr2=0x7f65140cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f651a396640 1 -- 172.21.15.6:0/401360886 shutdown_connections 2023-11-29T04:17:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.565+0000 7f651a396640 1 -- 172.21.15.6:0/401360886 wait complete. 2023-11-29T04:17:55.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f651a396640 1 Processor -- start 2023-11-29T04:17:55.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f651a396640 1 -- start start 2023-11-29T04:17:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f651a396640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651406d610 0x7f651416be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f651a396640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6514158770 0x7f65140ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f651a396640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65141657f0 0x7f6514152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f651a396640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65140cdf00 con 0x7f651406d610 2023-11-29T04:17:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f651a396640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6514153810 con 0x7f6514158770 2023-11-29T04:17:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f651a396640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6514152fa0 con 0x7f65141657f0 2023-11-29T04:17:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f65137fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6514158770 0x7f65140ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f6518933640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65141657f0 0x7f6514152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f65137fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6514158770 0x7f65140ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:52144/0 (socket says 172.21.15.6:52144) 2023-11-29T04:17:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.569+0000 7f65137fe640 1 -- 172.21.15.6:0/2300606446 learned_addr learned my addr 172.21.15.6:0/2300606446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f65137fe640 1 -- 172.21.15.6:0/2300606446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65141657f0 msgr2=0x7f6514152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f65137fe640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65141657f0 0x7f6514152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f65137fe640 1 -- 172.21.15.6:0/2300606446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651406d610 msgr2=0x7f651416be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f65137fe640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651406d610 0x7f651416be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f65137fe640 1 -- 172.21.15.6:0/2300606446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080094d0 con 0x7f6514158770 2023-11-29T04:17:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f65137fe640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6514158770 0x7f65140ce390 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f650000c490 tx=0x7f650000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f6510ff9640 1 -- 172.21.15.6:0/2300606446 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500007480 con 0x7f6514158770 2023-11-29T04:17:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f6510ff9640 1 -- 172.21.15.6:0/2300606446 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65000075e0 con 0x7f6514158770 2023-11-29T04:17:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f6510ff9640 1 -- 172.21.15.6:0/2300606446 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500004a10 con 0x7f6514158770 2023-11-29T04:17:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6514153250 con 0x7f6514158770 2023-11-29T04:17:55.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.573+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65140cdb90 con 0x7f6514158770 2023-11-29T04:17:55.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.577+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f4005260 con 0x7f6514158770 2023-11-29T04:17:55.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.585+0000 7f6510ff9640 1 -- 172.21.15.6:0/2300606446 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6500004b70 con 0x7f6514158770 2023-11-29T04:17:55.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.589+0000 7f6510ff9640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64f80664f0 0x7f64f80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.589+0000 7f6510ff9640 1 -- 172.21.15.6:0/2300606446 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65000832a0 con 0x7f6514158770 2023-11-29T04:17:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.593+0000 7f6513fff640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64f80664f0 0x7f64f80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.597+0000 7f6510ff9640 1 -- 172.21.15.6:0/2300606446 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6500050890 con 0x7f6514158770 2023-11-29T04:17:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.597+0000 7f6513fff640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64f80664f0 0x7f64f80689b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f65080ae000 tx=0x7f6508008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.909+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64f4005510 con 0x7f6514158770 2023-11-29T04:17:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.917+0000 7f6510ff9640 1 -- 172.21.15.6:0/2300606446 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4901 (secure 0 0 0) 0x7f6500018090 con 0x7f6514158770 2023-11-29T04:17:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:55.927 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1525667557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1525667557},{"type":"v1","addr":"172.21.15.31:6834","nonce":1525667557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/71303197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":71303197},{"type":"v1","addr":"172.21.15.31:6835","nonce":71303197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/4130466882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":4130466882},{"type":"v1","addr":"172.21.15.6:6837","nonce":4130466882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:09:13.024455+0000","modified":"2023-11-28T21:09:16.059795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5190":{"gid":5190,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2805255705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2805255705},{"type":"v1","addr":"172.21.15.6:6835","nonce":2805255705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T04:17:55.928 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-11-29T04:17:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64f80664f0 msgr2=0x7f64f80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64f80664f0 0x7f64f80689b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f65080ae000 tx=0x7f6508008040 comp rx=0 tx=0).stop 2023-11-29T04:17:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6514158770 msgr2=0x7f65140ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6514158770 0x7f65140ce390 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f650000c490 tx=0x7f650000c950 comp rx=0 tx=0).stop 2023-11-29T04:17:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 shutdown_connections 2023-11-29T04:17:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f64f80664f0 0x7f64f80689b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f65141657f0 0x7f6514152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6514158770 0x7f65140ce390 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 --2- 172.21.15.6:0/2300606446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651406d610 0x7f651416be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.929+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 >> 172.21.15.6:0/2300606446 conn(0x7f65140cf7b0 msgr2=0x7f65140b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.933+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 shutdown_connections 2023-11-29T04:17:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:55.933+0000 7f651a396640 1 -- 172.21.15.6:0/2300606446 wait complete. 2023-11-29T04:17:56.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T04:17:56.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.541+0000 7fb92bdf8640 1 Processor -- start 2023-11-29T04:17:56.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.541+0000 7fb92bdf8640 1 -- start start 2023-11-29T04:17:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.541+0000 7fb92bdf8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb9240ae0c0 0x7fb92415e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.541+0000 7fb92bdf8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92415e7b0 con 0x7fb9240ae4a0 2023-11-29T04:17:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.541+0000 7fb92bdf8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb924071af0 con 0x7fb924072650 2023-11-29T04:17:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.541+0000 7fb92bdf8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb924070a50 con 0x7fb9240ae0c0 2023-11-29T04:17:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.545+0000 7fb92a395640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb924072650 0x7fb924156fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:50282/0 (socket says 172.21.15.6:50282) 2023-11-29T04:17:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.545+0000 7fb92a395640 1 -- 172.21.15.6:0/461490008 learned_addr learned my addr 172.21.15.6:0/461490008 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:17:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.545+0000 7fb929b94640 1 --2- 172.21.15.6:0/461490008 >> v2:172.21.15.6:3300/0 conn(0x7fb9240ae0c0 0x7fb92415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.545+0000 7fb929b94640 1 -- 172.21.15.6:0/461490008 >> v1:172.21.15.31:6789/0 conn(0x7fb924072650 legacy=0x7fb924156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:17:56.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.545+0000 7fb929b94640 1 -- 172.21.15.6:0/461490008 >> v1:172.21.15.6:6789/0 conn(0x7fb9240ae4a0 legacy=0x7fb924071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:17:56.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.545+0000 7fb929b94640 1 -- 172.21.15.6:0/461490008 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924070d30 con 0x7fb9240ae0c0 2023-11-29T04:17:56.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.549+0000 7fb929b94640 1 --2- 172.21.15.6:0/461490008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae0c0 0x7fb92415e270 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097c0 tx=0x7fb91801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299ae99acc524422 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:56.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.549+0000 7fb928b92640 1 -- 172.21.15.6:0/461490008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180ac630 con 0x7fb9240ae0c0 2023-11-29T04:17:56.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.549+0000 7fb928b92640 1 -- 172.21.15.6:0/461490008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9180ac790 con 0x7fb9240ae0c0 2023-11-29T04:17:56.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.549+0000 7fb928b92640 1 -- 172.21.15.6:0/461490008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180acb20 con 0x7fb9240ae0c0 2023-11-29T04:17:56.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.549+0000 7fb92bdf8640 1 -- 172.21.15.6:0/461490008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae0c0 msgr2=0x7fb92415e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:56.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.549+0000 7fb92bdf8640 1 --2- 172.21.15.6:0/461490008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae0c0 0x7fb92415e270 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097c0 tx=0x7fb91801c3d0 comp rx=0 tx=0).stop 2023-11-29T04:17:56.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.553+0000 7fb92bdf8640 1 -- 172.21.15.6:0/461490008 shutdown_connections 2023-11-29T04:17:56.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.553+0000 7fb92bdf8640 1 --2- 172.21.15.6:0/461490008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae0c0 0x7fb92415e270 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:56.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.553+0000 7fb92bdf8640 1 -- 172.21.15.6:0/461490008 >> 172.21.15.6:0/461490008 conn(0x7fb92406a750 msgr2=0x7fb92406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:56.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.557+0000 7fb92bdf8640 1 -- 172.21.15.6:0/461490008 shutdown_connections 2023-11-29T04:17:56.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.557+0000 7fb92bdf8640 1 -- 172.21.15.6:0/461490008 wait complete. 2023-11-29T04:17:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.561+0000 7fb92bdf8640 1 Processor -- start 2023-11-29T04:17:56.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.565+0000 7fb92bdf8640 1 -- start start 2023-11-29T04:17:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb92bdf8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb924072650 0x7fb92415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb92bdf8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9240ae0c0 0x7fb9240a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb92bdf8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae4a0 0x7fb9240a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb929b94640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb924072650 0x7fb92415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb929393640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9240ae0c0 0x7fb9240a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb929b94640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb924072650 0x7fb92415a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:52150/0 (socket says 172.21.15.6:52150) 2023-11-29T04:17:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb929393640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9240ae0c0 0x7fb9240a83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43266/0 (socket says 172.21.15.6:43266) 2023-11-29T04:17:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb92a395640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae4a0 0x7fb9240a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb92a395640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae4a0 0x7fb9240a8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34722/0 (socket says 172.21.15.6:34722) 2023-11-29T04:17:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb92bdf8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924168bb0 con 0x7fb9240ae4a0 2023-11-29T04:17:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb92bdf8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92406db10 con 0x7fb924072650 2023-11-29T04:17:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb92bdf8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9241688d0 con 0x7fb9240ae0c0 2023-11-29T04:17:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.569+0000 7fb929b94640 1 -- 172.21.15.6:0/825021479 learned_addr learned my addr 172.21.15.6:0/825021479 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:56.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb929393640 1 -- 172.21.15.6:0/825021479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb924072650 msgr2=0x7fb92415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:56.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb929393640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb924072650 0x7fb92415a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb929393640 1 -- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae4a0 msgr2=0x7fb9240a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb929393640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae4a0 0x7fb9240a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb929393640 1 -- 172.21.15.6:0/825021479 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918009420 con 0x7fb9240ae0c0 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb929b94640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb924072650 0x7fb92415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb92a395640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae4a0 0x7fb9240a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb929393640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9240ae0c0 0x7fb9240a83e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb92000b410 tx=0x7fb92000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb9167fc640 1 -- 172.21.15.6:0/825021479 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920004020 con 0x7fb9240ae0c0 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb9167fc640 1 -- 172.21.15.6:0/825021479 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb920004180 con 0x7fb9240ae0c0 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb9167fc640 1 -- 172.21.15.6:0/825021479 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920011630 con 0x7fb9240ae0c0 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.573+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9240af660 con 0x7fb9240ae0c0 2023-11-29T04:17:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.577+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92415a850 con 0x7fb9240ae0c0 2023-11-29T04:17:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.577+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb924068870 con 0x7fb9240ae0c0 2023-11-29T04:17:56.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.581+0000 7fb9167fc640 1 -- 172.21.15.6:0/825021479 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb920011790 con 0x7fb9240ae0c0 2023-11-29T04:17:56.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.585+0000 7fb9167fc640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb908066470 0x7fb908068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.585+0000 7fb9167fc640 1 -- 172.21.15.6:0/825021479 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb920055290 con 0x7fb9240ae0c0 2023-11-29T04:17:56.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.585+0000 7fb929b94640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb908066470 0x7fb908068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:56.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.589+0000 7fb929b94640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb908066470 0x7fb908068930 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097c0 tx=0x7fb918008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:56.593+0000 7fb9167fc640 1 -- 172.21.15.6:0/825021479 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb920015020 con 0x7fb9240ae0c0 2023-11-29T04:17:57.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.433+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9240afb10 con 0x7fb9240ae0c0 2023-11-29T04:17:57.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.437+0000 7fb9167fc640 1 -- 172.21.15.6:0/825021479 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16461 (secure 0 0 0) 0x7fb9240afb10 con 0x7fb9240ae0c0 2023-11-29T04:17:57.441 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:57.441 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:09:14.652293+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:09:10.815928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T21:09:12.024583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T04:17:57.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb908066470 msgr2=0x7fb908068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:57.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb908066470 0x7fb908068930 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097c0 tx=0x7fb918008040 comp rx=0 tx=0).stop 2023-11-29T04:17:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9240ae0c0 msgr2=0x7fb9240a83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9240ae0c0 0x7fb9240a83e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb92000b410 tx=0x7fb92000b8d0 comp rx=0 tx=0).stop 2023-11-29T04:17:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 shutdown_connections 2023-11-29T04:17:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb908066470 0x7fb908068930 secure :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097c0 tx=0x7fb918008040 comp rx=0 tx=0).stop 2023-11-29T04:17:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9240ae4a0 0x7fb9240a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9240ae0c0 0x7fb9240a83e0 secure :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb92000b410 tx=0x7fb92000b8d0 comp rx=0 tx=0).stop 2023-11-29T04:17:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 --2- 172.21.15.6:0/825021479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb924072650 0x7fb92415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.441+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 >> 172.21.15.6:0/825021479 conn(0x7fb92406a750 msgr2=0x7fb924161630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.445+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 shutdown_connections 2023-11-29T04:17:57.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:57.445+0000 7fb92bdf8640 1 -- 172.21.15.6:0/825021479 wait complete. 2023-11-29T04:17:57.526 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T04:17:57.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T04:17:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.161+0000 7f856597d640 1 Processor -- start 2023-11-29T04:17:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.161+0000 7f856597d640 1 -- start start 2023-11-29T04:17:58.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.165+0000 7f856597d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:58.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.165+0000 7f856597d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f85600ac9e0 0x7f85600702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856497b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856597d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8560070ff0 con 0x7f85600cf740 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856497b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600ac4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43280/0 (socket says 172.21.15.6:43280) 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856597d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8560071c70 con 0x7f85600ac9e0 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856497b640 1 -- 172.21.15.6:0/930007072 learned_addr learned my addr 172.21.15.6:0/930007072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856597d640 1 -- 172.21.15.6:0/930007072 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85600ace60 con 0x7f85600ce200 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856497b640 1 -- 172.21.15.6:0/930007072 >> v2:172.21.15.31:3300/0 conn(0x7f85600ac9e0 msgr2=0x7f85600702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f855ffff640 1 --2- 172.21.15.6:0/930007072 >> v2:172.21.15.31:3300/0 conn(0x7f85600ac9e0 0x7f85600702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856497b640 1 --2- 172.21.15.6:0/930007072 >> v2:172.21.15.31:3300/0 conn(0x7f85600ac9e0 0x7f85600702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856497b640 1 -- 172.21.15.6:0/930007072 >> v1:172.21.15.6:6789/0 conn(0x7f85600cf740 legacy=0x7f8560070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:17:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f856497b640 1 -- 172.21.15.6:0/930007072 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600712d0 con 0x7f85600ce200 2023-11-29T04:17:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.169+0000 7f855ffff640 1 --2- 172.21.15.6:0/930007072 >> v2:172.21.15.31:3300/0 conn(0x7f85600ac9e0 0x7f85600702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T04:17:58.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.173+0000 7f856497b640 1 --2- 172.21.15.6:0/930007072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600ac4a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8550009870 tx=0x7f855001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc209fbad32e4f57 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:58.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.173+0000 7f855f7fe640 1 -- 172.21.15.6:0/930007072 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85500aa5f0 con 0x7f85600ce200 2023-11-29T04:17:58.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.173+0000 7f855f7fe640 1 -- 172.21.15.6:0/930007072 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85500aa750 con 0x7f85600ce200 2023-11-29T04:17:58.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.173+0000 7f855f7fe640 1 -- 172.21.15.6:0/930007072 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85500aaae0 con 0x7f85600ce200 2023-11-29T04:17:58.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.177+0000 7f856597d640 1 -- 172.21.15.6:0/930007072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 msgr2=0x7f85600ac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:58.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.177+0000 7f856597d640 1 --2- 172.21.15.6:0/930007072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600ac4a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8550009870 tx=0x7f855001c4f0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.177+0000 7f856597d640 1 -- 172.21.15.6:0/930007072 shutdown_connections 2023-11-29T04:17:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.177+0000 7f856597d640 1 --2- 172.21.15.6:0/930007072 >> v2:172.21.15.31:3300/0 conn(0x7f85600ac9e0 0x7f85600702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.177+0000 7f856597d640 1 --2- 172.21.15.6:0/930007072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600ac4a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.177+0000 7f856597d640 1 -- 172.21.15.6:0/930007072 >> 172.21.15.6:0/930007072 conn(0x7f85600cec20 msgr2=0x7f85600cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.181+0000 7f856597d640 1 -- 172.21.15.6:0/930007072 shutdown_connections 2023-11-29T04:17:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.181+0000 7f856597d640 1 -- 172.21.15.6:0/930007072 wait complete. 2023-11-29T04:17:58.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.181+0000 7f856597d640 1 Processor -- start 2023-11-29T04:17:58.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.181+0000 7f856597d640 1 -- start start 2023-11-29T04:17:58.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f856597d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85600ac9e0 0x7f8560145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:58.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f856597d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:58.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f856597d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85600cf740 0x7f856015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:58.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f856597d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600cd170 con 0x7f85600ac9e0 2023-11-29T04:17:58.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f856597d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856006d440 con 0x7f85600cf740 2023-11-29T04:17:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f856597d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856006d720 con 0x7f85600ce200 2023-11-29T04:17:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f855ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f855ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:43284/0 (socket says 172.21.15.6:43284) 2023-11-29T04:17:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f855ffff640 1 -- 172.21.15.6:0/3570794456 learned_addr learned my addr 172.21.15.6:0/3570794456 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f856517c640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85600cf740 0x7f856015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f856497b640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85600ac9e0 0x7f8560145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f855ffff640 1 -- 172.21.15.6:0/3570794456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85600cf740 msgr2=0x7f856015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f855ffff640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85600cf740 0x7f856015b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f855ffff640 1 -- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85600ac9e0 msgr2=0x7f8560145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.185+0000 7f855ffff640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85600ac9e0 0x7f8560145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.189+0000 7f855ffff640 1 -- 172.21.15.6:0/3570794456 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500094d0 con 0x7f85600ce200 2023-11-29T04:17:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.189+0000 7f855ffff640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600cc890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f855400c7c0 tx=0x7f855400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.189+0000 7f855d7fa640 1 -- 172.21.15.6:0/3570794456 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554007a30 con 0x7f85600ce200 2023-11-29T04:17:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.189+0000 7f855d7fa640 1 -- 172.21.15.6:0/3570794456 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8554007b90 con 0x7f85600ce200 2023-11-29T04:17:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.189+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856006da00 con 0x7f85600ce200 2023-11-29T04:17:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.189+0000 7f855d7fa640 1 -- 172.21.15.6:0/3570794456 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400ce70 con 0x7f85600ce200 2023-11-29T04:17:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.189+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85601464b0 con 0x7f85600ce200 2023-11-29T04:17:58.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.193+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856009d030 con 0x7f85600ce200 2023-11-29T04:17:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.201+0000 7f855d7fa640 1 -- 172.21.15.6:0/3570794456 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f85540113f0 con 0x7f85600ce200 2023-11-29T04:17:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.201+0000 7f855d7fa640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f854c0664c0 0x7f854c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.205+0000 7f855d7fa640 1 -- 172.21.15.6:0/3570794456 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85540841a0 con 0x7f85600ce200 2023-11-29T04:17:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.205+0000 7f856497b640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f854c0664c0 0x7f854c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.209+0000 7f856497b640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f854c0664c0 0x7f854c068980 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f85500ae000 tx=0x7f85500a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.213+0000 7f855d7fa640 1 -- 172.21.15.6:0/3570794456 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8554051790 con 0x7f85600ce200 2023-11-29T04:17:58.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.545+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f856004e930 con 0x7f85600ce200 2023-11-29T04:17:58.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.545+0000 7f855d7fa640 1 -- 172.21.15.6:0/3570794456 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4901 (secure 0 0 0) 0x7f8554054db0 con 0x7f85600ce200 2023-11-29T04:17:58.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:17:58.551 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1525667557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1525667557},{"type":"v1","addr":"172.21.15.31:6834","nonce":1525667557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/71303197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":71303197},{"type":"v1","addr":"172.21.15.31:6835","nonce":71303197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/4130466882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":4130466882},{"type":"v1","addr":"172.21.15.6:6837","nonce":4130466882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:09:13.024455+0000","modified":"2023-11-28T21:09:16.059795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5190":{"gid":5190,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2805255705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2805255705},{"type":"v1","addr":"172.21.15.6:6835","nonce":2805255705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T04:17:58.551 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-11-29T04:17:58.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f854c0664c0 msgr2=0x7f854c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:58.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f854c0664c0 0x7f854c068980 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f85500ae000 tx=0x7f85500a7000 comp rx=0 tx=0).stop 2023-11-29T04:17:58.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 msgr2=0x7f85600cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:58.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600cc890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f855400c7c0 tx=0x7f855400cc80 comp rx=0 tx=0).stop 2023-11-29T04:17:58.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 shutdown_connections 2023-11-29T04:17:58.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f854c0664c0 0x7f854c068980 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85600cf740 0x7f856015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85600ce200 0x7f85600cc890 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 --2- 172.21.15.6:0/3570794456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85600ac9e0 0x7f8560145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:58.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 >> 172.21.15.6:0/3570794456 conn(0x7f85600cec20 msgr2=0x7f85600b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:58.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 shutdown_connections 2023-11-29T04:17:58.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:58.549+0000 7f856597d640 1 -- 172.21.15.6:0/3570794456 wait complete. 2023-11-29T04:17:58.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T04:17:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.109+0000 7f49628c8640 1 Processor -- start 2023-11-29T04:17:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.109+0000 7f49628c8640 1 -- start start 2023-11-29T04:17:59.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.113+0000 7f49628c8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f495c0b2310 0x7f495c162360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:59.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.113+0000 7f49628c8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c06a980 0x7f495c06ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:59.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49618c6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f495c0b2310 0x7f495c162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:59.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49618c6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f495c0b2310 0x7f495c162360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:47368/0 (socket says 172.21.15.6:47368) 2023-11-29T04:17:59.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49610c5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f495c0b3c90 0x7f495c164fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:35312/0 (socket says 172.21.15.6:35312) 2023-11-29T04:17:59.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49618c6640 1 -- 172.21.15.6:0/3756477290 learned_addr learned my addr 172.21.15.6:0/3756477290 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:59.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49628c8640 1 -- 172.21.15.6:0/3756477290 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495c165e70 con 0x7f495c0b3c90 2023-11-29T04:17:59.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49628c8640 1 -- 172.21.15.6:0/3756477290 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495c161f40 con 0x7f495c0b2310 2023-11-29T04:17:59.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49628c8640 1 -- 172.21.15.6:0/3756477290 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495c06b370 con 0x7f495c06a980 2023-11-29T04:17:59.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49620c7640 1 --2- 172.21.15.6:0/3756477290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c06a980 0x7f495c06ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49608c4640 1 -- 172.21.15.6:0/3756477290 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371205998 0 0) 0x7f495c165e70 con 0x7f495c0b3c90 2023-11-29T04:17:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49608c4640 1 -- 172.21.15.6:0/3756477290 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4948003530 con 0x7f495c0b3c90 2023-11-29T04:17:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49618c6640 1 -- 172.21.15.6:0/3756477290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c06a980 msgr2=0x7f495c06ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:17:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49618c6640 1 --2- 172.21.15.6:0/3756477290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c06a980 0x7f495c06ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49618c6640 1 -- 172.21.15.6:0/3756477290 >> v1:172.21.15.31:6789/0 conn(0x7f495c0b3c90 legacy=0x7f495c164fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49618c6640 1 -- 172.21.15.6:0/3756477290 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c0b26f0 con 0x7f495c0b2310 2023-11-29T04:17:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.117+0000 7f49620c7640 1 --2- 172.21.15.6:0/3756477290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c06a980 0x7f495c06ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T04:17:59.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.125+0000 7f49618c6640 1 --2- 172.21.15.6:0/3756477290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c0b2310 0x7f495c162360 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f4958009e50 tx=0x7f495801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bff32b856b92b72c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:59.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.125+0000 7f49608c4640 1 -- 172.21.15.6:0/3756477290 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580a57d0 con 0x7f495c0b2310 2023-11-29T04:17:59.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.125+0000 7f49608c4640 1 -- 172.21.15.6:0/3756477290 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49580a5930 con 0x7f495c0b2310 2023-11-29T04:17:59.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.125+0000 7f49608c4640 1 -- 172.21.15.6:0/3756477290 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580a5cc0 con 0x7f495c0b2310 2023-11-29T04:17:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.129+0000 7f49628c8640 1 -- 172.21.15.6:0/3756477290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c0b2310 msgr2=0x7f495c162360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.129+0000 7f49628c8640 1 --2- 172.21.15.6:0/3756477290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c0b2310 0x7f495c162360 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f4958009e50 tx=0x7f495801ca10 comp rx=0 tx=0).stop 2023-11-29T04:17:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.133+0000 7f49628c8640 1 -- 172.21.15.6:0/3756477290 shutdown_connections 2023-11-29T04:17:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.133+0000 7f49628c8640 1 --2- 172.21.15.6:0/3756477290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c06a980 0x7f495c06ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.133+0000 7f49628c8640 1 --2- 172.21.15.6:0/3756477290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c0b2310 0x7f495c162360 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.133+0000 7f49628c8640 1 -- 172.21.15.6:0/3756477290 >> 172.21.15.6:0/3756477290 conn(0x7f495c0b0cd0 msgr2=0x7f495c0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:17:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.137+0000 7f49628c8640 1 -- 172.21.15.6:0/3756477290 shutdown_connections 2023-11-29T04:17:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.137+0000 7f49628c8640 1 -- 172.21.15.6:0/3756477290 wait complete. 2023-11-29T04:17:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.137+0000 7f49628c8640 1 Processor -- start 2023-11-29T04:17:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.137+0000 7f49628c8640 1 -- start start 2023-11-29T04:17:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49628c8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c06a980 0x7f495c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49628c8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c0b2310 0x7f495c099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49628c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0b3c90 0x7f495c0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49628c8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c150100 con 0x7f495c0b3c90 2023-11-29T04:17:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49628c8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c1503e0 con 0x7f495c06a980 2023-11-29T04:17:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49628c8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495c09b7e0 con 0x7f495c0b2310 2023-11-29T04:17:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49618c6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c06a980 0x7f495c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49618c6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c06a980 0x7f495c0cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:47380/0 (socket says 172.21.15.6:47380) 2023-11-29T04:17:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49618c6640 1 -- 172.21.15.6:0/3639330745 learned_addr learned my addr 172.21.15.6:0/3639330745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:17:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49610c5640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c0b2310 0x7f495c099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49620c7640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0b3c90 0x7f495c0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49618c6640 1 -- 172.21.15.6:0/3639330745 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c0b2310 msgr2=0x7f495c099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49618c6640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c0b2310 0x7f495c099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49618c6640 1 -- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0b3c90 msgr2=0x7f495c0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:17:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49618c6640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0b3c90 0x7f495c0cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:17:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49618c6640 1 -- 172.21.15.6:0/3639330745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958009b30 con 0x7f495c06a980 2023-11-29T04:17:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49610c5640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c0b2310 0x7f495c099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:17:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.141+0000 7f49620c7640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0b3c90 0x7f495c0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T04:17:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.145+0000 7f49618c6640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c06a980 0x7f495c0cdab0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f495801a640 tx=0x7f49580197b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.145+0000 7f49527fc640 1 -- 172.21.15.6:0/3639330745 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580b8670 con 0x7f495c06a980 2023-11-29T04:17:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.145+0000 7f49527fc640 1 -- 172.21.15.6:0/3639330745 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49580b87d0 con 0x7f495c06a980 2023-11-29T04:17:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.145+0000 7f49527fc640 1 -- 172.21.15.6:0/3639330745 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580b8b80 con 0x7f495c06a980 2023-11-29T04:17:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.145+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495c09bac0 con 0x7f495c06a980 2023-11-29T04:17:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.145+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495c099ec0 con 0x7f495c06a980 2023-11-29T04:17:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.149+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495c16c120 con 0x7f495c06a980 2023-11-29T04:17:59.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.153+0000 7f49527fc640 1 -- 172.21.15.6:0/3639330745 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f49580b8ce0 con 0x7f495c06a980 2023-11-29T04:17:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.157+0000 7f49527fc640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49400664c0 0x7f4940068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:17:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.157+0000 7f49527fc640 1 -- 172.21.15.6:0/3639330745 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f495811f400 con 0x7f495c06a980 2023-11-29T04:17:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.157+0000 7f49610c5640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49400664c0 0x7f4940068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:17:59.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.161+0000 7f49610c5640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49400664c0 0x7f4940068980 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f495c0cb390 tx=0x7f494c007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:17:59.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:17:59.161+0000 7f49527fc640 1 -- 172.21.15.6:0/3639330745 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49580eca10 con 0x7f495c06a980 2023-11-29T04:18:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.233+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f495c150520 con 0x7f495c06a980 2023-11-29T04:18:00.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.233+0000 7f49527fc640 1 -- 172.21.15.6:0/3639330745 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4901 (secure 0 0 0) 0x7f495c150520 con 0x7f495c06a980 2023-11-29T04:18:00.237 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:18:00.238 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1525667557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1525667557},{"type":"v1","addr":"172.21.15.31:6834","nonce":1525667557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/71303197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":71303197},{"type":"v1","addr":"172.21.15.31:6835","nonce":71303197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/4130466882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":4130466882},{"type":"v1","addr":"172.21.15.6:6837","nonce":4130466882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T21:09:13.024455+0000","modified":"2023-11-28T21:09:16.059795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5190":{"gid":5190,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2805255705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2805255705},{"type":"v1","addr":"172.21.15.6:6835","nonce":2805255705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T04:18:00.238 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-11-29T04:18:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49400664c0 msgr2=0x7f4940068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49400664c0 0x7f4940068980 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f495c0cb390 tx=0x7f494c007d40 comp rx=0 tx=0).stop 2023-11-29T04:18:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c06a980 msgr2=0x7f495c0cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:00.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c06a980 0x7f495c0cdab0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f495801a640 tx=0x7f49580197b0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 shutdown_connections 2023-11-29T04:18:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49400664c0 0x7f4940068980 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0b3c90 0x7f495c0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f495c0b2310 0x7f495c099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 --2- 172.21.15.6:0/3639330745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f495c06a980 0x7f495c0cdab0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.237+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 >> 172.21.15.6:0/3639330745 conn(0x7f495c0b0cd0 msgr2=0x7f495c0afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.245+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 shutdown_connections 2023-11-29T04:18:00.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.245+0000 7f49628c8640 1 -- 172.21.15.6:0/3639330745 wait complete. 2023-11-29T04:18:00.334 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T04:18:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.589+0000 7fd425cbb640 1 Processor -- start 2023-11-29T04:18:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.589+0000 7fd425cbb640 1 -- start start 2023-11-29T04:18:00.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd425cbb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd42015f230 0x7fd4200b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:00.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd425cbb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd420162890 0x7fd4200705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:00.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd425cbb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4200b32c0 con 0x7fd420070b20 2023-11-29T04:18:00.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd425cbb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42006d580 con 0x7fd420162890 2023-11-29T04:18:00.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd425cbb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd420070f90 con 0x7fd42015f230 2023-11-29T04:18:00.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd41effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd420162890 0x7fd4200705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:00.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd41effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd420162890 0x7fd4200705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58038/0 (socket says 172.21.15.6:58038) 2023-11-29T04:18:00.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd41effd640 1 -- 172.21.15.6:0/2838663667 learned_addr learned my addr 172.21.15.6:0/2838663667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:00.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd41f7fe640 1 --2- 172.21.15.6:0/2838663667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd42015f230 0x7fd4200b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:00.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd41f7fe640 1 -- 172.21.15.6:0/2838663667 >> v2:172.21.15.6:3300/0 conn(0x7fd420162890 msgr2=0x7fd4200705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:00.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd41f7fe640 1 --2- 172.21.15.6:0/2838663667 >> v2:172.21.15.6:3300/0 conn(0x7fd420162890 0x7fd4200705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd41f7fe640 1 -- 172.21.15.6:0/2838663667 >> v1:172.21.15.6:6789/0 conn(0x7fd420070b20 legacy=0x7fd4201651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:00.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd41f7fe640 1 -- 172.21.15.6:0/2838663667 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42015f610 con 0x7fd42015f230 2023-11-29T04:18:00.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.597+0000 7fd41effd640 1 --2- 172.21.15.6:0/2838663667 >> v2:172.21.15.6:3300/0 conn(0x7fd420162890 0x7fd4200705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T04:18:00.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.601+0000 7fd41f7fe640 1 --2- 172.21.15.6:0/2838663667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd42015f230 0x7fd4200b1d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd42006d6c0 tx=0x7fd41001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55abb0fd9f344040 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:00.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.601+0000 7fd41e7fc640 1 -- 172.21.15.6:0/2838663667 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100a4ea0 con 0x7fd42015f230 2023-11-29T04:18:00.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd41e7fc640 1 -- 172.21.15.6:0/2838663667 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4100a7050 con 0x7fd42015f230 2023-11-29T04:18:00.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd41e7fc640 1 -- 172.21.15.6:0/2838663667 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100ab820 con 0x7fd42015f230 2023-11-29T04:18:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd425cbb640 1 -- 172.21.15.6:0/2838663667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd42015f230 msgr2=0x7fd4200b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd425cbb640 1 --2- 172.21.15.6:0/2838663667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd42015f230 0x7fd4200b1d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd42006d6c0 tx=0x7fd41001c440 comp rx=0 tx=0).stop 2023-11-29T04:18:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd425cbb640 1 -- 172.21.15.6:0/2838663667 shutdown_connections 2023-11-29T04:18:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd425cbb640 1 --2- 172.21.15.6:0/2838663667 >> v2:172.21.15.6:3300/0 conn(0x7fd420162890 0x7fd4200705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd425cbb640 1 --2- 172.21.15.6:0/2838663667 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd42015f230 0x7fd4200b1d90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd425cbb640 1 -- 172.21.15.6:0/2838663667 >> 172.21.15.6:0/2838663667 conn(0x7fd42006ab80 msgr2=0x7fd4200b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd425cbb640 1 -- 172.21.15.6:0/2838663667 shutdown_connections 2023-11-29T04:18:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.605+0000 7fd425cbb640 1 -- 172.21.15.6:0/2838663667 wait complete. 2023-11-29T04:18:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.613+0000 7fd425cbb640 1 Processor -- start 2023-11-29T04:18:00.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.613+0000 7fd425cbb640 1 -- start start 2023-11-29T04:18:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd425cbb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd420070b20 0x7fd42015b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd425cbb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd42015f230 0x7fd420157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd425cbb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd420162890 0x7fd42015d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd41f7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd420070b20 0x7fd42015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd41f7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd420070b20 0x7fd42015b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:33192/0 (socket says 172.21.15.6:33192) 2023-11-29T04:18:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd41ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd420162890 0x7fd42015d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd425cbb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd420157bb0 con 0x7fd420162890 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd425cbb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42015a210 con 0x7fd42015f230 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd425cbb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42015b070 con 0x7fd420070b20 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd41effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd42015f230 0x7fd420157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd41effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd42015f230 0x7fd420157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:47394/0 (socket says 172.21.15.6:47394) 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.617+0000 7fd41effd640 1 -- 172.21.15.6:0/2948043384 learned_addr learned my addr 172.21.15.6:0/2948043384 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd41ffff640 1 -- 172.21.15.6:0/2948043384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd420070b20 msgr2=0x7fd42015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd41ffff640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd420070b20 0x7fd42015b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd41ffff640 1 -- 172.21.15.6:0/2948043384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd42015f230 msgr2=0x7fd420157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd41ffff640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd42015f230 0x7fd420157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:00.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd41ffff640 1 -- 172.21.15.6:0/2948043384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd410009420 con 0x7fd420162890 2023-11-29T04:18:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd41ffff640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd420162890 0x7fd42015d790 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c780 tx=0x7fd41800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd41f7fe640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd420070b20 0x7fd42015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-11-29T04:18:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd407fff640 1 -- 172.21.15.6:0/2948043384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418003d90 con 0x7fd420162890 2023-11-29T04:18:00.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd407fff640 1 -- 172.21.15.6:0/2948043384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41800ce30 con 0x7fd420162890 2023-11-29T04:18:00.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd407fff640 1 -- 172.21.15.6:0/2948043384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4180052b0 con 0x7fd420162890 2023-11-29T04:18:00.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42015a460 con 0x7fd420162890 2023-11-29T04:18:00.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.621+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42015aa20 con 0x7fd420162890 2023-11-29T04:18:00.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.625+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4200b3710 con 0x7fd420162890 2023-11-29T04:18:00.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.629+0000 7fd407fff640 1 -- 172.21.15.6:0/2948043384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd418006b20 con 0x7fd420162890 2023-11-29T04:18:00.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.633+0000 7fd407fff640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd40c066470 0x7fd40c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:00.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.633+0000 7fd407fff640 1 -- 172.21.15.6:0/2948043384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd418083030 con 0x7fd420162890 2023-11-29T04:18:00.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.637+0000 7fd41f7fe640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd40c066470 0x7fd40c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:00.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.641+0000 7fd41f7fe640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd40c066470 0x7fd40c068930 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd4100ad000 tx=0x7fd410008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:00.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:00.649+0000 7fd407fff640 1 -- 172.21.15.6:0/2948043384 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd418088060 con 0x7fd420162890 2023-11-29T04:18:01.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.513+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd42015b1e0 con 0x7fd420162890 2023-11-29T04:18:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.517+0000 7fd407fff640 1 -- 172.21.15.6:0/2948043384 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16461 (secure 0 0 0) 0x7fd4180504d0 con 0x7fd420162890 2023-11-29T04:18:01.521 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:18:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-28T21:09:14.652293+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T21:09:10.815928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T21:09:12.024583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T04:18:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.517+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd40c066470 msgr2=0x7fd40c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:01.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.517+0000 7fd425cbb640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd40c066470 0x7fd40c068930 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd4100ad000 tx=0x7fd410008040 comp rx=0 tx=0).stop 2023-11-29T04:18:01.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.517+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd420162890 msgr2=0x7fd42015d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:01.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.517+0000 7fd425cbb640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd420162890 0x7fd42015d790 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c780 tx=0x7fd41800cc40 comp rx=0 tx=0).stop 2023-11-29T04:18:01.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.521+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 shutdown_connections 2023-11-29T04:18:01.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.521+0000 7fd425cbb640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd40c066470 0x7fd40c068930 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:01.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.521+0000 7fd425cbb640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd420162890 0x7fd42015d790 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.521+0000 7fd425cbb640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd42015f230 0x7fd420157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.521+0000 7fd425cbb640 1 --2- 172.21.15.6:0/2948043384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd420070b20 0x7fd42015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.521+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 >> 172.21.15.6:0/2948043384 conn(0x7fd42006ab80 msgr2=0x7fd420160ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.521+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 shutdown_connections 2023-11-29T04:18:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.521+0000 7fd425cbb640 1 -- 172.21.15.6:0/2948043384 wait complete. 2023-11-29T04:18:01.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T04:18:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.829+0000 7f6d5a9b5640 1 Processor -- start 2023-11-29T04:18:01.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.829+0000 7f6d5a9b5640 1 -- start start 2023-11-29T04:18:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.829+0000 7f6d5a9b5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d540c94c0 0x7f6d540b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.829+0000 7f6d5a9b5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d540d0d10 con 0x7f6d540cffe0 2023-11-29T04:18:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.829+0000 7f6d5a9b5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d540c98a0 con 0x7f6d540d1c20 2023-11-29T04:18:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.829+0000 7f6d5a9b5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540d3a50 con 0x7f6d540c94c0 2023-11-29T04:18:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d5a1b4640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6d540d1c20 0x7f6d540cdd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:35320/0 (socket says 172.21.15.6:35320) 2023-11-29T04:18:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d5a1b4640 1 -- 172.21.15.6:0/3459821685 learned_addr learned my addr 172.21.15.6:0/3459821685 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:01.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477584811 0 0) 0x7f6d540c98a0 con 0x7f6d540d1c20 2023-11-29T04:18:01.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d599b3640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d540c94c0 0x7f6d540b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:01.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d40003530 con 0x7f6d540d1c20 2023-11-29T04:18:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 892647285 0 0) 0x7f6d40003530 con 0x7f6d540d1c20 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d540c94c0 msgr2=0x7f6d540b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d540c94c0 0x7f6d540b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 >> v1:172.21.15.6:6789/0 conn(0x7f6d540cffe0 legacy=0x7f6d540d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540b46f0 con 0x7f6d540d1c20 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f6d4c001a00 con 0x7f6d540d1c20 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 >> v1:172.21.15.31:6789/0 conn(0x7f6d540d1c20 legacy=0x7f6d540cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d40003980 0x7f6d40003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d400047d0 0x7f6d40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d40005190 0x7f6d4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540d3a50 con 0x7f6d40003980 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d40014870 con 0x7f6d400047d0 2023-11-29T04:18:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.833+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d40014a30 con 0x7f6d40005190 2023-11-29T04:18:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.837+0000 7f6d5a1b4640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d40005190 0x7f6d4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.837+0000 7f6d599b3640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d40003980 0x7f6d40003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.837+0000 7f6d5a1b4640 1 -- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d400047d0 msgr2=0x7f6d40004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.837+0000 7f6d5a1b4640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d400047d0 0x7f6d40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.837+0000 7f6d5a1b4640 1 -- 172.21.15.6:0/3459821685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d40003980 msgr2=0x7f6d40003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.837+0000 7f6d5a1b4640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d40003980 0x7f6d40003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.837+0000 7f6d5a1b4640 1 -- 172.21.15.6:0/3459821685 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40003530 con 0x7f6d40005190 2023-11-29T04:18:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.837+0000 7f6d599b3640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d40003980 0x7f6d40003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T04:18:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.853+0000 7f6d5a1b4640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d40005190 0x7f6d4000b990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00a7f0 tx=0x7f6d4c01d290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db3f01ca1e24956b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.853+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0ad630 con 0x7f6d40005190 2023-11-29T04:18:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.853+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c0a8070 con 0x7f6d40005190 2023-11-29T04:18:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.853+0000 7f6d589b1640 1 -- 172.21.15.6:0/3459821685 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0ad9d0 con 0x7f6d40005190 2023-11-29T04:18:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.853+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d40005190 msgr2=0x7f6d4000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.853+0000 7f6d5a9b5640 1 --2- 172.21.15.6:0/3459821685 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d40005190 0x7f6d4000b990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00a7f0 tx=0x7f6d4c01d290 comp rx=0 tx=0).stop 2023-11-29T04:18:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.853+0000 7f6d5a1b4640 1 -- 172.21.15.6:0/3459821685 reap_dead start 2023-11-29T04:18:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.853+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/3459821685 shutdown_connections 2023-11-29T04:18:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.853+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/3459821685 >> 172.21.15.6:0/3459821685 conn(0x7f6d540d2f30 msgr2=0x7f6d540d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/3459821685 shutdown_connections 2023-11-29T04:18:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/3459821685 wait complete. 2023-11-29T04:18:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 Processor -- start 2023-11-29T04:18:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 -- start start 2023-11-29T04:18:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d40005190 0x7f6d541f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d54154c40 0x7f6d5415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d541550c0 0x7f6d5415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540cb6a0 con 0x7f6d54154c40 2023-11-29T04:18:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540cb980 con 0x7f6d541550c0 2023-11-29T04:18:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d5a9b5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d540cbc60 con 0x7f6d40005190 2023-11-29T04:18:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d591b2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d54154c40 0x7f6d5415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d591b2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d54154c40 0x7f6d5415d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58078/0 (socket says 172.21.15.6:58078) 2023-11-29T04:18:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.857+0000 7f6d591b2640 1 -- 172.21.15.6:0/2071299296 learned_addr learned my addr 172.21.15.6:0/2071299296 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d591b2640 1 -- 172.21.15.6:0/2071299296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d40005190 msgr2=0x7f6d541f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d591b2640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d40005190 0x7f6d541f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d591b2640 1 -- 172.21.15.6:0/2071299296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d541550c0 msgr2=0x7f6d5415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d591b2640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d541550c0 0x7f6d5415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d591b2640 1 -- 172.21.15.6:0/2071299296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540cbf40 con 0x7f6d54154c40 2023-11-29T04:18:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d591b2640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d54154c40 0x7f6d5415d270 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400c3c0 tx=0x7f6d4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d4a7fc640 1 -- 172.21.15.6:0/2071299296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440052d0 con 0x7f6d54154c40 2023-11-29T04:18:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d540cc220 con 0x7f6d54154c40 2023-11-29T04:18:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d540cc740 con 0x7f6d54154c40 2023-11-29T04:18:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d4a7fc640 1 -- 172.21.15.6:0/2071299296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d44005450 con 0x7f6d54154c40 2023-11-29T04:18:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.861+0000 7f6d4a7fc640 1 -- 172.21.15.6:0/2071299296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44003840 con 0x7f6d54154c40 2023-11-29T04:18:01.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.865+0000 7f6d4a7fc640 1 -- 172.21.15.6:0/2071299296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d440039a0 con 0x7f6d54154c40 2023-11-29T04:18:01.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.865+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3c005260 con 0x7f6d54154c40 2023-11-29T04:18:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.865+0000 7f6d4a7fc640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6d38066470 0x7f6d38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.865+0000 7f6d4a7fc640 1 -- 172.21.15.6:0/2071299296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d44083420 con 0x7f6d54154c40 2023-11-29T04:18:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.865+0000 7f6d599b3640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6d38066470 0x7f6d38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.869+0000 7f6d599b3640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6d38066470 0x7f6d38068930 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6d50006e90 tx=0x7f6d50006e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:01.889+0000 7f6d4a7fc640 1 -- 172.21.15.6:0/2071299296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d44050820 con 0x7f6d54154c40 2023-11-29T04:18:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.221+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6d3c0057e0 con 0x7f6d54154c40 2023-11-29T04:18:02.298 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-11-29T04:18:02.293+0000 7f373394c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T04:18:02.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.317+0000 7f6d4a7fc640 1 -- 172.21.15.6:0/2071299296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6d44053e40 con 0x7f6d54154c40 2023-11-29T04:18:02.322 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T04:18:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.321+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6d38066470 msgr2=0x7f6d38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.321+0000 7f6d5a9b5640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6d38066470 0x7f6d38068930 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6d50006e90 tx=0x7f6d50006e20 comp rx=0 tx=0).stop 2023-11-29T04:18:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.321+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d54154c40 msgr2=0x7f6d5415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.321+0000 7f6d5a9b5640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d54154c40 0x7f6d5415d270 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400c3c0 tx=0x7f6d4400c880 comp rx=0 tx=0).stop 2023-11-29T04:18:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.329+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 shutdown_connections 2023-11-29T04:18:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.329+0000 7f6d5a9b5640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f6d38066470 0x7f6d38068930 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.329+0000 7f6d5a9b5640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d541550c0 0x7f6d5415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.329+0000 7f6d5a9b5640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d54154c40 0x7f6d5415d270 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.329+0000 7f6d5a9b5640 1 --2- 172.21.15.6:0/2071299296 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d40005190 0x7f6d541f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.329+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 >> 172.21.15.6:0/2071299296 conn(0x7f6d540d2f30 msgr2=0x7f6d54161020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:02.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.337+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 shutdown_connections 2023-11-29T04:18:02.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.337+0000 7f6d5a9b5640 1 -- 172.21.15.6:0/2071299296 wait complete. 2023-11-29T04:18:02.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-29T04:18:02.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.585+0000 7f9f9569e640 1 Processor -- start 2023-11-29T04:18:02.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.589+0000 7f9f9569e640 1 -- start start 2023-11-29T04:18:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.589+0000 7f9f9569e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f9015d4f0 0x7f9f9006e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.589+0000 7f9f9569e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f900cccb0 0x7f9f900b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.589+0000 7f9f9569e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f9015de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.589+0000 7f9f9569e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f900b38f0 con 0x7f9f9015d4f0 2023-11-29T04:18:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.589+0000 7f9f9569e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9006edc0 con 0x7f9f900cccb0 2023-11-29T04:18:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.589+0000 7f9f9569e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900cf2c0 con 0x7f9f900b3460 2023-11-29T04:18:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8e7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f900cccb0 0x7f9f900b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8e7fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f900cccb0 0x7f9f900b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:47432/0 (socket says 172.21.15.6:47432) 2023-11-29T04:18:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f9015d4f0 0x7f9f9006e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8e7fc640 1 -- 172.21.15.6:0/1910383523 learned_addr learned my addr 172.21.15.6:0/1910383523 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8ffff640 1 --2- 172.21.15.6:0/1910383523 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f9015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8e7fc640 1 -- 172.21.15.6:0/1910383523 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 msgr2=0x7f9f9015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8e7fc640 1 --2- 172.21.15.6:0/1910383523 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f9015de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8e7fc640 1 -- 172.21.15.6:0/1910383523 >> v2:172.21.15.6:3300/0 conn(0x7f9f9015d4f0 msgr2=0x7f9f9006e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8e7fc640 1 --2- 172.21.15.6:0/1910383523 >> v2:172.21.15.6:3300/0 conn(0x7f9f9015d4f0 0x7f9f9006e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8e7fc640 1 -- 172.21.15.6:0/1910383523 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f900cf5a0 con 0x7f9f900cccb0 2023-11-29T04:18:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8effd640 1 --2- 172.21.15.6:0/1910383523 >> v2:172.21.15.6:3300/0 conn(0x7f9f9015d4f0 0x7f9f9006e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T04:18:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.593+0000 7f9f8ffff640 1 --2- 172.21.15.6:0/1910383523 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f9015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T04:18:02.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f8e7fc640 1 --2- 172.21.15.6:0/1910383523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 0x7f9f900b2f20 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9f90073e70 tx=0x7f9f8401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dc7e79ea7511a3a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:02.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f8dffb640 1 -- 172.21.15.6:0/1910383523 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840aa5f0 con 0x7f9f900cccb0 2023-11-29T04:18:02.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f8dffb640 1 -- 172.21.15.6:0/1910383523 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f840aa750 con 0x7f9f900cccb0 2023-11-29T04:18:02.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f8dffb640 1 -- 172.21.15.6:0/1910383523 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840aaae0 con 0x7f9f900cccb0 2023-11-29T04:18:02.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 -- 172.21.15.6:0/1910383523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 msgr2=0x7f9f900b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:02.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 --2- 172.21.15.6:0/1910383523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 0x7f9f900b2f20 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9f90073e70 tx=0x7f9f8401c4d0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 -- 172.21.15.6:0/1910383523 shutdown_connections 2023-11-29T04:18:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 --2- 172.21.15.6:0/1910383523 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f9015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 --2- 172.21.15.6:0/1910383523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 0x7f9f900b2f20 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 --2- 172.21.15.6:0/1910383523 >> v2:172.21.15.6:3300/0 conn(0x7f9f9015d4f0 0x7f9f9006e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 -- 172.21.15.6:0/1910383523 >> 172.21.15.6:0/1910383523 conn(0x7f9f900d2660 msgr2=0x7f9f900d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 -- 172.21.15.6:0/1910383523 shutdown_connections 2023-11-29T04:18:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 -- 172.21.15.6:0/1910383523 wait complete. 2023-11-29T04:18:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.597+0000 7f9f9569e640 1 Processor -- start 2023-11-29T04:18:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f9569e640 1 -- start start 2023-11-29T04:18:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f9569e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f900af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f9569e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 0x7f9f900b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f9569e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9015d4f0 0x7f9f9015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f9569e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900b5d00 con 0x7f9f9015d4f0 2023-11-29T04:18:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f9569e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900b5fe0 con 0x7f9f900cccb0 2023-11-29T04:18:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f9569e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900b62c0 con 0x7f9f900b3460 2023-11-29T04:18:02.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8e7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 0x7f9f900b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:02.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8effd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f900af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8e7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 0x7f9f900b7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:47442/0 (socket says 172.21.15.6:47442) 2023-11-29T04:18:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8e7fc640 1 -- 172.21.15.6:0/168401036 learned_addr learned my addr 172.21.15.6:0/168401036 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8ffff640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9015d4f0 0x7f9f9015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8effd640 1 -- 172.21.15.6:0/168401036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 msgr2=0x7f9f900b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8effd640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 0x7f9f900b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8effd640 1 -- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9015d4f0 msgr2=0x7f9f9015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:02.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8effd640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9015d4f0 0x7f9f9015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8effd640 1 -- 172.21.15.6:0/168401036 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84009480 con 0x7f9f900b3460 2023-11-29T04:18:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f8effd640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f900af290 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000e600 tx=0x7f9f8000eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f777fe640 1 -- 172.21.15.6:0/168401036 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000c620 con 0x7f9f900b3460 2023-11-29T04:18:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f777fe640 1 -- 172.21.15.6:0/168401036 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8000c780 con 0x7f9f900b3460 2023-11-29T04:18:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f900b65a0 con 0x7f9f900b3460 2023-11-29T04:18:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f777fe640 1 -- 172.21.15.6:0/168401036 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000cb30 con 0x7f9f900b3460 2023-11-29T04:18:02.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.601+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f900b7fa0 con 0x7f9f900b3460 2023-11-29T04:18:02.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.605+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f900d0080 con 0x7f9f900b3460 2023-11-29T04:18:02.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.609+0000 7f9f777fe640 1 -- 172.21.15.6:0/168401036 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f8000cc90 con 0x7f9f900b3460 2023-11-29T04:18:02.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.609+0000 7f9f777fe640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f7c066470 0x7f9f7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:02.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.609+0000 7f9f777fe640 1 -- 172.21.15.6:0/168401036 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9f80083c40 con 0x7f9f900b3460 2023-11-29T04:18:02.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.609+0000 7f9f8e7fc640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f7c066470 0x7f9f7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:02.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.613+0000 7f9f8e7fc640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f7c066470 0x7f9f7c068930 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9f8401c510 tx=0x7f9f840a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:02.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.613+0000 7f9f777fe640 1 -- 172.21.15.6:0/168401036 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f80051070 con 0x7f9f900b3460 2023-11-29T04:18:02.752 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-11-29T04:18:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:02.809+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9f900d2140 con 0x7f9f900b3460 2023-11-29T04:18:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.329+0000 7f9f777fe640 1 -- 172.21.15.6:0/168401036 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9f80054690 con 0x7f9f900b3460 2023-11-29T04:18:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f7c066470 msgr2=0x7f9f7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f7c066470 0x7f9f7c068930 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9f8401c510 tx=0x7f9f840a7000 comp rx=0 tx=0).stop 2023-11-29T04:18:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 msgr2=0x7f9f900af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f900af290 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000e600 tx=0x7f9f8000eac0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 shutdown_connections 2023-11-29T04:18:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9f7c066470 0x7f9f7c068930 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9015d4f0 0x7f9f9015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f900cccb0 0x7f9f900b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 --2- 172.21.15.6:0/168401036 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f900b3460 0x7f9f900af290 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 >> 172.21.15.6:0/168401036 conn(0x7f9f900d2660 msgr2=0x7f9f900711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 shutdown_connections 2023-11-29T04:18:03.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.333+0000 7f9f9569e640 1 -- 172.21.15.6:0/168401036 wait complete. 2023-11-29T04:18:03.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-29T04:18:03.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.577+0000 7f31d0890640 1 Processor -- start 2023-11-29T04:18:03.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.577+0000 7f31d0890640 1 -- start start 2023-11-29T04:18:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.577+0000 7f31d0890640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31cc15d1e0 0x7f31cc0d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.577+0000 7f31d0890640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0d3680 0x7f31cc0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31d0890640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc15d5c0 con 0x7f31cc0d1a70 2023-11-29T04:18:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31d0890640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc0b3130 con 0x7f31cc15d1e0 2023-11-29T04:18:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31d0890640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc0d1f00 con 0x7f31cc0d3680 2023-11-29T04:18:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31ca59c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0d3680 0x7f31cc0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31cad9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31cc15d1e0 0x7f31cc0d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31ca59c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0d3680 0x7f31cc0d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:33268/0 (socket says 172.21.15.6:33268) 2023-11-29T04:18:03.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31ca59c640 1 -- 172.21.15.6:0/570992030 learned_addr learned my addr 172.21.15.6:0/570992030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:03.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31ca59c640 1 -- 172.21.15.6:0/570992030 >> v2:172.21.15.31:3300/0 conn(0x7f31cc15d1e0 msgr2=0x7f31cc0d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:03.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31ca59c640 1 --2- 172.21.15.6:0/570992030 >> v2:172.21.15.31:3300/0 conn(0x7f31cc15d1e0 0x7f31cc0d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31ca59c640 1 -- 172.21.15.6:0/570992030 >> v1:172.21.15.6:6789/0 conn(0x7f31cc0d1a70 legacy=0x7f31cc0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:03.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.581+0000 7f31ca59c640 1 -- 172.21.15.6:0/570992030 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0d1120 con 0x7f31cc0d3680 2023-11-29T04:18:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31ca59c640 1 --2- 172.21.15.6:0/570992030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0d3680 0x7f31cc0d1530 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7df391f20c19110a server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:03.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31c9d9b640 1 -- 172.21.15.6:0/570992030 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00ac410 con 0x7f31cc0d3680 2023-11-29T04:18:03.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31c9d9b640 1 -- 172.21.15.6:0/570992030 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c00ac570 con 0x7f31cc0d3680 2023-11-29T04:18:03.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31c9d9b640 1 -- 172.21.15.6:0/570992030 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00ac900 con 0x7f31cc0d3680 2023-11-29T04:18:03.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31d0890640 1 -- 172.21.15.6:0/570992030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0d3680 msgr2=0x7f31cc0d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:03.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31d0890640 1 --2- 172.21.15.6:0/570992030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0d3680 0x7f31cc0d1530 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009870 tx=0x7f31c001c500 comp rx=0 tx=0).stop 2023-11-29T04:18:03.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31d0890640 1 -- 172.21.15.6:0/570992030 shutdown_connections 2023-11-29T04:18:03.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31d0890640 1 --2- 172.21.15.6:0/570992030 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc0d3680 0x7f31cc0d1530 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31d0890640 1 --2- 172.21.15.6:0/570992030 >> v2:172.21.15.31:3300/0 conn(0x7f31cc15d1e0 0x7f31cc0d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31d0890640 1 -- 172.21.15.6:0/570992030 >> 172.21.15.6:0/570992030 conn(0x7f31cc09c310 msgr2=0x7f31cc0d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:03.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31d0890640 1 -- 172.21.15.6:0/570992030 shutdown_connections 2023-11-29T04:18:03.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.585+0000 7f31d0890640 1 -- 172.21.15.6:0/570992030 wait complete. 2023-11-29T04:18:03.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31d0890640 1 Processor -- start 2023-11-29T04:18:03.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31d0890640 1 -- start start 2023-11-29T04:18:03.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31d0890640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0d1a70 0x7f31cc1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:03.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31d0890640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc0d3680 0x7f31cc159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31d0890640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc15d1e0 0x7f31cc156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31d0890640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc154ab0 con 0x7f31cc0d1a70 2023-11-29T04:18:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31d0890640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc14afc0 con 0x7f31cc0d3680 2023-11-29T04:18:03.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31d0890640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc153e30 con 0x7f31cc15d1e0 2023-11-29T04:18:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31ca59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc0d3680 0x7f31cc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31cad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0d1a70 0x7f31cc1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31ca59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc0d3680 0x7f31cc159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:47472/0 (socket says 172.21.15.6:47472) 2023-11-29T04:18:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31cb59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc15d1e0 0x7f31cc156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31ca59c640 1 -- 172.21.15.6:0/3181480636 learned_addr learned my addr 172.21.15.6:0/3181480636 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31ca59c640 1 -- 172.21.15.6:0/3181480636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc15d1e0 msgr2=0x7f31cc156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31ca59c640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc15d1e0 0x7f31cc156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31ca59c640 1 -- 172.21.15.6:0/3181480636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0d1a70 msgr2=0x7f31cc1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31ca59c640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0d1a70 0x7f31cc1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.589+0000 7f31ca59c640 1 -- 172.21.15.6:0/3181480636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00094d0 con 0x7f31cc0d3680 2023-11-29T04:18:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.593+0000 7f31ca59c640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc0d3680 0x7f31cc159900 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f31c001cda0 tx=0x7f31c00192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.593+0000 7f31b37fe640 1 -- 172.21.15.6:0/3181480636 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00ac410 con 0x7f31cc0d3680 2023-11-29T04:18:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.593+0000 7f31b37fe640 1 -- 172.21.15.6:0/3181480636 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c00b45c0 con 0x7f31cc0d3680 2023-11-29T04:18:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.593+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31cc154110 con 0x7f31cc0d3680 2023-11-29T04:18:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.593+0000 7f31b37fe640 1 -- 172.21.15.6:0/3181480636 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00b4990 con 0x7f31cc0d3680 2023-11-29T04:18:03.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.593+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc1546d0 con 0x7f31cc0d3680 2023-11-29T04:18:03.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.593+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc04e850 con 0x7f31cc0d3680 2023-11-29T04:18:03.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.597+0000 7f31b37fe640 1 -- 172.21.15.6:0/3181480636 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31c00b4af0 con 0x7f31cc0d3680 2023-11-29T04:18:03.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.601+0000 7f31b37fe640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f31b8066470 0x7f31b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:03.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.601+0000 7f31b37fe640 1 -- 172.21.15.6:0/3181480636 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f31c011e460 con 0x7f31cc0d3680 2023-11-29T04:18:03.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.601+0000 7f31cad9d640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f31b8066470 0x7f31b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:03.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.601+0000 7f31cad9d640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f31b8066470 0x7f31b8068930 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009ac0 tx=0x7f31bc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:03.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:03.605+0000 7f31b37fe640 1 -- 172.21.15.6:0/3181480636 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31c00eb920 con 0x7f31cc0d3680 2023-11-29T04:18:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:04.097+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31cc04e850 con 0x7f31cc0d3680 2023-11-29T04:18:05.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.101+0000 7f31b37fe640 1 -- 172.21.15.6:0/3181480636 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7f31c00eef40 con 0x7f31cc0d3680 2023-11-29T04:18:05.106 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-11-29T04:18:05.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f31b8066470 msgr2=0x7f31b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:05.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f31b8066470 0x7f31b8068930 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009ac0 tx=0x7f31bc009190 comp rx=0 tx=0).stop 2023-11-29T04:18:05.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc0d3680 msgr2=0x7f31cc159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:05.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc0d3680 0x7f31cc159900 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f31c001cda0 tx=0x7f31c00192a0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 shutdown_connections 2023-11-29T04:18:05.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f31b8066470 0x7f31b8068930 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31cc15d1e0 0x7f31cc156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc0d3680 0x7f31cc159900 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 --2- 172.21.15.6:0/3181480636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc0d1a70 0x7f31cc1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.105+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 >> 172.21.15.6:0/3181480636 conn(0x7f31cc09c310 msgr2=0x7f31cc1566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:05.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.109+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 shutdown_connections 2023-11-29T04:18:05.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.109+0000 7f31d0890640 1 -- 172.21.15.6:0/3181480636 wait complete. 2023-11-29T04:18:05.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-29T04:18:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.701+0000 7f7066701640 1 Processor -- start 2023-11-29T04:18:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.701+0000 7f7066701640 1 -- start start 2023-11-29T04:18:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.705+0000 7f7066701640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f706014a5b0 0x7f706006c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.705+0000 7f7064c9e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f70600ce320 0x7f7060165a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37282/0 (socket says 172.21.15.6:37282) 2023-11-29T04:18:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.705+0000 7f7064c9e640 1 -- 172.21.15.6:0/1570273329 learned_addr learned my addr 172.21.15.6:0/1570273329 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.705+0000 7f7066701640 1 -- 172.21.15.6:0/1570273329 --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706014a990 con 0x7f70600ce320 2023-11-29T04:18:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.705+0000 7f7066701640 1 -- 172.21.15.6:0/1570273329 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7060166190 con 0x7f706014b100 2023-11-29T04:18:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.705+0000 7f7066701640 1 -- 172.21.15.6:0/1570273329 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7060071980 con 0x7f706014a5b0 2023-11-29T04:18:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497072495 0 0) 0x7f706014a990 con 0x7f70600ce320 2023-11-29T04:18:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7048003530 con 0x7f70600ce320 2023-11-29T04:18:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705ffff640 1 --2- 172.21.15.6:0/1570273329 >> v2:172.21.15.31:3300/0 conn(0x7f706014a5b0 0x7f706006c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717853200 0 0) 0x7f7060166190 con 0x7f706014b100 2023-11-29T04:18:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f706014a990 con 0x7f706014b100 2023-11-29T04:18:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2814779294 0 0) 0x7f7048003530 con 0x7f70600ce320 2023-11-29T04:18:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 >> v2:172.21.15.31:3300/0 conn(0x7f706014a5b0 msgr2=0x7f706006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 --2- 172.21.15.6:0/1570273329 >> v2:172.21.15.31:3300/0 conn(0x7f706014a5b0 0x7f706006c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 >> v1:172.21.15.31:6789/0 conn(0x7f706014b100 legacy=0x7f7060165370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060071c60 con 0x7f70600ce320 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f7058001a00 con 0x7f70600ce320 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 >> v1:172.21.15.6:6789/0 conn(0x7f70600ce320 legacy=0x7f7060165a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 --2- 172.21.15.6:0/1570273329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7048004bc0 0x7f7048004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 --2- 172.21.15.6:0/1570273329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048003770 0x7f7048003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 --2- 172.21.15.6:0/1570273329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7048004250 0x7f704800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7060071980 con 0x7f7048003770 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704800c200 con 0x7f7048004250 2023-11-29T04:18:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.709+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704800c3c0 con 0x7f7048004bc0 2023-11-29T04:18:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.713+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1570273329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048003770 0x7f7048003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.713+0000 7f705f7fe640 1 -- 172.21.15.6:0/1570273329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7048004bc0 msgr2=0x7f7048004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.713+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1570273329 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7048004bc0 0x7f7048004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.713+0000 7f705f7fe640 1 -- 172.21.15.6:0/1570273329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7048004250 msgr2=0x7f704800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.713+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1570273329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7048004250 0x7f704800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.713+0000 7f705f7fe640 1 -- 172.21.15.6:0/1570273329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7048003530 con 0x7f7048003770 2023-11-29T04:18:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.713+0000 7f7064c9e640 1 -- 172.21.15.6:0/1570273329 reap_dead start 2023-11-29T04:18:05.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.721+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1570273329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048003770 0x7f7048003bf0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f7054007fd0 tx=0x7f705401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a1ffe40ec768ea server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.721+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540052d0 con 0x7f7048003770 2023-11-29T04:18:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.721+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054005450 con 0x7f7048003770 2023-11-29T04:18:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.721+0000 7f705effd640 1 -- 172.21.15.6:0/1570273329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540a88d0 con 0x7f7048003770 2023-11-29T04:18:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.721+0000 7f7066701640 1 -- 172.21.15.6:0/1570273329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048003770 msgr2=0x7f7048003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.721+0000 7f7066701640 1 --2- 172.21.15.6:0/1570273329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048003770 0x7f7048003bf0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f7054007fd0 tx=0x7f705401ec90 comp rx=0 tx=0).stop 2023-11-29T04:18:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.721+0000 7f7066701640 1 -- 172.21.15.6:0/1570273329 shutdown_connections 2023-11-29T04:18:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.721+0000 7f7066701640 1 --2- 172.21.15.6:0/1570273329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7048003770 0x7f7048003bf0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.721+0000 7f7066701640 1 -- 172.21.15.6:0/1570273329 >> 172.21.15.6:0/1570273329 conn(0x7f70600b0b00 msgr2=0x7f70600b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.725+0000 7f7066701640 1 -- 172.21.15.6:0/1570273329 shutdown_connections 2023-11-29T04:18:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.725+0000 7f7066701640 1 -- 172.21.15.6:0/1570273329 wait complete. 2023-11-29T04:18:05.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.745+0000 7f7066701640 1 Processor -- start 2023-11-29T04:18:05.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.745+0000 7f7066701640 1 -- start start 2023-11-29T04:18:05.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.749+0000 7f7066701640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7060149ac0 0x7f70601640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:05.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.749+0000 7f7066701640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70600b24c0 0x7f7060132280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:05.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.749+0000 7f7066701640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70601327c0 0x7f7060161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:05.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.749+0000 7f7066701640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7060132c70 con 0x7f70601327c0 2023-11-29T04:18:05.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.749+0000 7f7066701640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600b3e30 con 0x7f70600b24c0 2023-11-29T04:18:05.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.749+0000 7f7066701640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600b29a0 con 0x7f7060149ac0 2023-11-29T04:18:05.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.749+0000 7f705f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70600b24c0 0x7f7060132280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:05.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.749+0000 7f705f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70600b24c0 0x7f7060132280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:47506/0 (socket says 172.21.15.6:47506) 2023-11-29T04:18:05.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.749+0000 7f705f7fe640 1 -- 172.21.15.6:0/1965561298 learned_addr learned my addr 172.21.15.6:0/1965561298 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:05.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.757+0000 7f705f7fe640 1 -- 172.21.15.6:0/1965561298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7060149ac0 msgr2=0x7f70601640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:05.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.757+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7060149ac0 0x7f70601640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.757+0000 7f705f7fe640 1 -- 172.21.15.6:0/1965561298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70601327c0 msgr2=0x7f7060161dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T04:18:05.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.757+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70601327c0 0x7f7060161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:05.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.757+0000 7f705f7fe640 1 -- 172.21.15.6:0/1965561298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70600b2c80 con 0x7f70600b24c0 2023-11-29T04:18:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.761+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70600b24c0 0x7f7060132280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f705401f530 tx=0x7f7048005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.769+0000 7f705cff9640 1 -- 172.21.15.6:0/1965561298 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540a8d10 con 0x7f70600b24c0 2023-11-29T04:18:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.769+0000 7f705cff9640 1 -- 172.21.15.6:0/1965561298 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70540a8e70 con 0x7f70600b24c0 2023-11-29T04:18:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.769+0000 7f705cff9640 1 -- 172.21.15.6:0/1965561298 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70540052d0 con 0x7f70600b24c0 2023-11-29T04:18:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.769+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70600b2f60 con 0x7f70600b24c0 2023-11-29T04:18:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.769+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7060162310 con 0x7f70600b24c0 2023-11-29T04:18:05.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.773+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70600674d0 con 0x7f70600b24c0 2023-11-29T04:18:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.777+0000 7f705cff9640 1 -- 172.21.15.6:0/1965561298 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70540067e0 con 0x7f70600b24c0 2023-11-29T04:18:05.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.781+0000 7f705cff9640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f704c0664f0 0x7f704c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:05.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.781+0000 7f705cff9640 1 -- 172.21.15.6:0/1965561298 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f7054120dc0 con 0x7f70600b24c0 2023-11-29T04:18:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.789+0000 7f705ffff640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f704c0664f0 0x7f704c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.793+0000 7f705ffff640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f704c0664f0 0x7f704c0689b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f70600cfcd0 tx=0x7f7050008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:05.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:05.805+0000 7f705cff9640 1 -- 172.21.15.6:0/1965561298 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70540ee550 con 0x7f70600b24c0 2023-11-29T04:18:06.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:06.189+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f70600674d0 con 0x7f70600b24c0 2023-11-29T04:18:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.141+0000 7f705cff9640 1 -- 172.21.15.6:0/1965561298 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f70540bf0d0 con 0x7f70600b24c0 2023-11-29T04:18:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-11-29T04:18:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f704c0664f0 msgr2=0x7f704c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f704c0664f0 0x7f704c0689b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f70600cfcd0 tx=0x7f7050008040 comp rx=0 tx=0).stop 2023-11-29T04:18:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70600b24c0 msgr2=0x7f7060132280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70600b24c0 0x7f7060132280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f705401f530 tx=0x7f7048005800 comp rx=0 tx=0).stop 2023-11-29T04:18:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 shutdown_connections 2023-11-29T04:18:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f704c0664f0 0x7f704c0689b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70601327c0 0x7f7060161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70600b24c0 0x7f7060132280 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 --2- 172.21.15.6:0/1965561298 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7060149ac0 0x7f70601640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.157+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 >> 172.21.15.6:0/1965561298 conn(0x7f70600b0b00 msgr2=0x7f70600b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:07.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.165+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 shutdown_connections 2023-11-29T04:18:07.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.169+0000 7f7066701640 1 -- 172.21.15.6:0/1965561298 wait complete. 2023-11-29T04:18:07.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-29T04:18:07.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.969+0000 7f6430efe640 1 Processor -- start 2023-11-29T04:18:07.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.977+0000 7f6430efe640 1 -- start start 2023-11-29T04:18:07.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.985+0000 7f6430efe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f642c0711f0 0x7f642c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:07.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.985+0000 7f6430efe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c15e780 con 0x7f642c06d060 2023-11-29T04:18:07.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.985+0000 7f6430efe640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c070430 con 0x7f642c143900 2023-11-29T04:18:07.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.985+0000 7f6430efe640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f642c070dd0 con 0x7f642c0711f0 2023-11-29T04:18:07.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.985+0000 7f6429d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f642c06d060 0x7f642c15da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37290/0 (socket says 172.21.15.6:37290) 2023-11-29T04:18:07.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.985+0000 7f6429d9b640 1 -- 172.21.15.6:0/3843707811 learned_addr learned my addr 172.21.15.6:0/3843707811 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:07.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.989+0000 7f642ad9d640 1 --2- 172.21.15.6:0/3843707811 >> v2:172.21.15.31:3300/0 conn(0x7f642c0711f0 0x7f642c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:08.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.993+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632353238 0 0) 0x7f642c15e780 con 0x7f642c06d060 2023-11-29T04:18:08.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.993+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6414003530 con 0x7f642c06d060 2023-11-29T04:18:08.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.993+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594528810 0 0) 0x7f642c070430 con 0x7f642c143900 2023-11-29T04:18:08.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.993+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f642c15e780 con 0x7f642c143900 2023-11-29T04:18:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2442564542 0 0) 0x7f6414003530 con 0x7f642c06d060 2023-11-29T04:18:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 >> v2:172.21.15.31:3300/0 conn(0x7f642c0711f0 msgr2=0x7f642c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 --2- 172.21.15.6:0/3843707811 >> v2:172.21.15.31:3300/0 conn(0x7f642c0711f0 0x7f642c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 >> v1:172.21.15.31:6789/0 conn(0x7f642c143900 legacy=0x7f642c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c070710 con 0x7f642c06d060 2023-11-29T04:18:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7f641c001680 con 0x7f642c06d060 2023-11-29T04:18:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 >> v1:172.21.15.6:6789/0 conn(0x7f642c06d060 legacy=0x7f642c15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:08.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6414004bc0 0x7f6414004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:08.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6414003770 0x7f6414003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:08.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6414004130 0x7f6414014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:08.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c070dd0 con 0x7f6414003770 2023-11-29T04:18:08.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64140148f0 con 0x7f6414004130 2023-11-29T04:18:08.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6414014ab0 con 0x7f6414004bc0 2023-11-29T04:18:08.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f6429d9b640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6414003770 0x7f6414003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:08.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f6429d9b640 1 -- 172.21.15.6:0/3843707811 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6414004bc0 msgr2=0x7f6414004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-29T04:18:08.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f6429d9b640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6414004bc0 0x7f6414004fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f6429d9b640 1 -- 172.21.15.6:0/3843707811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6414004130 msgr2=0x7f6414014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:08.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642ad9d640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6414004130 0x7f6414014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:08.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f6429d9b640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6414004130 0x7f6414014220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f6429d9b640 1 -- 172.21.15.6:0/3843707811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c070710 con 0x7f6414003770 2023-11-29T04:18:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:07.997+0000 7f642ad9d640 1 -- 172.21.15.6:0/3843707811 reap_dead start 2023-11-29T04:18:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.001+0000 7f6429d9b640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6414003770 0x7f6414003bf0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f642c0ced90 tx=0x7f641c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc7a85d32e1f575 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.001+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c005ae0 con 0x7f6414003770 2023-11-29T04:18:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.001+0000 7f642959a640 1 -- 172.21.15.6:0/3843707811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c005c40 con 0x7f6414003770 2023-11-29T04:18:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.005+0000 7f6430efe640 1 -- 172.21.15.6:0/3843707811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6414003770 msgr2=0x7f6414003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.005+0000 7f6430efe640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6414003770 0x7f6414003bf0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f642c0ced90 tx=0x7f641c01cbc0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.005+0000 7f6430efe640 1 -- 172.21.15.6:0/3843707811 shutdown_connections 2023-11-29T04:18:08.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.005+0000 7f6430efe640 1 --2- 172.21.15.6:0/3843707811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6414003770 0x7f6414003bf0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.005+0000 7f6430efe640 1 -- 172.21.15.6:0/3843707811 >> 172.21.15.6:0/3843707811 conn(0x7f642c06a580 msgr2=0x7f642c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:08.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.013+0000 7f6430efe640 1 -- 172.21.15.6:0/3843707811 shutdown_connections 2023-11-29T04:18:08.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.013+0000 7f6430efe640 1 -- 172.21.15.6:0/3843707811 wait complete. 2023-11-29T04:18:08.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.017+0000 7f6430efe640 1 Processor -- start 2023-11-29T04:18:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.021+0000 7f6430efe640 1 -- start start 2023-11-29T04:18:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f6430efe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6414003770 0x7f642c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f6430efe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f642c1f2610 0x7f642c1f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f6430efe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f642c1f2fb0 0x7f642c15b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f6429d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f642c1f2610 0x7f642c1f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f6429d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f642c1f2610 0x7f642c1f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:47528/0 (socket says 172.21.15.6:47528) 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f642ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f642c1f2fb0 0x7f642c15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f642ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f642c1f2fb0 0x7f642c15b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58160/0 (socket says 172.21.15.6:58160) 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f6429d9b640 1 -- 172.21.15.6:0/4068488738 learned_addr learned my addr 172.21.15.6:0/4068488738 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c13c8c0 con 0x7f642c1f2fb0 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c15c8a0 con 0x7f642c1f2610 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.025+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c13bf90 con 0x7f6414003770 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.029+0000 7f6429d9b640 1 -- 172.21.15.6:0/4068488738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6414003770 msgr2=0x7f642c159e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.029+0000 7f6429d9b640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6414003770 0x7f642c159e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.029+0000 7f6429d9b640 1 -- 172.21.15.6:0/4068488738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f642c1f2fb0 msgr2=0x7f642c15b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.029+0000 7f6429d9b640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f642c1f2fb0 0x7f642c15b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.029+0000 7f6429d9b640 1 -- 172.21.15.6:0/4068488738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c13c270 con 0x7f642c1f2610 2023-11-29T04:18:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.029+0000 7f6429d9b640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f642c1f2610 0x7f642c1f2a70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f641c01c630 tx=0x7f6414005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:08.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.029+0000 7f641affd640 1 -- 172.21.15.6:0/4068488738 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c0b4070 con 0x7f642c1f2610 2023-11-29T04:18:08.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.033+0000 7f641affd640 1 -- 172.21.15.6:0/4068488738 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c0a5cf0 con 0x7f642c1f2610 2023-11-29T04:18:08.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.033+0000 7f641affd640 1 -- 172.21.15.6:0/4068488738 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c007270 con 0x7f642c1f2610 2023-11-29T04:18:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.037+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c13c550 con 0x7f642c1f2610 2023-11-29T04:18:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.037+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c15a910 con 0x7f642c1f2610 2023-11-29T04:18:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.045+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c072b90 con 0x7f642c1f2610 2023-11-29T04:18:08.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.065+0000 7f641affd640 1 -- 172.21.15.6:0/4068488738 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f641c0073d0 con 0x7f642c1f2610 2023-11-29T04:18:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.073+0000 7f641affd640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f640c066570 0x7f640c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.073+0000 7f641affd640 1 -- 172.21.15.6:0/4068488738 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f641c11d6c0 con 0x7f642c1f2610 2023-11-29T04:18:08.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.073+0000 7f641affd640 1 -- 172.21.15.6:0/4068488738 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f641c11fc30 con 0x7f642c1f2610 2023-11-29T04:18:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.077+0000 7f642a59c640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f640c066570 0x7f640c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:08.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.085+0000 7f642a59c640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f640c066570 0x7f640c068a30 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f642400e2e0 tx=0x7f6424009d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:08.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.469+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f642c04e930 con 0x7f642c1f2610 2023-11-29T04:18:08.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.569+0000 7f641affd640 1 -- 172.21.15.6:0/4068488738 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f641c0eae20 con 0x7f642c1f2610 2023-11-29T04:18:08.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.577+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f640c066570 msgr2=0x7f640c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:08.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.577+0000 7f6430efe640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f640c066570 0x7f640c068a30 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f642400e2e0 tx=0x7f6424009d70 comp rx=0 tx=0).stop 2023-11-29T04:18:08.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.577+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f642c1f2610 msgr2=0x7f642c1f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:08.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.577+0000 7f6430efe640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f642c1f2610 0x7f642c1f2a70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f641c01c630 tx=0x7f6414005800 comp rx=0 tx=0).stop 2023-11-29T04:18:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.581+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 shutdown_connections 2023-11-29T04:18:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.581+0000 7f6430efe640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f640c066570 0x7f640c068a30 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.581+0000 7f6430efe640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f642c1f2fb0 0x7f642c15b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.581+0000 7f6430efe640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f642c1f2610 0x7f642c1f2a70 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.581+0000 7f6430efe640 1 --2- 172.21.15.6:0/4068488738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6414003770 0x7f642c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.581+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 >> 172.21.15.6:0/4068488738 conn(0x7f642c06a580 msgr2=0x7f642c0b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.585+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 shutdown_connections 2023-11-29T04:18:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:08.589+0000 7f6430efe640 1 -- 172.21.15.6:0/4068488738 wait complete. 2023-11-29T04:18:08.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-29T04:18:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.861+0000 7f9d433f5640 1 Processor -- start 2023-11-29T04:18:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.861+0000 7f9d433f5640 1 -- start start 2023-11-29T04:18:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d433f5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d3c15dae0 0x7f9d3c0715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d433f5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d3c071b30 0x7f9d3c1421a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d433f5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3c071f80 con 0x7f9d3c0b3780 2023-11-29T04:18:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d433f5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3c0723c0 con 0x7f9d3c071b30 2023-11-29T04:18:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d433f5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c0b2c80 con 0x7f9d3c15dae0 2023-11-29T04:18:09.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d41992640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d3c071b30 0x7f9d3c1421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:09.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d41992640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d3c071b30 0x7f9d3c1421a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49086/0 (socket says 172.21.15.6:49086) 2023-11-29T04:18:09.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d41992640 1 -- 172.21.15.6:0/3602760477 learned_addr learned my addr 172.21.15.6:0/3602760477 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:09.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d40990640 1 --2- 172.21.15.6:0/3602760477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d3c15dae0 0x7f9d3c0715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:09.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d41992640 1 -- 172.21.15.6:0/3602760477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d3c15dae0 msgr2=0x7f9d3c0715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d41992640 1 --2- 172.21.15.6:0/3602760477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d3c15dae0 0x7f9d3c0715f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d41992640 1 -- 172.21.15.6:0/3602760477 >> v1:172.21.15.31:6789/0 conn(0x7f9d3c0b3780 legacy=0x7f9d3c1436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.865+0000 7f9d41992640 1 -- 172.21.15.6:0/3602760477 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0b1d90 con 0x7f9d3c071b30 2023-11-29T04:18:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.873+0000 7f9d41992640 1 --2- 172.21.15.6:0/3602760477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c071b30 0x7f9d3c1421a0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009ad0 tx=0x7f9d3001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c940267400f70c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:09.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.873+0000 7f9d2ffff640 1 -- 172.21.15.6:0/3602760477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300a7070 con 0x7f9d3c071b30 2023-11-29T04:18:09.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.873+0000 7f9d2ffff640 1 -- 172.21.15.6:0/3602760477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d300ab430 con 0x7f9d3c071b30 2023-11-29T04:18:09.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.873+0000 7f9d2ffff640 1 -- 172.21.15.6:0/3602760477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300ab7c0 con 0x7f9d3c071b30 2023-11-29T04:18:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.881+0000 7f9d433f5640 1 -- 172.21.15.6:0/3602760477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c071b30 msgr2=0x7f9d3c1421a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.881+0000 7f9d433f5640 1 --2- 172.21.15.6:0/3602760477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c071b30 0x7f9d3c1421a0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009ad0 tx=0x7f9d3001c470 comp rx=0 tx=0).stop 2023-11-29T04:18:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.893+0000 7f9d433f5640 1 -- 172.21.15.6:0/3602760477 shutdown_connections 2023-11-29T04:18:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.893+0000 7f9d433f5640 1 --2- 172.21.15.6:0/3602760477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c071b30 0x7f9d3c1421a0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.893+0000 7f9d433f5640 1 --2- 172.21.15.6:0/3602760477 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d3c15dae0 0x7f9d3c0715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.893+0000 7f9d433f5640 1 -- 172.21.15.6:0/3602760477 >> 172.21.15.6:0/3602760477 conn(0x7f9d3c06a750 msgr2=0x7f9d3c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.901+0000 7f9d433f5640 1 -- 172.21.15.6:0/3602760477 shutdown_connections 2023-11-29T04:18:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.905+0000 7f9d433f5640 1 -- 172.21.15.6:0/3602760477 wait complete. 2023-11-29T04:18:09.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.933+0000 7f9d433f5640 1 Processor -- start 2023-11-29T04:18:09.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.933+0000 7f9d433f5640 1 -- start start 2023-11-29T04:18:09.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.933+0000 7f9d433f5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d3c071b30 0x7f9d3c140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:09.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.933+0000 7f9d433f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c0b3780 0x7f9d3c13c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.937+0000 7f9d433f5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d3c15dae0 0x7f9d3c13c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.937+0000 7f9d40990640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c0b3780 0x7f9d3c13c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.937+0000 7f9d433f5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c15c070 con 0x7f9d3c0b3780 2023-11-29T04:18:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.937+0000 7f9d40990640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c0b3780 0x7f9d3c13c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49090/0 (socket says 172.21.15.6:49090) 2023-11-29T04:18:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.937+0000 7f9d40990640 1 -- 172.21.15.6:0/3001173828 learned_addr learned my addr 172.21.15.6:0/3001173828 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.937+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c15b460 con 0x7f9d3c071b30 2023-11-29T04:18:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.937+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c15b740 con 0x7f9d3c15dae0 2023-11-29T04:18:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.941+0000 7f9d41191640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d3c071b30 0x7f9d3c140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:09.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.941+0000 7f9d41191640 1 -- 172.21.15.6:0/3001173828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d3c15dae0 msgr2=0x7f9d3c13c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:09.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.941+0000 7f9d41191640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d3c15dae0 0x7f9d3c13c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:09.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.941+0000 7f9d41191640 1 -- 172.21.15.6:0/3001173828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c0b3780 msgr2=0x7f9d3c13c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:09.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.945+0000 7f9d41191640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c0b3780 0x7f9d3c13c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:09.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.945+0000 7f9d41191640 1 -- 172.21.15.6:0/3001173828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d300094d0 con 0x7f9d3c071b30 2023-11-29T04:18:09.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.945+0000 7f9d41191640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d3c071b30 0x7f9d3c140c30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c700 tx=0x7f9d3400cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.957+0000 7f9d2dffb640 1 -- 172.21.15.6:0/3001173828 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34003b80 con 0x7f9d3c071b30 2023-11-29T04:18:09.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.957+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3c15ba20 con 0x7f9d3c071b30 2023-11-29T04:18:09.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.957+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3c141170 con 0x7f9d3c071b30 2023-11-29T04:18:09.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.961+0000 7f9d2dffb640 1 -- 172.21.15.6:0/3001173828 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d34003d00 con 0x7f9d3c071b30 2023-11-29T04:18:09.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.961+0000 7f9d2dffb640 1 -- 172.21.15.6:0/3001173828 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d340052b0 con 0x7f9d3c071b30 2023-11-29T04:18:09.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.961+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c005260 con 0x7f9d3c071b30 2023-11-29T04:18:09.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.973+0000 7f9d2dffb640 1 -- 172.21.15.6:0/3001173828 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d34005410 con 0x7f9d3c071b30 2023-11-29T04:18:09.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.977+0000 7f9d2dffb640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d200664c0 0x7f9d20068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:09.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.981+0000 7f9d2dffb640 1 -- 172.21.15.6:0/3001173828 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9d34083240 con 0x7f9d3c071b30 2023-11-29T04:18:09.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.985+0000 7f9d40990640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d200664c0 0x7f9d20068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:09.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:09.989+0000 7f9d40990640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d200664c0 0x7f9d20068980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c071930 tx=0x7f9d38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:10.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:10.009+0000 7f9d2dffb640 1 -- 172.21.15.6:0/3001173828 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d34050aa0 con 0x7f9d3c071b30 2023-11-29T04:18:11.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.221+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f9d1c005510 con 0x7f9d3c071b30 2023-11-29T04:18:11.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.717+0000 7f9d2dffb640 1 -- 172.21.15.6:0/3001173828 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v12964) v1 ==== 144+0+0 (secure 0 0 0) 0x7f9d34050aa0 con 0x7f9d3c071b30 2023-11-29T04:18:11.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.749+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d200664c0 msgr2=0x7f9d20068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:11.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.749+0000 7f9d433f5640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d200664c0 0x7f9d20068980 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c071930 tx=0x7f9d38008040 comp rx=0 tx=0).stop 2023-11-29T04:18:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.749+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d3c071b30 msgr2=0x7f9d3c140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.749+0000 7f9d433f5640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d3c071b30 0x7f9d3c140c30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c700 tx=0x7f9d3400cbc0 comp rx=0 tx=0).stop 2023-11-29T04:18:11.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.761+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 shutdown_connections 2023-11-29T04:18:11.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.761+0000 7f9d433f5640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f9d200664c0 0x7f9d20068980 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:11.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.761+0000 7f9d433f5640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d3c15dae0 0x7f9d3c13c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.761+0000 7f9d433f5640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d3c0b3780 0x7f9d3c13c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.761+0000 7f9d433f5640 1 --2- 172.21.15.6:0/3001173828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d3c071b30 0x7f9d3c140c30 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.761+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 >> 172.21.15.6:0/3001173828 conn(0x7f9d3c06a750 msgr2=0x7f9d3c0afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:11.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.765+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 shutdown_connections 2023-11-29T04:18:11.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:11.765+0000 7f9d433f5640 1 -- 172.21.15.6:0/3001173828 wait complete. 2023-11-29T04:18:12.125 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner: 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-11-29T04:18:12.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner: 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner:Ran 1 test in 25771.005s 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner: 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner: 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-29T04:18:12.127 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-29T04:18:12.128 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-11-29T04:18:12.128 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-11-29T04:18:12.128 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-11-29T04:18:12.128 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-11-29T04:18:12.128 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-11-29T04:18:12.128 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-11-29T04:18:12.128 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-11-29T04:18:12.128 INFO:tasks.cephfs_test_runner: 2023-11-29T04:18:12.128 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-29T04:18:12.192 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=68501a9bfd7540888844317d115992f2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-29T04:18:12.194 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-29T04:18:12.204 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-29T04:18:12.222 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-29T04:18:12.222 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-29T04:18:12.223 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T04:18:12.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3628 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T04:18:12.343 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-11-29T04:18:12.343 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T04:18:12.424 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3628 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T04:18:12.425 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-29T04:18:12.425 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T04:18:12.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T04:18:12.482 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-29T04:18:12.482 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T04:18:12.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357764k,nr_inodes=4089441,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T04:18:12.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:18:12.548 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2023-11-29T04:18:12.635 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-29T04:18:12.635 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-29T04:18:12.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:18:12.642 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-29T04:18:12.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:18:12.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-29T04:18:12.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:18:12.849 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2023-11-29T04:18:13.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:18:13.115 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-11-29T04:18:13.171 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T04:18:13.171 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T04:18:13.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:18:13.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T04:18:13.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:18:13.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T04:18:13.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T04:18:13.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-11-29T04:18:14.153 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-29T04:18:14.163 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-29T04:18:14.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T04:18:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.205+0000 7f7715dc4640 1 Processor -- start 2023-11-29T04:18:15.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.205+0000 7f7715dc4640 1 -- start start 2023-11-29T04:18:15.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.213+0000 7f7715dc4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7710144780 0x7f771015eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:15.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.213+0000 7f7715dc4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f771015f020 0x7f7710071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:15.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.213+0000 7f7715dc4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77100718c0 0x7f771015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:15.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.213+0000 7f770effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f771015f020 0x7f7710071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:15.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.213+0000 7f770effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f771015f020 0x7f7710071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49100/0 (socket says 172.21.15.6:49100) 2023-11-29T04:18:15.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f770effd640 1 -- 172.21.15.6:0/3459708858 learned_addr learned my addr 172.21.15.6:0/3459708858 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f7715dc4640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77100b24f0 con 0x7f771015f020 2023-11-29T04:18:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f7715dc4640 1 -- 172.21.15.6:0/3459708858 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7710071cf0 con 0x7f7710144780 2023-11-29T04:18:15.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f7715dc4640 1 -- 172.21.15.6:0/3459708858 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77100cc760 con 0x7f77100718c0 2023-11-29T04:18:15.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f770ffff640 1 --2- 172.21.15.6:0/3459708858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77100718c0 0x7f771015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f770effd640 1 -- 172.21.15.6:0/3459708858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77100718c0 msgr2=0x7f771015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f770effd640 1 --2- 172.21.15.6:0/3459708858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77100718c0 0x7f771015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f770effd640 1 -- 172.21.15.6:0/3459708858 >> v2:172.21.15.31:3300/0 conn(0x7f7710144780 msgr2=0x7f771015eae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T04:18:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f770effd640 1 --2- 172.21.15.6:0/3459708858 >> v2:172.21.15.31:3300/0 conn(0x7f7710144780 0x7f771015eae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.217+0000 7f770effd640 1 -- 172.21.15.6:0/3459708858 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771015f650 con 0x7f771015f020 2023-11-29T04:18:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.229+0000 7f770effd640 1 --2- 172.21.15.6:0/3459708858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f771015f020 0x7f7710071380 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f77100b18b0 tx=0x7f770001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93d9216ed91c108 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.241+0000 7f770e7fc640 1 -- 172.21.15.6:0/3459708858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000ab610 con 0x7f771015f020 2023-11-29T04:18:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.241+0000 7f770e7fc640 1 -- 172.21.15.6:0/3459708858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77000ab770 con 0x7f771015f020 2023-11-29T04:18:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.241+0000 7f770e7fc640 1 -- 172.21.15.6:0/3459708858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77000abb40 con 0x7f771015f020 2023-11-29T04:18:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.245+0000 7f7715dc4640 1 -- 172.21.15.6:0/3459708858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f771015f020 msgr2=0x7f7710071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.245+0000 7f7715dc4640 1 --2- 172.21.15.6:0/3459708858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f771015f020 0x7f7710071380 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f77100b18b0 tx=0x7f770001c540 comp rx=0 tx=0).stop 2023-11-29T04:18:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.245+0000 7f7715dc4640 1 -- 172.21.15.6:0/3459708858 shutdown_connections 2023-11-29T04:18:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.245+0000 7f7715dc4640 1 --2- 172.21.15.6:0/3459708858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f77100718c0 0x7f771015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.245+0000 7f7715dc4640 1 --2- 172.21.15.6:0/3459708858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f771015f020 0x7f7710071380 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.245+0000 7f7715dc4640 1 --2- 172.21.15.6:0/3459708858 >> v2:172.21.15.31:3300/0 conn(0x7f7710144780 0x7f771015eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.245+0000 7f7715dc4640 1 -- 172.21.15.6:0/3459708858 >> 172.21.15.6:0/3459708858 conn(0x7f77100b0b00 msgr2=0x7f77100b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.245+0000 7f7715dc4640 1 -- 172.21.15.6:0/3459708858 shutdown_connections 2023-11-29T04:18:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.245+0000 7f7715dc4640 1 -- 172.21.15.6:0/3459708858 wait complete. 2023-11-29T04:18:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.265+0000 7f7715dc4640 1 Processor -- start 2023-11-29T04:18:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.265+0000 7f7715dc4640 1 -- start start 2023-11-29T04:18:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f7715dc4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100718c0 0x7f7710153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f7715dc4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7710144780 0x7f77101fad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f7715dc4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771015f020 0x7f771015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f7715dc4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7710141d90 con 0x7f77100718c0 2023-11-29T04:18:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f7715dc4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7710153ec0 con 0x7f7710144780 2023-11-29T04:18:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f7715dc4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77101fb240 con 0x7f771015f020 2023-11-29T04:18:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f770ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771015f020 0x7f771015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f770ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771015f020 0x7f771015a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:55598/0 (socket says 172.21.15.6:55598) 2023-11-29T04:18:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f770ffff640 1 -- 172.21.15.6:0/1705203468 learned_addr learned my addr 172.21.15.6:0/1705203468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f770effd640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7710144780 0x7f77101fad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.273+0000 7f770f7fe640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100718c0 0x7f7710153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.277+0000 7f770ffff640 1 -- 172.21.15.6:0/1705203468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7710144780 msgr2=0x7f77101fad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.277+0000 7f770ffff640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7710144780 0x7f77101fad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.277+0000 7f770ffff640 1 -- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100718c0 msgr2=0x7f7710153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.277+0000 7f770ffff640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100718c0 0x7f7710153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.277+0000 7f770ffff640 1 -- 172.21.15.6:0/1705203468 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000094d0 con 0x7f771015f020 2023-11-29T04:18:15.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.277+0000 7f770f7fe640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100718c0 0x7f7710153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.277+0000 7f770effd640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7710144780 0x7f77101fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.277+0000 7f770ffff640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771015f020 0x7f771015a2d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f770800bcc0 tx=0x7f770800a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.277+0000 7f76f7fff640 1 -- 172.21.15.6:0/1705203468 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708003ba0 con 0x7f771015f020 2023-11-29T04:18:15.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.281+0000 7f76f7fff640 1 -- 172.21.15.6:0/1705203468 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708003d00 con 0x7f771015f020 2023-11-29T04:18:15.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.281+0000 7f76f7fff640 1 -- 172.21.15.6:0/1705203468 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708004270 con 0x7f771015f020 2023-11-29T04:18:15.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.289+0000 7f7715dc4640 1 -- 172.21.15.6:0/1705203468 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7710137c10 con 0x7f771015f020 2023-11-29T04:18:15.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.289+0000 7f7715dc4640 1 -- 172.21.15.6:0/1705203468 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77101422c0 con 0x7f771015f020 2023-11-29T04:18:15.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.293+0000 7f76f5ffb640 1 -- 172.21.15.6:0/1705203468 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771004e8c0 con 0x7f771015f020 2023-11-29T04:18:15.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.293+0000 7f76f7fff640 1 -- 172.21.15.6:0/1705203468 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f770800b040 con 0x7f771015f020 2023-11-29T04:18:15.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.317+0000 7f76f7fff640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f76fc066470 0x7f76fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:15.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.317+0000 7f76f7fff640 1 -- 172.21.15.6:0/1705203468 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7708083ef0 con 0x7f771015f020 2023-11-29T04:18:15.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.317+0000 7f770f7fe640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f76fc066470 0x7f76fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:15.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.321+0000 7f770f7fe640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f76fc066470 0x7f76fc068930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7704009d50 tx=0x7f77040090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:15.333+0000 7f76f7fff640 1 -- 172.21.15.6:0/1705203468 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7708051870 con 0x7f771015f020 2023-11-29T04:18:17.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.021+0000 7f76f5ffb640 1 -- 172.21.15.6:0/1705203468 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7710144b60 con 0x7f76fc066470 2023-11-29T04:18:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.049+0000 7f76f7fff640 1 -- 172.21.15.6:0/1705203468 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49547 (secure 0 0 0) 0x7f77040099a0 con 0x7f76fc066470 2023-11-29T04:18:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:18:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-29T04:18:17.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.061+0000 7f76f5ffb640 1 -- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f76fc066470 msgr2=0x7f76fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:17.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.061+0000 7f76f5ffb640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f76fc066470 0x7f76fc068930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7704009d50 tx=0x7f77040090e0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.061+0000 7f76f5ffb640 1 -- 172.21.15.6:0/1705203468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771015f020 msgr2=0x7f771015a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:17.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.061+0000 7f76f5ffb640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771015f020 0x7f771015a2d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f770800bcc0 tx=0x7f770800a650 comp rx=0 tx=0).stop 2023-11-29T04:18:17.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.065+0000 7f76f5ffb640 1 -- 172.21.15.6:0/1705203468 shutdown_connections 2023-11-29T04:18:17.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.065+0000 7f76f5ffb640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f76fc066470 0x7f76fc068930 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.065+0000 7f76f5ffb640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771015f020 0x7f771015a2d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.065+0000 7f76f5ffb640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7710144780 0x7f77101fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.065+0000 7f76f5ffb640 1 --2- 172.21.15.6:0/1705203468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77100718c0 0x7f7710153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.065+0000 7f76f5ffb640 1 -- 172.21.15.6:0/1705203468 >> 172.21.15.6:0/1705203468 conn(0x7f77100b0b00 msgr2=0x7f7710140e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:17.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.069+0000 7f76f5ffb640 1 -- 172.21.15.6:0/1705203468 shutdown_connections 2023-11-29T04:18:17.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.073+0000 7f76f5ffb640 1 -- 172.21.15.6:0/1705203468 wait complete. 2023-11-29T04:18:17.150 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":12929,"stamp":"2023-11-29T04:18:16.626991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":25161152,"kb_used_data":13991920,"kb_used_omap":4861,"kb_used_meta":10992962,"kb_avail":729813568,"statfs":{"total":773094113280,"available":747329093632,"internally_reserved":0,"allocated":14327726080,"data_stored":14295546926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4978608,"internal_metadata":11256793168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":935,"apply_latency_ms":935,"commit_latency_ns":935000000,"apply_latency_ns":935000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23228427017,"num_objects":-21177,"num_object_clones":0,"num_object_copies":-42354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21177,"num_whiteouts":0,"num_read":-1834801,"num_read_kb":-129666032,"num_write":-6589495,"num_write_kb":-162736096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.024186"},"pg_stats":[{"pgid":"1.0","version":"34'161","reported_seq":446,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-29T04:18:05.452717+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-29T04:18:05.452717+0000","last_peered":"2023-11-29T04:18:05.452717+0000","last_clean":"2023-11-29T04:18:05.452717+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-29T04:18:05.452717+0000","last_undegraded":"2023-11-29T04:18:05.452717+0000","last_fullsized":"2023-11-29T04:18:05.452717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514603,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4422588,"kb_used_data":2824368,"kb_used_omap":22,"kb_used_meta":1598185,"kb_avail":89949252,"statfs":{"total":96636764160,"available":92108034048,"internally_reserved":0,"allocated":2892152832,"data_stored":2885392958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22957,"internal_metadata":1636542035},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.516,"15min":1.577},"min":{"1min":0.51900000000000002,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":14.651,"5min":14.651,"15min":14.651},"last":3.5049999999999999},{"interface":"front","average":{"1min":2.395,"5min":1.9710000000000001,"15min":1.706},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.312},"max":{"1min":16.303000000000001,"5min":16.303000000000001,"15min":16.303000000000001},"last":1.0249999999999999}]},{"osd":1,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.673,"15min":1.6839999999999999},"min":{"1min":0.57799999999999996,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":4.2519999999999998,"5min":7.9900000000000002,"15min":28.478999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.675,"15min":1.665},"min":{"1min":0.52500000000000002,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":8.0099999999999998,"5min":8.3539999999999992,"15min":28.408000000000001},"last":1.234}]},{"osd":2,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":2.6880000000000002,"5min":2.2650000000000001,"15min":1.764},"min":{"1min":0.64800000000000002,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":19.091999999999999,"5min":47,"15min":47},"last":0.78700000000000003},{"interface":"front","average":{"1min":3.0049999999999999,"5min":1.8799999999999999,"15min":1.806},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":24.178000000000001,"5min":24.178000000000001,"15min":24.178000000000001},"last":2.6850000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":2.157,"15min":1.9339999999999999},"min":{"1min":0.65400000000000003,"5min":0.496,"15min":0.42199999999999999},"max":{"1min":9.0839999999999996,"5min":46.820999999999998,"15min":46.820999999999998},"last":2.4900000000000002},{"interface":"front","average":{"1min":2.2690000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"min":{"1min":0.52200000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":9.7899999999999991,"5min":9.7899999999999991,"15min":31.053000000000001},"last":6.4909999999999997}]},{"osd":4,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.026,"15min":0.77300000000000002},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":7.4720000000000004,"5min":29.809000000000001,"15min":29.809000000000001},"last":0.373},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1599999999999999,"15min":0.84099999999999997},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.6140000000000008,"5min":46.726999999999997,"15min":46.726999999999997},"last":0.57799999999999996}]},{"osd":5,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":0.92600000000000005,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":8.1720000000000006,"5min":16.276,"15min":16.276},"last":0.501},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.208,"15min":0.90200000000000002},"min":{"1min":0.52000000000000002,"5min":0.39300000000000002,"15min":0.371},"max":{"1min":12.036,"5min":32.847000000000001,"15min":32.847000000000001},"last":0.42399999999999999}]},{"osd":6,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.42899999999999999},"max":{"1min":4.0759999999999996,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.194,"15min":0.89300000000000002},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.41299999999999998},"max":{"1min":1.417,"5min":46.865000000000002,"15min":46.865000000000002},"last":0.443}]}]},{"osd":6,"up_from":15,"seq":64424514606,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1579824,"kb_used_data":30820,"kb_used_omap":415,"kb_used_meta":1548576,"kb_avail":92792016,"statfs":{"total":96636764160,"available":95019024384,"internally_reserved":0,"allocated":31559680,"data_stored":31183451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":425474,"internal_metadata":1585742334},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":117,"apply_latency_ms":117,"commit_latency_ns":117000000,"apply_latency_ns":117000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":4.9569999999999999,"5min":8.9809999999999999,"15min":9.7270000000000003},"last":11.984},{"interface":"front","average":{"1min":1.7310000000000001,"5min":1.6619999999999999,"15min":1.5780000000000001},"min":{"1min":0.432,"5min":0.39700000000000002,"15min":0.33600000000000002},"max":{"1min":7.1079999999999997,"5min":13.32,"15min":13.32},"last":12.198}]},{"osd":1,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.78,"15min":1.6579999999999999},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.373},"max":{"1min":7.04,"5min":21.614999999999998,"15min":21.614999999999998},"last":8.3989999999999991},{"interface":"front","average":{"1min":1.597,"5min":1.5820000000000001,"15min":1.8340000000000001},"min":{"1min":0.43099999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":7.218,"5min":12.239000000000001,"15min":12.603999999999999},"last":7.8689999999999998}]},{"osd":2,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":1.712,"15min":1.7110000000000001},"min":{"1min":0.50800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":6.8840000000000003,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":7.8179999999999996},{"interface":"front","average":{"1min":1.8839999999999999,"5min":1.851,"15min":1.621},"min":{"1min":0.66900000000000004,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":6.0659999999999998,"5min":7.5330000000000004,"15min":9.4369999999999994},"last":0.97999999999999998}]},{"osd":3,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.72,"15min":1.7030000000000001},"min":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.48799999999999999},"max":{"1min":4.0419999999999998,"5min":12.911,"15min":12.911},"last":4.0119999999999996},{"interface":"front","average":{"1min":2.1760000000000002,"5min":1.8160000000000001,"15min":1.8049999999999999},"min":{"1min":0.58899999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":6.9800000000000004,"5min":21.228999999999999,"15min":21.228999999999999},"last":2.2080000000000002}]},{"osd":4,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.71599999999999997,"15min":0.65100000000000002},"min":{"1min":0.42699999999999999,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":2.2810000000000001,"5min":8.9100000000000001,"15min":8.9100000000000001},"last":3.4889999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":1.631,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":0.72199999999999998}]},{"osd":5,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.85699999999999998,"15min":0.73499999999999999},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":2.0129999999999999,"5min":16.655000000000001,"15min":16.655000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.85799999999999998,"15min":0.77200000000000002},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.38100000000000001},"max":{"1min":2.786,"5min":9.2260000000000009,"15min":9.2260000000000009},"last":3.5409999999999999}]},{"osd":7,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.81899999999999995,"15min":0.753},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":4.4400000000000004,"5min":7.4299999999999997,"15min":7.4299999999999997},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.90900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.0590000000000002,"5min":16.710000000000001,"15min":16.710000000000001},"last":0.56299999999999994}]}]},{"osd":5,"up_from":15,"seq":64424514604,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4458596,"kb_used_data":2926936,"kb_used_omap":130,"kb_used_meta":1531517,"kb_avail":89913244,"statfs":{"total":96636764160,"available":92071161856,"internally_reserved":0,"allocated":2997182464,"data_stored":2990876148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":133284,"internal_metadata":1568274268},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.361,"15min":1.375},"min":{"1min":0.57099999999999995,"5min":0.379,"15min":0.309},"max":{"1min":3.9790000000000001,"5min":6.3399999999999999,"15min":7.6769999999999996},"last":9.1609999999999996},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.2869999999999999,"15min":1.45},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.2759999999999998,"5min":6.3650000000000002,"15min":6.8579999999999997},"last":8.8079999999999998}]},{"osd":1,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.3580000000000001,"15min":1.544},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":6.0599999999999996,"5min":7.5730000000000004,"15min":50.093000000000004},"last":8.7729999999999997},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.3740000000000001,"15min":1.768},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":6.9809999999999999,"5min":6.9809999999999999,"15min":49.384},"last":4.6459999999999999}]},{"osd":2,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5649999999999999,"15min":1.8799999999999999},"min":{"1min":0.58799999999999997,"5min":0.45800000000000002,"15min":0.36699999999999999},"max":{"1min":6.181,"5min":8.9489999999999998,"15min":50.744},"last":13.563000000000001},{"interface":"front","average":{"1min":1.768,"5min":1.587,"15min":1.879},"min":{"1min":0.48699999999999999,"5min":0.439,"15min":0.437},"max":{"1min":7.0979999999999999,"5min":9.3179999999999996,"15min":49.237000000000002},"last":12.554}]},{"osd":3,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.575,"15min":1.893},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.41999999999999998},"max":{"1min":6.4779999999999998,"5min":6.4779999999999998,"15min":11.491},"last":5.4720000000000004},{"interface":"front","average":{"1min":1.667,"5min":1.6419999999999999,"15min":1.645},"min":{"1min":0.56000000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":6.3170000000000002,"5min":6.4989999999999997,"15min":8.1600000000000001},"last":12.49}]},{"osd":4,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.41199999999999998,"5min":0.34100000000000003,"15min":0.32800000000000001},"max":{"1min":0.85599999999999998,"5min":2.3410000000000002,"15min":3.7719999999999998},"last":4.3099999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.70499999999999996,"15min":0.67700000000000005},"min":{"1min":0.442,"5min":0.379,"15min":0.373},"max":{"1min":1.234,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":3.5150000000000001}]},{"osd":6,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.755,"15min":0.70499999999999996},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":6.3499999999999996,"5min":6.3499999999999996,"15min":6.3499999999999996},"last":5.1989999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70599999999999996,"15min":0.69699999999999995},"min":{"1min":0.50700000000000001,"5min":0.434,"15min":0.41799999999999998},"max":{"1min":1.2929999999999999,"5min":2.387,"15min":3.8730000000000002},"last":4.7000000000000002}]},{"osd":7,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.74199999999999999},"min":{"1min":0.502,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1919999999999999,"5min":2.6179999999999999,"15min":4.032},"last":4.0069999999999997},{"interface":"front","average":{"1min":1.014,"5min":0.81299999999999994,"15min":0.77000000000000002},"min":{"1min":0.54500000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":6.2220000000000004,"5min":6.2220000000000004,"15min":6.2220000000000004},"last":8.7210000000000001}]}]},{"osd":4,"up_from":15,"seq":64424514606,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1626020,"kb_used_data":412,"kb_used_omap":1141,"kb_used_meta":1624458,"kb_avail":92745820,"statfs":{"total":96636764160,"available":94971719680,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1169084,"internal_metadata":1663445316},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":210,"apply_latency_ms":210,"commit_latency_ns":210000000,"apply_latency_ns":210000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":1.736,"15min":1.554},"min":{"1min":0.379,"5min":0.35199999999999998,"15min":0.307},"max":{"1min":11.618,"5min":11.618,"15min":11.839},"last":2.7109999999999999},{"interface":"front","average":{"1min":2.153,"5min":1.857,"15min":1.7769999999999999},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.34000000000000002},"max":{"1min":7.359,"5min":10.318,"15min":10.318},"last":6.6980000000000004}]},{"osd":1,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.476,"15min":1.825},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.851,"5min":26.338000000000001,"15min":26.338000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.774,"15min":1.8520000000000001},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.1449999999999996,"5min":25.989000000000001,"15min":25.989000000000001},"last":1.6879999999999999}]},{"osd":2,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":1.653,"15min":1.623},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.3420000000000005,"5min":9.3420000000000005,"15min":9.6120000000000001},"last":1.288},{"interface":"front","average":{"1min":2.3239999999999998,"5min":1.6679999999999999,"15min":1.6499999999999999},"min":{"1min":0.55600000000000005,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":6.4880000000000004,"5min":6.5049999999999999,"15min":12.461},"last":1.4990000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":2.4089999999999998,"5min":1.895,"15min":1.635},"min":{"1min":0.67400000000000004,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":8.4030000000000005,"5min":8.4030000000000005,"15min":8.4030000000000005},"last":1.931},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5229999999999999,"15min":1.7589999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.6580000000000004,"5min":8.6799999999999997,"15min":12.52},"last":3.0489999999999999}]},{"osd":5,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.61599999999999999,"15min":0.59099999999999997},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.34100000000000003},"max":{"1min":0.871,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.452},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.33200000000000002},"max":{"1min":0.71099999999999997,"5min":3.802,"15min":3.802},"last":1.4330000000000001}]},{"osd":6,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.72599999999999998,"15min":0.68600000000000005},"min":{"1min":0.44400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.7060000000000004,"5min":4.7060000000000004,"15min":4.7060000000000004},"last":1.538}]},{"osd":7,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.73499999999999999,"15min":0.69699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.373},"max":{"1min":0.99399999999999999,"5min":4.077,"15min":4.077},"last":1.385},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.78100000000000003,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.40799999999999997},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.327}]}]},{"osd":2,"up_from":15,"seq":64424514570,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3564716,"kb_used_data":2399520,"kb_used_omap":339,"kb_used_meta":1164844,"kb_avail":90807124,"statfs":{"total":96636764160,"available":92986494976,"internally_reserved":0,"allocated":2457108480,"data_stored":2451767200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":347851,"internal_metadata":1192800565},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.3740000000000001,"5min":2.8940000000000001,"15min":2.8780000000000001},"min":{"1min":0.74099999999999999,"5min":0.45800000000000002,"15min":0.45500000000000002},"max":{"1min":4.7409999999999997,"5min":33.073,"15min":33.073},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.645,"5min":3.3969999999999998,"15min":3.1240000000000001},"min":{"1min":0.745,"5min":0.434,"15min":0.434},"max":{"1min":6.931,"5min":37.037999999999997,"15min":37.037999999999997},"last":1.002}]},{"osd":1,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":3.0190000000000001,"15min":3.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.60999999999999999,"15min":0.41299999999999998},"max":{"1min":5.7110000000000003,"5min":12.577999999999999,"15min":17.945},"last":0.83499999999999996},{"interface":"front","average":{"1min":2.9740000000000002,"5min":3.5499999999999998,"15min":3.2200000000000002},"min":{"1min":0.82899999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":7.7229999999999999,"5min":16.536000000000001,"15min":18.667000000000002},"last":1.752}]},{"osd":3,"last update":"Wed Nov 29 04:17:15 2023","interfaces":[{"interface":"back","average":{"1min":2.1659999999999999,"5min":2.73,"15min":2.944},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.40699999999999997},"max":{"1min":4.3579999999999997,"5min":10.836,"15min":21.995000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":2.677,"5min":2.8149999999999999,"15min":3.0979999999999999},"min":{"1min":0.76100000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":16.334,"5min":16.334,"15min":17.504999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.1480000000000001,"5min":2.6059999999999999,"15min":2.4910000000000001},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":5.9139999999999997,"5min":11.319000000000001,"15min":18.219999999999999},"last":1.512},{"interface":"front","average":{"1min":1.605,"5min":2.2000000000000002,"15min":2.3559999999999999},"min":{"1min":0.65800000000000003,"5min":0.60799999999999998,"15min":0.51200000000000001},"max":{"1min":4.0629999999999997,"5min":10.489000000000001,"15min":19.183},"last":0.90900000000000003}]},{"osd":5,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":2.3450000000000002,"15min":2.5230000000000001},"min":{"1min":0.71999999999999997,"5min":0.624,"15min":0.433},"max":{"1min":4.2610000000000001,"5min":15.224,"15min":49.899000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":2.5219999999999998,"5min":2.7029999999999998,"15min":2.7770000000000001},"min":{"1min":0.67500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":6.0439999999999996,"5min":11.461,"15min":50.293999999999997},"last":1.609}]},{"osd":6,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":2.3730000000000002,"15min":2.5630000000000002},"min":{"1min":0.77700000000000002,"5min":0.64400000000000002,"15min":0.56799999999999995},"max":{"1min":3.8530000000000002,"5min":10.648,"15min":20.477},"last":0.745},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.3540000000000001,"15min":2.5539999999999998},"min":{"1min":0.67900000000000005,"5min":0.65800000000000003,"15min":0.54500000000000004},"max":{"1min":4.4770000000000003,"5min":13.013999999999999,"15min":17.815999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.9590000000000001,"15min":2.802},"min":{"1min":0.88200000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":7.6349999999999998,"5min":11.571,"15min":18.341999999999999},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.8280000000000001,"5min":2.528,"15min":2.7029999999999998},"min":{"1min":0.71199999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.9630000000000001,"5min":10.747,"15min":21.225999999999999},"last":1.085}]}]},{"osd":3,"up_from":14,"seq":60129547258,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2607916,"kb_used_data":1492544,"kb_used_omap":1234,"kb_used_meta":1036781,"kb_avail":91763924,"statfs":{"total":96636764160,"available":93966258176,"internally_reserved":0,"allocated":1528365056,"data_stored":1524862234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1264471,"internal_metadata":1061663913},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":175,"apply_latency_ms":175,"commit_latency_ns":175000000,"apply_latency_ns":175000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":2.7749999999999999,"15min":2.9409999999999998},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.42299999999999999},"max":{"1min":6.2709999999999999,"5min":16.690000000000001,"15min":16.690000000000001},"last":8.2599999999999998},{"interface":"front","average":{"1min":2.411,"5min":2.6619999999999999,"15min":2.8340000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.32500000000000001},"max":{"1min":11.503,"5min":15.228,"15min":15.819000000000001},"last":7.2779999999999996}]},{"osd":1,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":4.4100000000000001,"5min":3.2480000000000002,"15min":3.2839999999999998},"min":{"1min":0.69099999999999995,"5min":0.66800000000000004,"15min":0.33200000000000002},"max":{"1min":45.505000000000003,"5min":45.505000000000003,"15min":45.505000000000003},"last":9.3219999999999992},{"interface":"front","average":{"1min":3.8759999999999999,"5min":2.9550000000000001,"15min":3.2989999999999999},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":14.897,"5min":14.897,"15min":40.087000000000003},"last":10.504}]},{"osd":2,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":3.5619999999999998,"5min":2.8580000000000001,"15min":3.3119999999999998},"min":{"1min":0.72399999999999998,"5min":0.56499999999999995,"15min":0.38400000000000001},"max":{"1min":10.923999999999999,"5min":14.907999999999999,"15min":39.954000000000001},"last":10.398999999999999},{"interface":"front","average":{"1min":3.2679999999999998,"5min":3.1899999999999999,"15min":3.4249999999999998},"min":{"1min":0.90100000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":7.5540000000000003,"5min":23.989000000000001,"15min":37.334000000000003},"last":11.295999999999999}]},{"osd":4,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":2.4380000000000002,"15min":2.3809999999999998},"min":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.47199999999999998},"max":{"1min":11.044,"5min":30.600999999999999,"15min":30.600999999999999},"last":7.4219999999999997},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.1459999999999999,"15min":2.4769999999999999},"min":{"1min":0.68899999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":8.2370000000000001,"5min":8.2370000000000001,"15min":16.803000000000001},"last":10.063000000000001}]},{"osd":5,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.069,"5min":2.6509999999999998,"15min":2.552},"min":{"1min":0.69699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":6.468,"5min":40.125,"15min":40.125},"last":9.5559999999999992},{"interface":"front","average":{"1min":2.552,"5min":2.6299999999999999,"15min":2.601},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":11.295999999999999,"5min":34.496000000000002,"15min":34.496000000000002},"last":7.5309999999999997}]},{"osd":6,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":3.246,"5min":2.29,"15min":2.617},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"max":{"1min":8.3320000000000007,"5min":8.6869999999999994,"15min":16.622},"last":10.183},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.6360000000000001,"15min":2.665},"min":{"1min":0.73599999999999999,"5min":0.67100000000000004,"15min":0.58799999999999997},"max":{"1min":6.5800000000000001,"5min":23.747,"15min":23.747},"last":9.4510000000000005}]},{"osd":7,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.6920000000000002,"5min":2.774,"15min":2.7829999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":11.409000000000001,"5min":38.837000000000003,"15min":38.837000000000003},"last":7.649},{"interface":"front","average":{"1min":3.399,"5min":2.5499999999999998,"15min":2.7749999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":8.423,"5min":9.0380000000000003,"15min":16.716000000000001},"last":10.292}]}]},{"osd":1,"up_from":14,"seq":60129547264,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4521820,"kb_used_data":2894716,"kb_used_omap":1246,"kb_used_meta":1531873,"kb_avail":89850020,"statfs":{"total":96636764160,"available":92006420480,"internally_reserved":0,"allocated":2964189184,"data_stored":2957964719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1275937,"internal_metadata":1568638943},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":162,"apply_latency_ms":162,"commit_latency_ns":162000000,"apply_latency_ns":162000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":3.6419999999999999,"5min":2.9140000000000001,"15min":3.093},"min":{"1min":0.442,"5min":0.442,"15min":0.30599999999999999},"max":{"1min":10.551,"5min":10.551,"15min":18.100000000000001},"last":10.994},{"interface":"front","average":{"1min":4.1130000000000004,"5min":2.9510000000000001,"15min":2.8290000000000002},"min":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.42699999999999999},"max":{"1min":43.956000000000003,"5min":43.956000000000003,"15min":43.956000000000003},"last":2.8580000000000001}]},{"osd":2,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":4.5250000000000004,"5min":3.1309999999999998,"15min":3.0139999999999998},"min":{"1min":0.63300000000000001,"5min":0.53200000000000003,"15min":0.53100000000000003},"max":{"1min":25.652000000000001,"5min":25.652000000000001,"15min":25.652000000000001},"last":7.0979999999999999},{"interface":"front","average":{"1min":4.1840000000000002,"5min":3.2389999999999999,"15min":3.0179999999999998},"min":{"1min":0.69599999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":43.795000000000002,"5min":43.795000000000002,"15min":43.795000000000002},"last":10.473000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":2.3090000000000002,"5min":2.5680000000000001,"15min":2.851},"min":{"1min":0.98699999999999999,"5min":0.56399999999999995,"15min":0.35299999999999998},"max":{"1min":8.5939999999999994,"5min":8.5939999999999994,"15min":13.419},"last":1.9950000000000001},{"interface":"front","average":{"1min":4.4390000000000001,"5min":3.5390000000000001,"15min":3.4969999999999999},"min":{"1min":0.84399999999999997,"5min":0.376,"15min":0.376},"max":{"1min":10.433,"5min":11.618,"15min":18.062000000000001},"last":3.6299999999999999}]},{"osd":4,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":2.5419999999999998,"5min":2.431,"15min":2.3380000000000001},"min":{"1min":0.628,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":11.483000000000001,"5min":11.483000000000001,"15min":11.483000000000001},"last":2.5030000000000001},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.0670000000000002,"15min":2.3069999999999999},"min":{"1min":0.59899999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":6.8940000000000001,"5min":6.8940000000000001,"15min":7.9050000000000002},"last":1.448}]},{"osd":5,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":4.0640000000000001,"5min":2.8479999999999999,"15min":2.589},"min":{"1min":0.755,"5min":0.46200000000000002,"15min":0.40500000000000003},"max":{"1min":26.135000000000002,"5min":26.135000000000002,"15min":26.135000000000002},"last":3.2810000000000001},{"interface":"front","average":{"1min":4.351,"5min":2.9049999999999998,"15min":2.6070000000000002},"min":{"1min":0.72299999999999998,"5min":0.63800000000000001,"15min":0.48999999999999999},"max":{"1min":44.347999999999999,"5min":44.347999999999999,"15min":44.347999999999999},"last":2.7559999999999998}]},{"osd":6,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":2.492,"5min":2.3650000000000002,"15min":2.5640000000000001},"min":{"1min":0.72699999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":8.1950000000000003,"5min":8.891,"15min":10.086},"last":1.5900000000000001},{"interface":"front","average":{"1min":3.7309999999999999,"5min":2.988,"15min":2.7869999999999999},"min":{"1min":0.79700000000000004,"5min":0.72399999999999998,"15min":0.56799999999999995},"max":{"1min":11.606,"5min":11.606,"15min":17.978999999999999},"last":3.423}]},{"osd":7,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":4.8120000000000003,"5min":3.0680000000000001,"15min":2.8809999999999998},"min":{"1min":0.83199999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":47.781999999999996,"5min":47.781999999999996,"15min":47.781999999999996},"last":1.8859999999999999},{"interface":"front","average":{"1min":4.391,"5min":3.1560000000000001,"15min":2.9239999999999999},"min":{"1min":0.879,"5min":0.76300000000000001,"15min":0.59999999999999998},"max":{"1min":25.777000000000001,"5min":25.777000000000001,"15min":25.777000000000001},"last":3.5259999999999998}]}]},{"osd":0,"up_from":14,"seq":60129547284,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2379672,"kb_used_data":1422604,"kb_used_omap":331,"kb_used_meta":956724,"kb_avail":91992168,"statfs":{"total":96636764160,"available":94199980032,"internally_reserved":0,"allocated":1456746496,"data_stored":1453334678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":339550,"internal_metadata":979685794},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":126,"apply_latency_ms":126,"commit_latency_ns":126000000,"apply_latency_ns":126000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.246,"5min":2.6349999999999998,"15min":2.9039999999999999},"min":{"1min":0.86299999999999999,"5min":0.629,"15min":0.27100000000000002},"max":{"1min":12.653,"5min":12.653,"15min":12.755000000000001},"last":8.3100000000000005},{"interface":"front","average":{"1min":3.448,"5min":2.7160000000000002,"15min":2.8239999999999998},"min":{"1min":0.63700000000000001,"5min":0.44400000000000001,"15min":0.38300000000000001},"max":{"1min":8.327,"5min":8.8640000000000008,"15min":9.8810000000000002},"last":15.050000000000001}]},{"osd":2,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.4540000000000002,"5min":2.6299999999999999,"15min":2.8090000000000002},"min":{"1min":0.74199999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.199999999999999,"5min":13.199999999999999,"15min":13.199999999999999},"last":12.109999999999999},{"interface":"front","average":{"1min":3.226,"5min":3.036,"15min":3.206},"min":{"1min":0.95999999999999996,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":8.6989999999999998,"5min":14.084,"15min":14.084},"last":4.6900000000000004}]},{"osd":3,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.8799999999999999,"5min":3.6680000000000001,"15min":3.5950000000000002},"min":{"1min":0.76000000000000001,"5min":0.53000000000000003,"15min":0.51800000000000002},"max":{"1min":12.099,"5min":33.881999999999998,"15min":33.881999999999998},"last":8.859},{"interface":"front","average":{"1min":3.831,"5min":3.3580000000000001,"15min":3.4860000000000002},"min":{"1min":1.032,"5min":0.42399999999999999,"15min":0.42299999999999999},"max":{"1min":13.071999999999999,"5min":35.034999999999997,"15min":35.034999999999997},"last":12.307}]},{"osd":4,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.7240000000000002,"5min":2.468,"15min":2.5179999999999998},"min":{"1min":0.82599999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":13.42,"5min":13.42,"15min":13.42},"last":8.4570000000000007},{"interface":"front","average":{"1min":3.2690000000000001,"5min":2.3290000000000002,"15min":2.504},"min":{"1min":0.78700000000000003,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":14.199,"5min":14.199,"15min":14.199},"last":11.987}]},{"osd":5,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":4.0570000000000004,"5min":2.6480000000000001,"15min":2.6859999999999999},"min":{"1min":1.4119999999999999,"5min":0.57099999999999995,"15min":0.52500000000000002},"max":{"1min":13.590999999999999,"5min":13.590999999999999,"15min":13.590999999999999},"last":8.641},{"interface":"front","average":{"1min":3.8410000000000002,"5min":2.5139999999999998,"15min":2.673},"min":{"1min":1.0569999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":14.314,"5min":14.314,"15min":14.314},"last":12.211}]},{"osd":6,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.4020000000000001,"5min":2.3889999999999998,"15min":2.5379999999999998},"min":{"1min":0.874,"5min":0.59999999999999998,"15min":0.58199999999999996},"max":{"1min":11.808,"5min":11.808,"15min":11.808},"last":1.0429999999999999},{"interface":"front","average":{"1min":3.4470000000000001,"5min":2.6720000000000002,"15min":2.7749999999999999},"min":{"1min":1.4239999999999999,"5min":0.63500000000000001,"15min":0.58899999999999997},"max":{"1min":12.901999999999999,"5min":12.901999999999999,"15min":12.901999999999999},"last":8.7599999999999998}]},{"osd":7,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.5449999999999999,"5min":2.5289999999999999,"15min":2.6680000000000001},"min":{"1min":1.0329999999999999,"5min":0.61899999999999999,"15min":0.61699999999999999},"max":{"1min":11.93,"5min":11.93,"15min":11.93},"last":1.1659999999999999},{"interface":"front","average":{"1min":3.6400000000000001,"5min":2.7290000000000001,"15min":2.8849999999999998},"min":{"1min":1.593,"5min":0.60399999999999998,"15min":0.55400000000000005},"max":{"1min":13.006,"5min":13.006,"15min":13.006},"last":27.364000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T04:18:17.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T04:18:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3525f62640 1 Processor -- start 2023-11-29T04:18:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3525f62640 1 -- start start 2023-11-29T04:18:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3525f62640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520161520 0x7f35200b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3525f62640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3520165070 0x7f35201654d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3525f62640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35200ae670 con 0x7f3520165a10 2023-11-29T04:18:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3525f62640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3520165ea0 con 0x7f3520165070 2023-11-29T04:18:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3525f62640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3520161900 con 0x7f3520161520 2023-11-29T04:18:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3524f60640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520161520 0x7f35200b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3524f60640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520161520 0x7f35200b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:55600/0 (socket says 172.21.15.6:55600) 2023-11-29T04:18:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3524f60640 1 -- 172.21.15.6:0/2159826474 learned_addr learned my addr 172.21.15.6:0/2159826474 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.917+0000 7f3525761640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3520165a10 0x7f35200abcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49628/0 (socket says 172.21.15.6:49628) 2023-11-29T04:18:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.921+0000 7f351ffff640 1 --2- 172.21.15.6:0/2159826474 >> v2:172.21.15.6:3300/0 conn(0x7f3520165070 0x7f35201654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.921+0000 7f3524f60640 1 -- 172.21.15.6:0/2159826474 >> v2:172.21.15.6:3300/0 conn(0x7f3520165070 msgr2=0x7f35201654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.921+0000 7f3524f60640 1 --2- 172.21.15.6:0/2159826474 >> v2:172.21.15.6:3300/0 conn(0x7f3520165070 0x7f35201654d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.921+0000 7f3524f60640 1 -- 172.21.15.6:0/2159826474 >> v1:172.21.15.6:6789/0 conn(0x7f3520165a10 legacy=0x7f35200abcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.921+0000 7f3524f60640 1 -- 172.21.15.6:0/2159826474 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35200ae0f0 con 0x7f3520161520 2023-11-29T04:18:17.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.949+0000 7f3524f60640 1 --2- 172.21.15.6:0/2159826474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520161520 0x7f35200b1ee0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3510009870 tx=0x7f351001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c7a2c415ff7005b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.949+0000 7f351f7fe640 1 -- 172.21.15.6:0/2159826474 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35100aa670 con 0x7f3520161520 2023-11-29T04:18:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.949+0000 7f351f7fe640 1 -- 172.21.15.6:0/2159826474 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35100aa7d0 con 0x7f3520161520 2023-11-29T04:18:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.949+0000 7f351f7fe640 1 -- 172.21.15.6:0/2159826474 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35100aa670 con 0x7f3520161520 2023-11-29T04:18:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.957+0000 7f3525f62640 1 -- 172.21.15.6:0/2159826474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520161520 msgr2=0x7f35200b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.957+0000 7f3525f62640 1 --2- 172.21.15.6:0/2159826474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520161520 0x7f35200b1ee0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3510009870 tx=0x7f351001c510 comp rx=0 tx=0).stop 2023-11-29T04:18:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.961+0000 7f3525f62640 1 -- 172.21.15.6:0/2159826474 shutdown_connections 2023-11-29T04:18:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.961+0000 7f3525f62640 1 --2- 172.21.15.6:0/2159826474 >> v2:172.21.15.6:3300/0 conn(0x7f3520165070 0x7f35201654d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.961+0000 7f3525f62640 1 --2- 172.21.15.6:0/2159826474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520161520 0x7f35200b1ee0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.961+0000 7f3525f62640 1 -- 172.21.15.6:0/2159826474 >> 172.21.15.6:0/2159826474 conn(0x7f35200cec20 msgr2=0x7f35200cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.965+0000 7f3525f62640 1 -- 172.21.15.6:0/2159826474 shutdown_connections 2023-11-29T04:18:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.965+0000 7f3525f62640 1 -- 172.21.15.6:0/2159826474 wait complete. 2023-11-29T04:18:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.965+0000 7f3525f62640 1 Processor -- start 2023-11-29T04:18:17.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.965+0000 7f3525f62640 1 -- start start 2023-11-29T04:18:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f3525f62640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3520161520 0x7f352020c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f3525f62640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3520165070 0x7f352020e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f3525f62640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520165a10 0x7f352020b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f3525f62640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35200ce640 con 0x7f3520161520 2023-11-29T04:18:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f3525f62640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35200ce360 con 0x7f3520165070 2023-11-29T04:18:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f3525f62640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352015c9c0 con 0x7f3520165a10 2023-11-29T04:18:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f351ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3520165070 0x7f352020e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f351ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3520165070 0x7f352020e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:57060/0 (socket says 172.21.15.6:57060) 2023-11-29T04:18:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f3525761640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520165a10 0x7f352020b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f351ffff640 1 -- 172.21.15.6:0/1085159117 learned_addr learned my addr 172.21.15.6:0/1085159117 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f3524f60640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3520161520 0x7f352020c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f351ffff640 1 -- 172.21.15.6:0/1085159117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520165a10 msgr2=0x7f352020b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f351ffff640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520165a10 0x7f352020b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f351ffff640 1 -- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3520161520 msgr2=0x7f352020c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f351ffff640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3520161520 0x7f352020c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f351ffff640 1 -- 172.21.15.6:0/1085159117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100094d0 con 0x7f3520165070 2023-11-29T04:18:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f3525761640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520165a10 0x7f352020b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.977+0000 7f351ffff640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3520165070 0x7f352020e3b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3514007e40 tx=0x7f351400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.981+0000 7f351d7fa640 1 -- 172.21.15.6:0/1085159117 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514014620 con 0x7f3520165070 2023-11-29T04:18:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.981+0000 7f351d7fa640 1 -- 172.21.15.6:0/1085159117 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351400ee90 con 0x7f3520165070 2023-11-29T04:18:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.981+0000 7f351d7fa640 1 -- 172.21.15.6:0/1085159117 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35140149c0 con 0x7f3520165070 2023-11-29T04:18:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.981+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352015cca0 con 0x7f3520165070 2023-11-29T04:18:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.985+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352020e8f0 con 0x7f3520165070 2023-11-29T04:18:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.993+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352009d030 con 0x7f3520165070 2023-11-29T04:18:17.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:17.997+0000 7f351d7fa640 1 -- 172.21.15.6:0/1085159117 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3514014b20 con 0x7f3520165070 2023-11-29T04:18:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.005+0000 7f351d7fa640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f350c066470 0x7f350c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.005+0000 7f351d7fa640 1 -- 172.21.15.6:0/1085159117 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3514085d50 con 0x7f3520165070 2023-11-29T04:18:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.009+0000 7f351d7fa640 1 -- 172.21.15.6:0/1085159117 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3514089060 con 0x7f3520165070 2023-11-29T04:18:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.013+0000 7f3524f60640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f350c066470 0x7f350c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.021+0000 7f3524f60640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f350c066470 0x7f350c068930 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f35100ae000 tx=0x7f35100a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.741+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3520073f20 con 0x7f350c066470 2023-11-29T04:18:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.757+0000 7f351d7fa640 1 -- 172.21.15.6:0/1085159117 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49458 (secure 0 0 0) 0x7f3520073f20 con 0x7f350c066470 2023-11-29T04:18:18.760 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:18:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-29T04:18:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f350c066470 msgr2=0x7f350c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f350c066470 0x7f350c068930 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f35100ae000 tx=0x7f35100a7000 comp rx=0 tx=0).stop 2023-11-29T04:18:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3520165070 msgr2=0x7f352020e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3520165070 0x7f352020e3b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3514007e40 tx=0x7f351400e4b0 comp rx=0 tx=0).stop 2023-11-29T04:18:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 shutdown_connections 2023-11-29T04:18:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f350c066470 0x7f350c068930 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3520165a10 0x7f352020b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3520165070 0x7f352020e3b0 secure :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f3514007e40 tx=0x7f351400e4b0 comp rx=0 tx=0).stop 2023-11-29T04:18:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 --2- 172.21.15.6:0/1085159117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3520161520 0x7f352020c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 >> 172.21.15.6:0/1085159117 conn(0x7f35200cec20 msgr2=0x7f352006d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 shutdown_connections 2023-11-29T04:18:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:18.769+0000 7f3525f62640 1 -- 172.21.15.6:0/1085159117 wait complete. 2023-11-29T04:18:18.852 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":12930,"stamp":"2023-11-29T04:18:18.630793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":16614020,"kb_used_data":5530176,"kb_used_omap":4861,"kb_used_meta":10976322,"kb_avail":738360700,"statfs":{"total":773094113280,"available":756081356800,"internally_reserved":0,"allocated":5662900224,"data_stored":5648987890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4978608,"internal_metadata":11239753808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2847,"apply_latency_ms":2847,"commit_latency_ns":2847000000,"apply_latency_ns":2847000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.489787"},"pg_stats":[{"pgid":"1.0","version":"34'161","reported_seq":446,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-29T04:18:05.452717+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-29T04:18:05.452717+0000","last_peered":"2023-11-29T04:18:05.452717+0000","last_clean":"2023-11-29T04:18:05.452717+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-29T04:18:05.452717+0000","last_undegraded":"2023-11-29T04:18:05.452717+0000","last_fullsized":"2023-11-29T04:18:05.452717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514604,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1632540,"kb_used_data":9084,"kb_used_omap":22,"kb_used_meta":1598185,"kb_avail":92739300,"statfs":{"total":96636764160,"available":94965043200,"internally_reserved":0,"allocated":9302016,"data_stored":9036474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22957,"internal_metadata":1636542035},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":259,"apply_latency_ms":259,"commit_latency_ns":259000000,"apply_latency_ns":259000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.516,"15min":1.577},"min":{"1min":0.51900000000000002,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":14.651,"5min":14.651,"15min":14.651},"last":2.1160000000000001},{"interface":"front","average":{"1min":2.395,"5min":1.9710000000000001,"15min":1.706},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.312},"max":{"1min":16.303000000000001,"5min":16.303000000000001,"15min":16.303000000000001},"last":1.349}]},{"osd":1,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.673,"15min":1.6839999999999999},"min":{"1min":0.57799999999999996,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":4.2519999999999998,"5min":7.9900000000000002,"15min":28.478999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.675,"15min":1.665},"min":{"1min":0.52500000000000002,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":8.0099999999999998,"5min":8.3539999999999992,"15min":28.408000000000001},"last":2.3660000000000001}]},{"osd":2,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":2.6880000000000002,"5min":2.2650000000000001,"15min":1.764},"min":{"1min":0.64800000000000002,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":19.091999999999999,"5min":47,"15min":47},"last":0.81100000000000005},{"interface":"front","average":{"1min":3.0049999999999999,"5min":1.8799999999999999,"15min":1.806},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":24.178000000000001,"5min":24.178000000000001,"15min":24.178000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":2.157,"15min":1.9339999999999999},"min":{"1min":0.65400000000000003,"5min":0.496,"15min":0.42199999999999999},"max":{"1min":9.0839999999999996,"5min":46.820999999999998,"15min":46.820999999999998},"last":1.121},{"interface":"front","average":{"1min":2.2690000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"min":{"1min":0.52200000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":9.7899999999999991,"5min":9.7899999999999991,"15min":31.053000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.026,"15min":0.77300000000000002},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":7.4720000000000004,"5min":29.809000000000001,"15min":29.809000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1599999999999999,"15min":0.84099999999999997},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.6140000000000008,"5min":46.726999999999997,"15min":46.726999999999997},"last":0.85499999999999998}]},{"osd":5,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":0.92600000000000005,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":8.1720000000000006,"5min":16.276,"15min":16.276},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.208,"15min":0.90200000000000002},"min":{"1min":0.52000000000000002,"5min":0.39300000000000002,"15min":0.371},"max":{"1min":12.036,"5min":32.847000000000001,"15min":32.847000000000001},"last":0.622}]},{"osd":6,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.42899999999999999},"max":{"1min":4.0759999999999996,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.194,"15min":0.89300000000000002},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.41299999999999998},"max":{"1min":1.417,"5min":46.865000000000002,"15min":46.865000000000002},"last":0.996}]}]},{"osd":6,"up_from":15,"seq":64424514607,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1549412,"kb_used_data":412,"kb_used_omap":415,"kb_used_meta":1548576,"kb_avail":92822428,"statfs":{"total":96636764160,"available":95050166272,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":425474,"internal_metadata":1585742334},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1376,"apply_latency_ms":1376,"commit_latency_ns":1376000000,"apply_latency_ns":1376000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":4.9569999999999999,"5min":8.9809999999999999,"15min":9.7270000000000003},"last":8.2270000000000003},{"interface":"front","average":{"1min":1.7310000000000001,"5min":1.6619999999999999,"15min":1.5780000000000001},"min":{"1min":0.432,"5min":0.39700000000000002,"15min":0.33600000000000002},"max":{"1min":7.1079999999999997,"5min":13.32,"15min":13.32},"last":4.7409999999999997}]},{"osd":1,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.78,"15min":1.6579999999999999},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.373},"max":{"1min":7.04,"5min":21.614999999999998,"15min":21.614999999999998},"last":12.563000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.5820000000000001,"15min":1.8340000000000001},"min":{"1min":0.43099999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":7.218,"5min":12.239000000000001,"15min":12.603999999999999},"last":1.2689999999999999}]},{"osd":2,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":1.712,"15min":1.7110000000000001},"min":{"1min":0.50800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":6.8840000000000003,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":2.7490000000000001},{"interface":"front","average":{"1min":1.8839999999999999,"5min":1.851,"15min":1.621},"min":{"1min":0.66900000000000004,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":6.0659999999999998,"5min":7.5330000000000004,"15min":9.4369999999999994},"last":8.1340000000000003}]},{"osd":3,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.72,"15min":1.7030000000000001},"min":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.48799999999999999},"max":{"1min":4.0419999999999998,"5min":12.911,"15min":12.911},"last":2.1040000000000001},{"interface":"front","average":{"1min":2.1760000000000002,"5min":1.8160000000000001,"15min":1.8049999999999999},"min":{"1min":0.58899999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":6.9800000000000004,"5min":21.228999999999999,"15min":21.228999999999999},"last":8.7050000000000001}]},{"osd":4,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.71599999999999997,"15min":0.65100000000000002},"min":{"1min":0.42699999999999999,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":2.2810000000000001,"5min":8.9100000000000001,"15min":8.9100000000000001},"last":1.153},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":1.631,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":2.0569999999999999}]},{"osd":5,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.85699999999999998,"15min":0.73499999999999999},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":2.0129999999999999,"5min":16.655000000000001,"15min":16.655000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.85799999999999998,"15min":0.77200000000000002},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.38100000000000001},"max":{"1min":2.786,"5min":9.2260000000000009,"15min":9.2260000000000009},"last":1.4430000000000001}]},{"osd":7,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.81899999999999995,"15min":0.753},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":4.4400000000000004,"5min":7.4299999999999997,"15min":7.4299999999999997},"last":2.008},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.90900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.0590000000000002,"5min":16.710000000000001,"15min":16.710000000000001},"last":1.484}]}]},{"osd":5,"up_from":15,"seq":64424514605,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1515428,"kb_used_data":412,"kb_used_omap":130,"kb_used_meta":1514877,"kb_avail":92856412,"statfs":{"total":96636764160,"available":95084965888,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":133284,"internal_metadata":1551234908},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":294,"apply_latency_ms":294,"commit_latency_ns":294000000,"apply_latency_ns":294000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.361,"15min":1.375},"min":{"1min":0.57099999999999995,"5min":0.379,"15min":0.309},"max":{"1min":3.9790000000000001,"5min":6.3399999999999999,"15min":7.6769999999999996},"last":1.244},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.2869999999999999,"15min":1.45},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.2759999999999998,"5min":6.3650000000000002,"15min":6.8579999999999997},"last":7.9029999999999996}]},{"osd":1,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.3580000000000001,"15min":1.544},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":6.0599999999999996,"5min":7.5730000000000004,"15min":50.093000000000004},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.3740000000000001,"15min":1.768},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":6.9809999999999999,"5min":6.9809999999999999,"15min":49.384},"last":12.132}]},{"osd":2,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5649999999999999,"15min":1.8799999999999999},"min":{"1min":0.58799999999999997,"5min":0.45800000000000002,"15min":0.36699999999999999},"max":{"1min":6.181,"5min":8.9489999999999998,"15min":50.744},"last":3.3980000000000001},{"interface":"front","average":{"1min":1.768,"5min":1.587,"15min":1.879},"min":{"1min":0.48699999999999999,"5min":0.439,"15min":0.437},"max":{"1min":7.0979999999999999,"5min":9.3179999999999996,"15min":49.237000000000002},"last":0.95899999999999996}]},{"osd":3,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.575,"15min":1.893},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.41999999999999998},"max":{"1min":6.4779999999999998,"5min":6.4779999999999998,"15min":11.491},"last":3.3079999999999998},{"interface":"front","average":{"1min":1.667,"5min":1.6419999999999999,"15min":1.645},"min":{"1min":0.56000000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":6.3170000000000002,"5min":6.4989999999999997,"15min":8.1600000000000001},"last":3.4169999999999998}]},{"osd":4,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.41199999999999998,"5min":0.34100000000000003,"15min":0.32800000000000001},"max":{"1min":0.85599999999999998,"5min":2.3410000000000002,"15min":3.7719999999999998},"last":2.077},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.70499999999999996,"15min":0.67700000000000005},"min":{"1min":0.442,"5min":0.379,"15min":0.373},"max":{"1min":1.234,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":3.258}]},{"osd":6,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.755,"15min":0.70499999999999996},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":6.3499999999999996,"5min":6.3499999999999996,"15min":6.3499999999999996},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70599999999999996,"15min":0.69699999999999995},"min":{"1min":0.50700000000000001,"5min":0.434,"15min":0.41799999999999998},"max":{"1min":1.2929999999999999,"5min":2.387,"15min":3.8730000000000002},"last":2.1200000000000001}]},{"osd":7,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.74199999999999999},"min":{"1min":0.502,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1919999999999999,"5min":2.6179999999999999,"15min":4.032},"last":3.3490000000000002},{"interface":"front","average":{"1min":1.014,"5min":0.81299999999999994,"15min":0.77000000000000002},"min":{"1min":0.54500000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":6.2220000000000004,"5min":6.2220000000000004,"15min":6.2220000000000004},"last":1.2809999999999999}]}]},{"osd":4,"up_from":15,"seq":64424514606,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1626020,"kb_used_data":412,"kb_used_omap":1141,"kb_used_meta":1624458,"kb_avail":92745820,"statfs":{"total":96636764160,"available":94971719680,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1169084,"internal_metadata":1663445316},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":210,"apply_latency_ms":210,"commit_latency_ns":210000000,"apply_latency_ns":210000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":1.736,"15min":1.554},"min":{"1min":0.379,"5min":0.35199999999999998,"15min":0.307},"max":{"1min":11.618,"5min":11.618,"15min":11.839},"last":2.7109999999999999},{"interface":"front","average":{"1min":2.153,"5min":1.857,"15min":1.7769999999999999},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.34000000000000002},"max":{"1min":7.359,"5min":10.318,"15min":10.318},"last":6.6980000000000004}]},{"osd":1,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.476,"15min":1.825},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.851,"5min":26.338000000000001,"15min":26.338000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.774,"15min":1.8520000000000001},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.1449999999999996,"5min":25.989000000000001,"15min":25.989000000000001},"last":1.6879999999999999}]},{"osd":2,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":1.653,"15min":1.623},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.3420000000000005,"5min":9.3420000000000005,"15min":9.6120000000000001},"last":1.288},{"interface":"front","average":{"1min":2.3239999999999998,"5min":1.6679999999999999,"15min":1.6499999999999999},"min":{"1min":0.55600000000000005,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":6.4880000000000004,"5min":6.5049999999999999,"15min":12.461},"last":1.4990000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":2.4089999999999998,"5min":1.895,"15min":1.635},"min":{"1min":0.67400000000000004,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":8.4030000000000005,"5min":8.4030000000000005,"15min":8.4030000000000005},"last":1.931},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5229999999999999,"15min":1.7589999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.6580000000000004,"5min":8.6799999999999997,"15min":12.52},"last":3.0489999999999999}]},{"osd":5,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.61599999999999999,"15min":0.59099999999999997},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.34100000000000003},"max":{"1min":0.871,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.452},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.33200000000000002},"max":{"1min":0.71099999999999997,"5min":3.802,"15min":3.802},"last":1.4330000000000001}]},{"osd":6,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.72599999999999998,"15min":0.68600000000000005},"min":{"1min":0.44400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.7060000000000004,"5min":4.7060000000000004,"15min":4.7060000000000004},"last":1.538}]},{"osd":7,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.73499999999999999,"15min":0.69699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.373},"max":{"1min":0.99399999999999999,"5min":4.077,"15min":4.077},"last":1.385},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.78100000000000003,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.40799999999999997},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.327}]}]},{"osd":2,"up_from":15,"seq":64424514570,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3564716,"kb_used_data":2399520,"kb_used_omap":339,"kb_used_meta":1164844,"kb_avail":90807124,"statfs":{"total":96636764160,"available":92986494976,"internally_reserved":0,"allocated":2457108480,"data_stored":2451767200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":347851,"internal_metadata":1192800565},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.3740000000000001,"5min":2.8940000000000001,"15min":2.8780000000000001},"min":{"1min":0.74099999999999999,"5min":0.45800000000000002,"15min":0.45500000000000002},"max":{"1min":4.7409999999999997,"5min":33.073,"15min":33.073},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.645,"5min":3.3969999999999998,"15min":3.1240000000000001},"min":{"1min":0.745,"5min":0.434,"15min":0.434},"max":{"1min":6.931,"5min":37.037999999999997,"15min":37.037999999999997},"last":1.002}]},{"osd":1,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":3.0190000000000001,"15min":3.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.60999999999999999,"15min":0.41299999999999998},"max":{"1min":5.7110000000000003,"5min":12.577999999999999,"15min":17.945},"last":0.83499999999999996},{"interface":"front","average":{"1min":2.9740000000000002,"5min":3.5499999999999998,"15min":3.2200000000000002},"min":{"1min":0.82899999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":7.7229999999999999,"5min":16.536000000000001,"15min":18.667000000000002},"last":1.752}]},{"osd":3,"last update":"Wed Nov 29 04:17:15 2023","interfaces":[{"interface":"back","average":{"1min":2.1659999999999999,"5min":2.73,"15min":2.944},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.40699999999999997},"max":{"1min":4.3579999999999997,"5min":10.836,"15min":21.995000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":2.677,"5min":2.8149999999999999,"15min":3.0979999999999999},"min":{"1min":0.76100000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":16.334,"5min":16.334,"15min":17.504999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.1480000000000001,"5min":2.6059999999999999,"15min":2.4910000000000001},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":5.9139999999999997,"5min":11.319000000000001,"15min":18.219999999999999},"last":1.512},{"interface":"front","average":{"1min":1.605,"5min":2.2000000000000002,"15min":2.3559999999999999},"min":{"1min":0.65800000000000003,"5min":0.60799999999999998,"15min":0.51200000000000001},"max":{"1min":4.0629999999999997,"5min":10.489000000000001,"15min":19.183},"last":0.90900000000000003}]},{"osd":5,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":2.3450000000000002,"15min":2.5230000000000001},"min":{"1min":0.71999999999999997,"5min":0.624,"15min":0.433},"max":{"1min":4.2610000000000001,"5min":15.224,"15min":49.899000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":2.5219999999999998,"5min":2.7029999999999998,"15min":2.7770000000000001},"min":{"1min":0.67500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":6.0439999999999996,"5min":11.461,"15min":50.293999999999997},"last":1.609}]},{"osd":6,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":2.3730000000000002,"15min":2.5630000000000002},"min":{"1min":0.77700000000000002,"5min":0.64400000000000002,"15min":0.56799999999999995},"max":{"1min":3.8530000000000002,"5min":10.648,"15min":20.477},"last":0.745},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.3540000000000001,"15min":2.5539999999999998},"min":{"1min":0.67900000000000005,"5min":0.65800000000000003,"15min":0.54500000000000004},"max":{"1min":4.4770000000000003,"5min":13.013999999999999,"15min":17.815999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.9590000000000001,"15min":2.802},"min":{"1min":0.88200000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":7.6349999999999998,"5min":11.571,"15min":18.341999999999999},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.8280000000000001,"5min":2.528,"15min":2.7029999999999998},"min":{"1min":0.71199999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.9630000000000001,"5min":10.747,"15min":21.225999999999999},"last":1.085}]}]},{"osd":3,"up_from":14,"seq":60129547258,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2607916,"kb_used_data":1492544,"kb_used_omap":1234,"kb_used_meta":1036781,"kb_avail":91763924,"statfs":{"total":96636764160,"available":93966258176,"internally_reserved":0,"allocated":1528365056,"data_stored":1524862234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1264471,"internal_metadata":1061663913},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":175,"apply_latency_ms":175,"commit_latency_ns":175000000,"apply_latency_ns":175000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":2.7749999999999999,"15min":2.9409999999999998},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.42299999999999999},"max":{"1min":6.2709999999999999,"5min":16.690000000000001,"15min":16.690000000000001},"last":8.2599999999999998},{"interface":"front","average":{"1min":2.411,"5min":2.6619999999999999,"15min":2.8340000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.32500000000000001},"max":{"1min":11.503,"5min":15.228,"15min":15.819000000000001},"last":7.2779999999999996}]},{"osd":1,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":4.4100000000000001,"5min":3.2480000000000002,"15min":3.2839999999999998},"min":{"1min":0.69099999999999995,"5min":0.66800000000000004,"15min":0.33200000000000002},"max":{"1min":45.505000000000003,"5min":45.505000000000003,"15min":45.505000000000003},"last":9.3219999999999992},{"interface":"front","average":{"1min":3.8759999999999999,"5min":2.9550000000000001,"15min":3.2989999999999999},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":14.897,"5min":14.897,"15min":40.087000000000003},"last":10.504}]},{"osd":2,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":3.5619999999999998,"5min":2.8580000000000001,"15min":3.3119999999999998},"min":{"1min":0.72399999999999998,"5min":0.56499999999999995,"15min":0.38400000000000001},"max":{"1min":10.923999999999999,"5min":14.907999999999999,"15min":39.954000000000001},"last":10.398999999999999},{"interface":"front","average":{"1min":3.2679999999999998,"5min":3.1899999999999999,"15min":3.4249999999999998},"min":{"1min":0.90100000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":7.5540000000000003,"5min":23.989000000000001,"15min":37.334000000000003},"last":11.295999999999999}]},{"osd":4,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":2.4380000000000002,"15min":2.3809999999999998},"min":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.47199999999999998},"max":{"1min":11.044,"5min":30.600999999999999,"15min":30.600999999999999},"last":7.4219999999999997},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.1459999999999999,"15min":2.4769999999999999},"min":{"1min":0.68899999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":8.2370000000000001,"5min":8.2370000000000001,"15min":16.803000000000001},"last":10.063000000000001}]},{"osd":5,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.069,"5min":2.6509999999999998,"15min":2.552},"min":{"1min":0.69699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":6.468,"5min":40.125,"15min":40.125},"last":9.5559999999999992},{"interface":"front","average":{"1min":2.552,"5min":2.6299999999999999,"15min":2.601},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":11.295999999999999,"5min":34.496000000000002,"15min":34.496000000000002},"last":7.5309999999999997}]},{"osd":6,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":3.246,"5min":2.29,"15min":2.617},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"max":{"1min":8.3320000000000007,"5min":8.6869999999999994,"15min":16.622},"last":10.183},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.6360000000000001,"15min":2.665},"min":{"1min":0.73599999999999999,"5min":0.67100000000000004,"15min":0.58799999999999997},"max":{"1min":6.5800000000000001,"5min":23.747,"15min":23.747},"last":9.4510000000000005}]},{"osd":7,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.6920000000000002,"5min":2.774,"15min":2.7829999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":11.409000000000001,"5min":38.837000000000003,"15min":38.837000000000003},"last":7.649},{"interface":"front","average":{"1min":3.399,"5min":2.5499999999999998,"15min":2.7749999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":8.423,"5min":9.0380000000000003,"15min":16.716000000000001},"last":10.292}]}]},{"osd":1,"up_from":14,"seq":60129547265,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1738316,"kb_used_data":205188,"kb_used_omap":1246,"kb_used_meta":1531873,"kb_avail":92633524,"statfs":{"total":96636764160,"available":94856728576,"internally_reserved":0,"allocated":210112512,"data_stored":209490690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1275937,"internal_metadata":1568638943},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":366,"apply_latency_ms":366,"commit_latency_ns":366000000,"apply_latency_ns":366000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.9020000000000001,"5min":2.923,"15min":3.097},"min":{"1min":0.54900000000000004,"5min":0.442,"15min":0.30599999999999999},"max":{"1min":10.994,"5min":10.994,"15min":18.100000000000001},"last":3.7810000000000001},{"interface":"front","average":{"1min":3.577,"5min":3.1349999999999998,"15min":2.9369999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":16.48,"5min":43.956000000000003,"15min":43.956000000000003},"last":1.9650000000000001}]},{"osd":2,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":3.2120000000000002,"5min":3.1339999999999999,"15min":3.0609999999999999},"min":{"1min":0.61599999999999999,"5min":0.53200000000000003,"15min":0.53100000000000003},"max":{"1min":7.0979999999999999,"5min":25.652000000000001,"15min":25.652000000000001},"last":3.9169999999999998},{"interface":"front","average":{"1min":4.0439999999999996,"5min":3.472,"15min":3.1230000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.42599999999999999},"max":{"1min":24.094999999999999,"5min":43.795000000000002,"15min":43.795000000000002},"last":1.5600000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":3.3149999999999999,"5min":2.7090000000000001,"15min":2.827},"min":{"1min":0.69299999999999995,"5min":0.56399999999999995,"15min":0.498},"max":{"1min":10.07,"5min":10.07,"15min":13.419},"last":0.69299999999999995},{"interface":"front","average":{"1min":3.448,"5min":3.4900000000000002,"15min":3.5110000000000001},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":7.1150000000000002,"5min":11.618,"15min":18.062000000000001},"last":5.2050000000000001}]},{"osd":4,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.3860000000000001,"5min":2.4550000000000001,"15min":2.391},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":11.739000000000001,"5min":11.739000000000001,"15min":11.739000000000001},"last":1.7010000000000001},{"interface":"front","average":{"1min":2.7959999999999998,"5min":2.238,"15min":2.3010000000000002},"min":{"1min":0.73799999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.4820000000000002,"5min":2.8370000000000002,"15min":2.617},"min":{"1min":0.51100000000000001,"5min":0.46200000000000002,"15min":0.40500000000000003},"max":{"1min":5.3449999999999998,"5min":26.135000000000002,"15min":26.135000000000002},"last":4.7779999999999996},{"interface":"front","average":{"1min":2.1560000000000001,"5min":2.8530000000000002,"15min":2.6379999999999999},"min":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.60799999999999998},"max":{"1min":4.9969999999999999,"5min":44.347999999999999,"15min":44.347999999999999},"last":1.857}]},{"osd":6,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":2.4980000000000002,"15min":2.5529999999999999},"min":{"1min":0.81399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":8.0549999999999997,"5min":8.891,"15min":10.086},"last":0.81399999999999995},{"interface":"front","average":{"1min":2.6110000000000002,"5min":2.8889999999999998,"15min":2.8130000000000002},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.56799999999999995},"max":{"1min":5.5599999999999996,"5min":11.606,"15min":17.978999999999999},"last":4.9269999999999996}]},{"osd":7,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.9689999999999999,"5min":3.1930000000000001,"15min":2.8679999999999999},"min":{"1min":0.77500000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":8.2870000000000008,"5min":47.781999999999996,"15min":47.781999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":2.8340000000000001,"5min":3.089,"15min":2.9649999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":5.4800000000000004,"5min":25.777000000000001,"15min":25.777000000000001},"last":5.0659999999999998}]}]},{"osd":0,"up_from":14,"seq":60129547284,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2379672,"kb_used_data":1422604,"kb_used_omap":331,"kb_used_meta":956724,"kb_avail":91992168,"statfs":{"total":96636764160,"available":94199980032,"internally_reserved":0,"allocated":1456746496,"data_stored":1453334678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":339550,"internal_metadata":979685794},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":126,"apply_latency_ms":126,"commit_latency_ns":126000000,"apply_latency_ns":126000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.246,"5min":2.6349999999999998,"15min":2.9039999999999999},"min":{"1min":0.86299999999999999,"5min":0.629,"15min":0.27100000000000002},"max":{"1min":12.653,"5min":12.653,"15min":12.755000000000001},"last":8.3100000000000005},{"interface":"front","average":{"1min":3.448,"5min":2.7160000000000002,"15min":2.8239999999999998},"min":{"1min":0.63700000000000001,"5min":0.44400000000000001,"15min":0.38300000000000001},"max":{"1min":8.327,"5min":8.8640000000000008,"15min":9.8810000000000002},"last":15.050000000000001}]},{"osd":2,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.4540000000000002,"5min":2.6299999999999999,"15min":2.8090000000000002},"min":{"1min":0.74199999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.199999999999999,"5min":13.199999999999999,"15min":13.199999999999999},"last":12.109999999999999},{"interface":"front","average":{"1min":3.226,"5min":3.036,"15min":3.206},"min":{"1min":0.95999999999999996,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":8.6989999999999998,"5min":14.084,"15min":14.084},"last":4.6900000000000004}]},{"osd":3,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.8799999999999999,"5min":3.6680000000000001,"15min":3.5950000000000002},"min":{"1min":0.76000000000000001,"5min":0.53000000000000003,"15min":0.51800000000000002},"max":{"1min":12.099,"5min":33.881999999999998,"15min":33.881999999999998},"last":8.859},{"interface":"front","average":{"1min":3.831,"5min":3.3580000000000001,"15min":3.4860000000000002},"min":{"1min":1.032,"5min":0.42399999999999999,"15min":0.42299999999999999},"max":{"1min":13.071999999999999,"5min":35.034999999999997,"15min":35.034999999999997},"last":12.307}]},{"osd":4,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.7240000000000002,"5min":2.468,"15min":2.5179999999999998},"min":{"1min":0.82599999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":13.42,"5min":13.42,"15min":13.42},"last":8.4570000000000007},{"interface":"front","average":{"1min":3.2690000000000001,"5min":2.3290000000000002,"15min":2.504},"min":{"1min":0.78700000000000003,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":14.199,"5min":14.199,"15min":14.199},"last":11.987}]},{"osd":5,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":4.0570000000000004,"5min":2.6480000000000001,"15min":2.6859999999999999},"min":{"1min":1.4119999999999999,"5min":0.57099999999999995,"15min":0.52500000000000002},"max":{"1min":13.590999999999999,"5min":13.590999999999999,"15min":13.590999999999999},"last":8.641},{"interface":"front","average":{"1min":3.8410000000000002,"5min":2.5139999999999998,"15min":2.673},"min":{"1min":1.0569999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":14.314,"5min":14.314,"15min":14.314},"last":12.211}]},{"osd":6,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.4020000000000001,"5min":2.3889999999999998,"15min":2.5379999999999998},"min":{"1min":0.874,"5min":0.59999999999999998,"15min":0.58199999999999996},"max":{"1min":11.808,"5min":11.808,"15min":11.808},"last":1.0429999999999999},{"interface":"front","average":{"1min":3.4470000000000001,"5min":2.6720000000000002,"15min":2.7749999999999999},"min":{"1min":1.4239999999999999,"5min":0.63500000000000001,"15min":0.58899999999999997},"max":{"1min":12.901999999999999,"5min":12.901999999999999,"15min":12.901999999999999},"last":8.7599999999999998}]},{"osd":7,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.5449999999999999,"5min":2.5289999999999999,"15min":2.6680000000000001},"min":{"1min":1.0329999999999999,"5min":0.61899999999999999,"15min":0.61699999999999999},"max":{"1min":11.93,"5min":11.93,"15min":11.93},"last":1.1659999999999999},{"interface":"front","average":{"1min":3.6400000000000001,"5min":2.7290000000000001,"15min":2.8849999999999998},"min":{"1min":1.593,"5min":0.60399999999999998,"15min":0.55400000000000005},"max":{"1min":13.006,"5min":13.006,"15min":13.006},"last":27.364000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T04:18:18.854 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-29T04:18:18.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T04:18:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.537+0000 7f7d023aa640 1 Processor -- start 2023-11-29T04:18:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.537+0000 7f7d023aa640 1 -- start start 2023-11-29T04:18:19.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7d023aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7cf403a590 0x7f7cf40e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:19.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7d023aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf40340f0 0x7f7cf40068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:19.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7cfbfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7cf40e0f90 0x7f7cf4039e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:40088/0 (socket says 172.21.15.6:40088) 2023-11-29T04:18:19.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7d023aa640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf4006130 con 0x7f7cf40e0f90 2023-11-29T04:18:19.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7d023aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf404f4d0 con 0x7f7cf403a590 2023-11-29T04:18:19.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7d023aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf404eca0 con 0x7f7cf40340f0 2023-11-29T04:18:19.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7d01148640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf40340f0 0x7f7cf40068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:19.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7d01148640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf40340f0 0x7f7cf40068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:38420/0 (socket says 172.21.15.6:38420) 2023-11-29T04:18:19.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7d01148640 1 -- 172.21.15.6:0/2049696042 learned_addr learned my addr 172.21.15.6:0/2049696042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:19.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7cfaffd640 1 -- 172.21.15.6:0/2049696042 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090096449 0 0) 0x7f7cf4006130 con 0x7f7cf40e0f90 2023-11-29T04:18:19.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.545+0000 7f7cfaffd640 1 -- 172.21.15.6:0/2049696042 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cec003530 con 0x7f7cf40e0f90 2023-11-29T04:18:19.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.549+0000 7f7d01148640 1 -- 172.21.15.6:0/2049696042 >> v2:172.21.15.6:3300/0 conn(0x7f7cf403a590 msgr2=0x7f7cf40e55f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T04:18:19.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.549+0000 7f7cfaffd640 1 -- 172.21.15.6:0/2049696042 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424003935 0 0) 0x7f7cec003530 con 0x7f7cf40e0f90 2023-11-29T04:18:19.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.549+0000 7f7d01148640 1 --2- 172.21.15.6:0/2049696042 >> v2:172.21.15.6:3300/0 conn(0x7f7cf403a590 0x7f7cf40e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:19.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.549+0000 7f7d01148640 1 -- 172.21.15.6:0/2049696042 >> v1:172.21.15.31:6789/0 conn(0x7f7cf40e0f90 legacy=0x7f7cf4039e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:19.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.549+0000 7f7d01148640 1 -- 172.21.15.6:0/2049696042 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40063d0 con 0x7f7cf40340f0 2023-11-29T04:18:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.561+0000 7f7d01148640 1 --2- 172.21.15.6:0/2049696042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf40340f0 0x7f7cf40068f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc062150 tx=0x7f7cfc09b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbf6003eb73f1d34 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.565+0000 7f7cfaffd640 1 -- 172.21.15.6:0/2049696042 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00016a0 con 0x7f7cf40340f0 2023-11-29T04:18:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.565+0000 7f7cfaffd640 1 -- 172.21.15.6:0/2049696042 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc1239b0 con 0x7f7cf40340f0 2023-11-29T04:18:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.565+0000 7f7cfaffd640 1 -- 172.21.15.6:0/2049696042 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc123b20 con 0x7f7cf40340f0 2023-11-29T04:18:19.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.565+0000 7f7d023aa640 1 -- 172.21.15.6:0/2049696042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf40340f0 msgr2=0x7f7cf40068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:19.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.565+0000 7f7d023aa640 1 --2- 172.21.15.6:0/2049696042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf40340f0 0x7f7cf40068f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc062150 tx=0x7f7cfc09b7d0 comp rx=0 tx=0).stop 2023-11-29T04:18:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.573+0000 7f7d023aa640 1 -- 172.21.15.6:0/2049696042 shutdown_connections 2023-11-29T04:18:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.573+0000 7f7d023aa640 1 --2- 172.21.15.6:0/2049696042 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf40340f0 0x7f7cf40068f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.573+0000 7f7d023aa640 1 --2- 172.21.15.6:0/2049696042 >> v2:172.21.15.6:3300/0 conn(0x7f7cf403a590 0x7f7cf40e55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.573+0000 7f7d023aa640 1 -- 172.21.15.6:0/2049696042 >> 172.21.15.6:0/2049696042 conn(0x7f7cf4054c70 msgr2=0x7f7cf4055080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.573+0000 7f7d023aa640 1 -- 172.21.15.6:0/2049696042 shutdown_connections 2023-11-29T04:18:19.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.573+0000 7f7d023aa640 1 -- 172.21.15.6:0/2049696042 wait complete. 2023-11-29T04:18:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.589+0000 7f7d023aa640 1 Processor -- start 2023-11-29T04:18:19.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.589+0000 7f7d023aa640 1 -- start start 2023-11-29T04:18:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.597+0000 7f7d023aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf40340f0 0x7f7cf40e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.597+0000 7f7d023aa640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf403a590 0x7f7cf40d3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7d023aa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf40e0f90 0x7f7cf404a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7d023aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40d38d0 con 0x7f7cf40340f0 2023-11-29T04:18:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7d023aa640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf416c7c0 con 0x7f7cf40e0f90 2023-11-29T04:18:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7d023aa640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf416caa0 con 0x7f7cf403a590 2023-11-29T04:18:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7cfb7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf403a590 0x7f7cf40d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7cfb7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf403a590 0x7f7cf40d3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:38422/0 (socket says 172.21.15.6:38422) 2023-11-29T04:18:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7cfb7fe640 1 -- 172.21.15.6:0/3567488184 learned_addr learned my addr 172.21.15.6:0/3567488184 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7cfb7fe640 1 -- 172.21.15.6:0/3567488184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf40e0f90 msgr2=0x7f7cf404a460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-29T04:18:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7cfb7fe640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf40e0f90 0x7f7cf404a460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7cfb7fe640 1 -- 172.21.15.6:0/3567488184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf40340f0 msgr2=0x7f7cf40e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7cfb7fe640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf40340f0 0x7f7cf40e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7cfb7fe640 1 -- 172.21.15.6:0/3567488184 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc068300 con 0x7f7cf403a590 2023-11-29T04:18:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.601+0000 7f7cfb7fe640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf403a590 0x7f7cf40d3390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800b440 tx=0x7f7ce800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.605+0000 7f7cf8ff9640 1 -- 172.21.15.6:0/3567488184 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8011890 con 0x7f7cf403a590 2023-11-29T04:18:19.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.605+0000 7f7cf8ff9640 1 -- 172.21.15.6:0/3567488184 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce80119f0 con 0x7f7cf403a590 2023-11-29T04:18:19.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.605+0000 7f7cf8ff9640 1 -- 172.21.15.6:0/3567488184 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8011d60 con 0x7f7cf403a590 2023-11-29T04:18:19.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.609+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf416cd80 con 0x7f7cf403a590 2023-11-29T04:18:19.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.609+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf416c420 con 0x7f7cf403a590 2023-11-29T04:18:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.613+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf416d230 con 0x7f7cf403a590 2023-11-29T04:18:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.625+0000 7f7cf8ff9640 1 -- 172.21.15.6:0/3567488184 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ce801a400 con 0x7f7cf403a590 2023-11-29T04:18:19.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.629+0000 7f7cf8ff9640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ce0066470 0x7f7ce0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:19.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.637+0000 7f7cf8ff9640 1 -- 172.21.15.6:0/3567488184 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7ce805b550 con 0x7f7cf403a590 2023-11-29T04:18:19.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.637+0000 7f7cfbfff640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ce0066470 0x7f7ce0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:19.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.637+0000 7f7cf8ff9640 1 -- 172.21.15.6:0/3567488184 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ce8051de0 con 0x7f7cf403a590 2023-11-29T04:18:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:19.641+0000 7f7cfbfff640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ce0066470 0x7f7ce0068930 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001210 tx=0x7f7cf0001120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.101+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7cf4005470 con 0x7f7ce0066470 2023-11-29T04:18:20.131 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:18:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-29T04:18:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.125+0000 7f7cf8ff9640 1 -- 172.21.15.6:0/3567488184 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49458 (secure 0 0 0) 0x7f7cf4005470 con 0x7f7ce0066470 2023-11-29T04:18:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ce0066470 msgr2=0x7f7ce0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ce0066470 0x7f7ce0068930 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001210 tx=0x7f7cf0001120 comp rx=0 tx=0).stop 2023-11-29T04:18:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf403a590 msgr2=0x7f7cf40d3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf403a590 0x7f7cf40d3390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800b440 tx=0x7f7ce800b900 comp rx=0 tx=0).stop 2023-11-29T04:18:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 shutdown_connections 2023-11-29T04:18:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7ce0066470 0x7f7ce0068930 secure :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001210 tx=0x7f7cf0001120 comp rx=0 tx=0).stop 2023-11-29T04:18:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf40e0f90 0x7f7cf404a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7cf403a590 0x7f7cf40d3390 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800b440 tx=0x7f7ce800b900 comp rx=0 tx=0).stop 2023-11-29T04:18:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 --2- 172.21.15.6:0/3567488184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cf40340f0 0x7f7cf40e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 >> 172.21.15.6:0/3567488184 conn(0x7f7cf4054c70 msgr2=0x7f7cf404d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:20.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 shutdown_connections 2023-11-29T04:18:20.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.133+0000 7f7d023aa640 1 -- 172.21.15.6:0/3567488184 wait complete. 2023-11-29T04:18:20.196 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":12930,"stamp":"2023-11-29T04:18:18.630793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":16614020,"kb_used_data":5530176,"kb_used_omap":4861,"kb_used_meta":10976322,"kb_avail":738360700,"statfs":{"total":773094113280,"available":756081356800,"internally_reserved":0,"allocated":5662900224,"data_stored":5648987890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4978608,"internal_metadata":11239753808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2847,"apply_latency_ms":2847,"commit_latency_ns":2847000000,"apply_latency_ns":2847000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.489787"},"pg_stats":[{"pgid":"1.0","version":"34'161","reported_seq":446,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-29T04:18:05.452717+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-29T04:18:05.452717+0000","last_peered":"2023-11-29T04:18:05.452717+0000","last_clean":"2023-11-29T04:18:05.452717+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-29T04:18:05.452717+0000","last_undegraded":"2023-11-29T04:18:05.452717+0000","last_fullsized":"2023-11-29T04:18:05.452717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514604,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1632540,"kb_used_data":9084,"kb_used_omap":22,"kb_used_meta":1598185,"kb_avail":92739300,"statfs":{"total":96636764160,"available":94965043200,"internally_reserved":0,"allocated":9302016,"data_stored":9036474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22957,"internal_metadata":1636542035},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":259,"apply_latency_ms":259,"commit_latency_ns":259000000,"apply_latency_ns":259000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.516,"15min":1.577},"min":{"1min":0.51900000000000002,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":14.651,"5min":14.651,"15min":14.651},"last":2.1160000000000001},{"interface":"front","average":{"1min":2.395,"5min":1.9710000000000001,"15min":1.706},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.312},"max":{"1min":16.303000000000001,"5min":16.303000000000001,"15min":16.303000000000001},"last":1.349}]},{"osd":1,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.673,"15min":1.6839999999999999},"min":{"1min":0.57799999999999996,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":4.2519999999999998,"5min":7.9900000000000002,"15min":28.478999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.675,"15min":1.665},"min":{"1min":0.52500000000000002,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":8.0099999999999998,"5min":8.3539999999999992,"15min":28.408000000000001},"last":2.3660000000000001}]},{"osd":2,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":2.6880000000000002,"5min":2.2650000000000001,"15min":1.764},"min":{"1min":0.64800000000000002,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":19.091999999999999,"5min":47,"15min":47},"last":0.81100000000000005},{"interface":"front","average":{"1min":3.0049999999999999,"5min":1.8799999999999999,"15min":1.806},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":24.178000000000001,"5min":24.178000000000001,"15min":24.178000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":2.157,"15min":1.9339999999999999},"min":{"1min":0.65400000000000003,"5min":0.496,"15min":0.42199999999999999},"max":{"1min":9.0839999999999996,"5min":46.820999999999998,"15min":46.820999999999998},"last":1.121},{"interface":"front","average":{"1min":2.2690000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"min":{"1min":0.52200000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":9.7899999999999991,"5min":9.7899999999999991,"15min":31.053000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.026,"15min":0.77300000000000002},"min":{"1min":0.36399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":7.4720000000000004,"5min":29.809000000000001,"15min":29.809000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1599999999999999,"15min":0.84099999999999997},"min":{"1min":0.41199999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.6140000000000008,"5min":46.726999999999997,"15min":46.726999999999997},"last":0.85499999999999998}]},{"osd":5,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":0.92600000000000005,"15min":0.754},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":8.1720000000000006,"5min":16.276,"15min":16.276},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.208,"15min":0.90200000000000002},"min":{"1min":0.52000000000000002,"5min":0.39300000000000002,"15min":0.371},"max":{"1min":12.036,"5min":32.847000000000001,"15min":32.847000000000001},"last":0.622}]},{"osd":6,"last update":"Wed Nov 29 04:17:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.56599999999999995,"5min":0.441,"15min":0.42899999999999999},"max":{"1min":4.0759999999999996,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.194,"15min":0.89300000000000002},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.41299999999999998},"max":{"1min":1.417,"5min":46.865000000000002,"15min":46.865000000000002},"last":0.996}]}]},{"osd":6,"up_from":15,"seq":64424514607,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1549412,"kb_used_data":412,"kb_used_omap":415,"kb_used_meta":1548576,"kb_avail":92822428,"statfs":{"total":96636764160,"available":95050166272,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":425474,"internal_metadata":1585742334},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1376,"apply_latency_ms":1376,"commit_latency_ns":1376000000,"apply_latency_ns":1376000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":4.9569999999999999,"5min":8.9809999999999999,"15min":9.7270000000000003},"last":8.2270000000000003},{"interface":"front","average":{"1min":1.7310000000000001,"5min":1.6619999999999999,"15min":1.5780000000000001},"min":{"1min":0.432,"5min":0.39700000000000002,"15min":0.33600000000000002},"max":{"1min":7.1079999999999997,"5min":13.32,"15min":13.32},"last":4.7409999999999997}]},{"osd":1,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.78,"15min":1.6579999999999999},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.373},"max":{"1min":7.04,"5min":21.614999999999998,"15min":21.614999999999998},"last":12.563000000000001},{"interface":"front","average":{"1min":1.597,"5min":1.5820000000000001,"15min":1.8340000000000001},"min":{"1min":0.43099999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":7.218,"5min":12.239000000000001,"15min":12.603999999999999},"last":1.2689999999999999}]},{"osd":2,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":1.712,"15min":1.7110000000000001},"min":{"1min":0.50800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":6.8840000000000003,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":2.7490000000000001},{"interface":"front","average":{"1min":1.8839999999999999,"5min":1.851,"15min":1.621},"min":{"1min":0.66900000000000004,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":6.0659999999999998,"5min":7.5330000000000004,"15min":9.4369999999999994},"last":8.1340000000000003}]},{"osd":3,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.72,"15min":1.7030000000000001},"min":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.48799999999999999},"max":{"1min":4.0419999999999998,"5min":12.911,"15min":12.911},"last":2.1040000000000001},{"interface":"front","average":{"1min":2.1760000000000002,"5min":1.8160000000000001,"15min":1.8049999999999999},"min":{"1min":0.58899999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":6.9800000000000004,"5min":21.228999999999999,"15min":21.228999999999999},"last":8.7050000000000001}]},{"osd":4,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.71599999999999997,"15min":0.65100000000000002},"min":{"1min":0.42699999999999999,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":2.2810000000000001,"5min":8.9100000000000001,"15min":8.9100000000000001},"last":1.153},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":1.631,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":2.0569999999999999}]},{"osd":5,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.85699999999999998,"15min":0.73499999999999999},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":2.0129999999999999,"5min":16.655000000000001,"15min":16.655000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.85799999999999998,"15min":0.77200000000000002},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.38100000000000001},"max":{"1min":2.786,"5min":9.2260000000000009,"15min":9.2260000000000009},"last":1.4430000000000001}]},{"osd":7,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.81899999999999995,"15min":0.753},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":4.4400000000000004,"5min":7.4299999999999997,"15min":7.4299999999999997},"last":2.008},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.90900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.0590000000000002,"5min":16.710000000000001,"15min":16.710000000000001},"last":1.484}]}]},{"osd":5,"up_from":15,"seq":64424514605,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1515428,"kb_used_data":412,"kb_used_omap":130,"kb_used_meta":1514877,"kb_avail":92856412,"statfs":{"total":96636764160,"available":95084965888,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":133284,"internal_metadata":1551234908},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":294,"apply_latency_ms":294,"commit_latency_ns":294000000,"apply_latency_ns":294000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.361,"15min":1.375},"min":{"1min":0.57099999999999995,"5min":0.379,"15min":0.309},"max":{"1min":3.9790000000000001,"5min":6.3399999999999999,"15min":7.6769999999999996},"last":1.244},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.2869999999999999,"15min":1.45},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.2759999999999998,"5min":6.3650000000000002,"15min":6.8579999999999997},"last":7.9029999999999996}]},{"osd":1,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.3580000000000001,"15min":1.544},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":6.0599999999999996,"5min":7.5730000000000004,"15min":50.093000000000004},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.3740000000000001,"15min":1.768},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":6.9809999999999999,"5min":6.9809999999999999,"15min":49.384},"last":12.132}]},{"osd":2,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.5649999999999999,"15min":1.8799999999999999},"min":{"1min":0.58799999999999997,"5min":0.45800000000000002,"15min":0.36699999999999999},"max":{"1min":6.181,"5min":8.9489999999999998,"15min":50.744},"last":3.3980000000000001},{"interface":"front","average":{"1min":1.768,"5min":1.587,"15min":1.879},"min":{"1min":0.48699999999999999,"5min":0.439,"15min":0.437},"max":{"1min":7.0979999999999999,"5min":9.3179999999999996,"15min":49.237000000000002},"last":0.95899999999999996}]},{"osd":3,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.575,"15min":1.893},"min":{"1min":0.46400000000000002,"5min":0.443,"15min":0.41999999999999998},"max":{"1min":6.4779999999999998,"5min":6.4779999999999998,"15min":11.491},"last":3.3079999999999998},{"interface":"front","average":{"1min":1.667,"5min":1.6419999999999999,"15min":1.645},"min":{"1min":0.56000000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":6.3170000000000002,"5min":6.4989999999999997,"15min":8.1600000000000001},"last":3.4169999999999998}]},{"osd":4,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.41199999999999998,"5min":0.34100000000000003,"15min":0.32800000000000001},"max":{"1min":0.85599999999999998,"5min":2.3410000000000002,"15min":3.7719999999999998},"last":2.077},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.70499999999999996,"15min":0.67700000000000005},"min":{"1min":0.442,"5min":0.379,"15min":0.373},"max":{"1min":1.234,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":3.258}]},{"osd":6,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.755,"15min":0.70499999999999996},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":6.3499999999999996,"5min":6.3499999999999996,"15min":6.3499999999999996},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70599999999999996,"15min":0.69699999999999995},"min":{"1min":0.50700000000000001,"5min":0.434,"15min":0.41799999999999998},"max":{"1min":1.2929999999999999,"5min":2.387,"15min":3.8730000000000002},"last":2.1200000000000001}]},{"osd":7,"last update":"Wed Nov 29 04:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.70999999999999996,"15min":0.74199999999999999},"min":{"1min":0.502,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1919999999999999,"5min":2.6179999999999999,"15min":4.032},"last":3.3490000000000002},{"interface":"front","average":{"1min":1.014,"5min":0.81299999999999994,"15min":0.77000000000000002},"min":{"1min":0.54500000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":6.2220000000000004,"5min":6.2220000000000004,"15min":6.2220000000000004},"last":1.2809999999999999}]}]},{"osd":4,"up_from":15,"seq":64424514606,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1626020,"kb_used_data":412,"kb_used_omap":1141,"kb_used_meta":1624458,"kb_avail":92745820,"statfs":{"total":96636764160,"available":94971719680,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1169084,"internal_metadata":1663445316},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":210,"apply_latency_ms":210,"commit_latency_ns":210000000,"apply_latency_ns":210000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":1.736,"15min":1.554},"min":{"1min":0.379,"5min":0.35199999999999998,"15min":0.307},"max":{"1min":11.618,"5min":11.618,"15min":11.839},"last":2.7109999999999999},{"interface":"front","average":{"1min":2.153,"5min":1.857,"15min":1.7769999999999999},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.34000000000000002},"max":{"1min":7.359,"5min":10.318,"15min":10.318},"last":6.6980000000000004}]},{"osd":1,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.476,"15min":1.825},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.851,"5min":26.338000000000001,"15min":26.338000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.774,"15min":1.8520000000000001},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.1449999999999996,"5min":25.989000000000001,"15min":25.989000000000001},"last":1.6879999999999999}]},{"osd":2,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":1.653,"15min":1.623},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.3420000000000005,"5min":9.3420000000000005,"15min":9.6120000000000001},"last":1.288},{"interface":"front","average":{"1min":2.3239999999999998,"5min":1.6679999999999999,"15min":1.6499999999999999},"min":{"1min":0.55600000000000005,"5min":0.433,"15min":0.40500000000000003},"max":{"1min":6.4880000000000004,"5min":6.5049999999999999,"15min":12.461},"last":1.4990000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":2.4089999999999998,"5min":1.895,"15min":1.635},"min":{"1min":0.67400000000000004,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":8.4030000000000005,"5min":8.4030000000000005,"15min":8.4030000000000005},"last":1.931},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.5229999999999999,"15min":1.7589999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.6580000000000004,"5min":8.6799999999999997,"15min":12.52},"last":3.0489999999999999}]},{"osd":5,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.61599999999999999,"15min":0.59099999999999997},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.34100000000000003},"max":{"1min":0.871,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.452},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.40100000000000002,"15min":0.33200000000000002},"max":{"1min":0.71099999999999997,"5min":3.802,"15min":3.802},"last":1.4330000000000001}]},{"osd":6,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.42799999999999999,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.79700000000000004,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.72599999999999998,"15min":0.68600000000000005},"min":{"1min":0.44400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.7060000000000004,"5min":4.7060000000000004,"15min":4.7060000000000004},"last":1.538}]},{"osd":7,"last update":"Wed Nov 29 04:17:16 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.73499999999999999,"15min":0.69699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.373},"max":{"1min":0.99399999999999999,"5min":4.077,"15min":4.077},"last":1.385},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.78100000000000003,"15min":0.746},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.40799999999999997},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.327}]}]},{"osd":2,"up_from":15,"seq":64424514570,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3564716,"kb_used_data":2399520,"kb_used_omap":339,"kb_used_meta":1164844,"kb_avail":90807124,"statfs":{"total":96636764160,"available":92986494976,"internally_reserved":0,"allocated":2457108480,"data_stored":2451767200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":347851,"internal_metadata":1192800565},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.3740000000000001,"5min":2.8940000000000001,"15min":2.8780000000000001},"min":{"1min":0.74099999999999999,"5min":0.45800000000000002,"15min":0.45500000000000002},"max":{"1min":4.7409999999999997,"5min":33.073,"15min":33.073},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.645,"5min":3.3969999999999998,"15min":3.1240000000000001},"min":{"1min":0.745,"5min":0.434,"15min":0.434},"max":{"1min":6.931,"5min":37.037999999999997,"15min":37.037999999999997},"last":1.002}]},{"osd":1,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":3.0190000000000001,"15min":3.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.60999999999999999,"15min":0.41299999999999998},"max":{"1min":5.7110000000000003,"5min":12.577999999999999,"15min":17.945},"last":0.83499999999999996},{"interface":"front","average":{"1min":2.9740000000000002,"5min":3.5499999999999998,"15min":3.2200000000000002},"min":{"1min":0.82899999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":7.7229999999999999,"5min":16.536000000000001,"15min":18.667000000000002},"last":1.752}]},{"osd":3,"last update":"Wed Nov 29 04:17:15 2023","interfaces":[{"interface":"back","average":{"1min":2.1659999999999999,"5min":2.73,"15min":2.944},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.40699999999999997},"max":{"1min":4.3579999999999997,"5min":10.836,"15min":21.995000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":2.677,"5min":2.8149999999999999,"15min":3.0979999999999999},"min":{"1min":0.76100000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":16.334,"5min":16.334,"15min":17.504999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.1480000000000001,"5min":2.6059999999999999,"15min":2.4910000000000001},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":5.9139999999999997,"5min":11.319000000000001,"15min":18.219999999999999},"last":1.512},{"interface":"front","average":{"1min":1.605,"5min":2.2000000000000002,"15min":2.3559999999999999},"min":{"1min":0.65800000000000003,"5min":0.60799999999999998,"15min":0.51200000000000001},"max":{"1min":4.0629999999999997,"5min":10.489000000000001,"15min":19.183},"last":0.90900000000000003}]},{"osd":5,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":2.3450000000000002,"15min":2.5230000000000001},"min":{"1min":0.71999999999999997,"5min":0.624,"15min":0.433},"max":{"1min":4.2610000000000001,"5min":15.224,"15min":49.899000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":2.5219999999999998,"5min":2.7029999999999998,"15min":2.7770000000000001},"min":{"1min":0.67500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":6.0439999999999996,"5min":11.461,"15min":50.293999999999997},"last":1.609}]},{"osd":6,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":2.3730000000000002,"15min":2.5630000000000002},"min":{"1min":0.77700000000000002,"5min":0.64400000000000002,"15min":0.56799999999999995},"max":{"1min":3.8530000000000002,"5min":10.648,"15min":20.477},"last":0.745},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.3540000000000001,"15min":2.5539999999999998},"min":{"1min":0.67900000000000005,"5min":0.65800000000000003,"15min":0.54500000000000004},"max":{"1min":4.4770000000000003,"5min":13.013999999999999,"15min":17.815999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.9590000000000001,"15min":2.802},"min":{"1min":0.88200000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":7.6349999999999998,"5min":11.571,"15min":18.341999999999999},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.8280000000000001,"5min":2.528,"15min":2.7029999999999998},"min":{"1min":0.71199999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.9630000000000001,"5min":10.747,"15min":21.225999999999999},"last":1.085}]}]},{"osd":3,"up_from":14,"seq":60129547258,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2607916,"kb_used_data":1492544,"kb_used_omap":1234,"kb_used_meta":1036781,"kb_avail":91763924,"statfs":{"total":96636764160,"available":93966258176,"internally_reserved":0,"allocated":1528365056,"data_stored":1524862234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1264471,"internal_metadata":1061663913},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":175,"apply_latency_ms":175,"commit_latency_ns":175000000,"apply_latency_ns":175000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.133,"5min":2.7749999999999999,"15min":2.9409999999999998},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.42299999999999999},"max":{"1min":6.2709999999999999,"5min":16.690000000000001,"15min":16.690000000000001},"last":8.2599999999999998},{"interface":"front","average":{"1min":2.411,"5min":2.6619999999999999,"15min":2.8340000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.32500000000000001},"max":{"1min":11.503,"5min":15.228,"15min":15.819000000000001},"last":7.2779999999999996}]},{"osd":1,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":4.4100000000000001,"5min":3.2480000000000002,"15min":3.2839999999999998},"min":{"1min":0.69099999999999995,"5min":0.66800000000000004,"15min":0.33200000000000002},"max":{"1min":45.505000000000003,"5min":45.505000000000003,"15min":45.505000000000003},"last":9.3219999999999992},{"interface":"front","average":{"1min":3.8759999999999999,"5min":2.9550000000000001,"15min":3.2989999999999999},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":14.897,"5min":14.897,"15min":40.087000000000003},"last":10.504}]},{"osd":2,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":3.5619999999999998,"5min":2.8580000000000001,"15min":3.3119999999999998},"min":{"1min":0.72399999999999998,"5min":0.56499999999999995,"15min":0.38400000000000001},"max":{"1min":10.923999999999999,"5min":14.907999999999999,"15min":39.954000000000001},"last":10.398999999999999},{"interface":"front","average":{"1min":3.2679999999999998,"5min":3.1899999999999999,"15min":3.4249999999999998},"min":{"1min":0.90100000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":7.5540000000000003,"5min":23.989000000000001,"15min":37.334000000000003},"last":11.295999999999999}]},{"osd":4,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.464,"5min":2.4380000000000002,"15min":2.3809999999999998},"min":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.47199999999999998},"max":{"1min":11.044,"5min":30.600999999999999,"15min":30.600999999999999},"last":7.4219999999999997},{"interface":"front","average":{"1min":3.1160000000000001,"5min":2.1459999999999999,"15min":2.4769999999999999},"min":{"1min":0.68899999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":8.2370000000000001,"5min":8.2370000000000001,"15min":16.803000000000001},"last":10.063000000000001}]},{"osd":5,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.069,"5min":2.6509999999999998,"15min":2.552},"min":{"1min":0.69699999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":6.468,"5min":40.125,"15min":40.125},"last":9.5559999999999992},{"interface":"front","average":{"1min":2.552,"5min":2.6299999999999999,"15min":2.601},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":11.295999999999999,"5min":34.496000000000002,"15min":34.496000000000002},"last":7.5309999999999997}]},{"osd":6,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":3.246,"5min":2.29,"15min":2.617},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60599999999999998},"max":{"1min":8.3320000000000007,"5min":8.6869999999999994,"15min":16.622},"last":10.183},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.6360000000000001,"15min":2.665},"min":{"1min":0.73599999999999999,"5min":0.67100000000000004,"15min":0.58799999999999997},"max":{"1min":6.5800000000000001,"5min":23.747,"15min":23.747},"last":9.4510000000000005}]},{"osd":7,"last update":"Wed Nov 29 04:17:20 2023","interfaces":[{"interface":"back","average":{"1min":2.6920000000000002,"5min":2.774,"15min":2.7829999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":11.409000000000001,"5min":38.837000000000003,"15min":38.837000000000003},"last":7.649},{"interface":"front","average":{"1min":3.399,"5min":2.5499999999999998,"15min":2.7749999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":8.423,"5min":9.0380000000000003,"15min":16.716000000000001},"last":10.292}]}]},{"osd":1,"up_from":14,"seq":60129547265,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1738316,"kb_used_data":205188,"kb_used_omap":1246,"kb_used_meta":1531873,"kb_avail":92633524,"statfs":{"total":96636764160,"available":94856728576,"internally_reserved":0,"allocated":210112512,"data_stored":209490690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1275937,"internal_metadata":1568638943},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":366,"apply_latency_ms":366,"commit_latency_ns":366000000,"apply_latency_ns":366000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.9020000000000001,"5min":2.923,"15min":3.097},"min":{"1min":0.54900000000000004,"5min":0.442,"15min":0.30599999999999999},"max":{"1min":10.994,"5min":10.994,"15min":18.100000000000001},"last":3.7810000000000001},{"interface":"front","average":{"1min":3.577,"5min":3.1349999999999998,"15min":2.9369999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":16.48,"5min":43.956000000000003,"15min":43.956000000000003},"last":1.9650000000000001}]},{"osd":2,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":3.2120000000000002,"5min":3.1339999999999999,"15min":3.0609999999999999},"min":{"1min":0.61599999999999999,"5min":0.53200000000000003,"15min":0.53100000000000003},"max":{"1min":7.0979999999999999,"5min":25.652000000000001,"15min":25.652000000000001},"last":3.9169999999999998},{"interface":"front","average":{"1min":4.0439999999999996,"5min":3.472,"15min":3.1230000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.42599999999999999},"max":{"1min":24.094999999999999,"5min":43.795000000000002,"15min":43.795000000000002},"last":1.5600000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":3.3149999999999999,"5min":2.7090000000000001,"15min":2.827},"min":{"1min":0.69299999999999995,"5min":0.56399999999999995,"15min":0.498},"max":{"1min":10.07,"5min":10.07,"15min":13.419},"last":0.69299999999999995},{"interface":"front","average":{"1min":3.448,"5min":3.4900000000000002,"15min":3.5110000000000001},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":7.1150000000000002,"5min":11.618,"15min":18.062000000000001},"last":5.2050000000000001}]},{"osd":4,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.3860000000000001,"5min":2.4550000000000001,"15min":2.391},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":11.739000000000001,"5min":11.739000000000001,"15min":11.739000000000001},"last":1.7010000000000001},{"interface":"front","average":{"1min":2.7959999999999998,"5min":2.238,"15min":2.3010000000000002},"min":{"1min":0.73799999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.4820000000000002,"5min":2.8370000000000002,"15min":2.617},"min":{"1min":0.51100000000000001,"5min":0.46200000000000002,"15min":0.40500000000000003},"max":{"1min":5.3449999999999998,"5min":26.135000000000002,"15min":26.135000000000002},"last":4.7779999999999996},{"interface":"front","average":{"1min":2.1560000000000001,"5min":2.8530000000000002,"15min":2.6379999999999999},"min":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.60799999999999998},"max":{"1min":4.9969999999999999,"5min":44.347999999999999,"15min":44.347999999999999},"last":1.857}]},{"osd":6,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":2.4980000000000002,"15min":2.5529999999999999},"min":{"1min":0.81399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":8.0549999999999997,"5min":8.891,"15min":10.086},"last":0.81399999999999995},{"interface":"front","average":{"1min":2.6110000000000002,"5min":2.8889999999999998,"15min":2.8130000000000002},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.56799999999999995},"max":{"1min":5.5599999999999996,"5min":11.606,"15min":17.978999999999999},"last":4.9269999999999996}]},{"osd":7,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.9689999999999999,"5min":3.1930000000000001,"15min":2.8679999999999999},"min":{"1min":0.77500000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":8.2870000000000008,"5min":47.781999999999996,"15min":47.781999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":2.8340000000000001,"5min":3.089,"15min":2.9649999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":5.4800000000000004,"5min":25.777000000000001,"15min":25.777000000000001},"last":5.0659999999999998}]}]},{"osd":0,"up_from":14,"seq":60129547284,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2379672,"kb_used_data":1422604,"kb_used_omap":331,"kb_used_meta":956724,"kb_avail":91992168,"statfs":{"total":96636764160,"available":94199980032,"internally_reserved":0,"allocated":1456746496,"data_stored":1453334678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":339550,"internal_metadata":979685794},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":126,"apply_latency_ms":126,"commit_latency_ns":126000000,"apply_latency_ns":126000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.246,"5min":2.6349999999999998,"15min":2.9039999999999999},"min":{"1min":0.86299999999999999,"5min":0.629,"15min":0.27100000000000002},"max":{"1min":12.653,"5min":12.653,"15min":12.755000000000001},"last":8.3100000000000005},{"interface":"front","average":{"1min":3.448,"5min":2.7160000000000002,"15min":2.8239999999999998},"min":{"1min":0.63700000000000001,"5min":0.44400000000000001,"15min":0.38300000000000001},"max":{"1min":8.327,"5min":8.8640000000000008,"15min":9.8810000000000002},"last":15.050000000000001}]},{"osd":2,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.4540000000000002,"5min":2.6299999999999999,"15min":2.8090000000000002},"min":{"1min":0.74199999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.199999999999999,"5min":13.199999999999999,"15min":13.199999999999999},"last":12.109999999999999},{"interface":"front","average":{"1min":3.226,"5min":3.036,"15min":3.206},"min":{"1min":0.95999999999999996,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":8.6989999999999998,"5min":14.084,"15min":14.084},"last":4.6900000000000004}]},{"osd":3,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.8799999999999999,"5min":3.6680000000000001,"15min":3.5950000000000002},"min":{"1min":0.76000000000000001,"5min":0.53000000000000003,"15min":0.51800000000000002},"max":{"1min":12.099,"5min":33.881999999999998,"15min":33.881999999999998},"last":8.859},{"interface":"front","average":{"1min":3.831,"5min":3.3580000000000001,"15min":3.4860000000000002},"min":{"1min":1.032,"5min":0.42399999999999999,"15min":0.42299999999999999},"max":{"1min":13.071999999999999,"5min":35.034999999999997,"15min":35.034999999999997},"last":12.307}]},{"osd":4,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.7240000000000002,"5min":2.468,"15min":2.5179999999999998},"min":{"1min":0.82599999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":13.42,"5min":13.42,"15min":13.42},"last":8.4570000000000007},{"interface":"front","average":{"1min":3.2690000000000001,"5min":2.3290000000000002,"15min":2.504},"min":{"1min":0.78700000000000003,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":14.199,"5min":14.199,"15min":14.199},"last":11.987}]},{"osd":5,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":4.0570000000000004,"5min":2.6480000000000001,"15min":2.6859999999999999},"min":{"1min":1.4119999999999999,"5min":0.57099999999999995,"15min":0.52500000000000002},"max":{"1min":13.590999999999999,"5min":13.590999999999999,"15min":13.590999999999999},"last":8.641},{"interface":"front","average":{"1min":3.8410000000000002,"5min":2.5139999999999998,"15min":2.673},"min":{"1min":1.0569999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":14.314,"5min":14.314,"15min":14.314},"last":12.211}]},{"osd":6,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.4020000000000001,"5min":2.3889999999999998,"15min":2.5379999999999998},"min":{"1min":0.874,"5min":0.59999999999999998,"15min":0.58199999999999996},"max":{"1min":11.808,"5min":11.808,"15min":11.808},"last":1.0429999999999999},{"interface":"front","average":{"1min":3.4470000000000001,"5min":2.6720000000000002,"15min":2.7749999999999999},"min":{"1min":1.4239999999999999,"5min":0.63500000000000001,"15min":0.58899999999999997},"max":{"1min":12.901999999999999,"5min":12.901999999999999,"15min":12.901999999999999},"last":8.7599999999999998}]},{"osd":7,"last update":"Wed Nov 29 04:17:18 2023","interfaces":[{"interface":"back","average":{"1min":3.5449999999999999,"5min":2.5289999999999999,"15min":2.6680000000000001},"min":{"1min":1.0329999999999999,"5min":0.61899999999999999,"15min":0.61699999999999999},"max":{"1min":11.93,"5min":11.93,"15min":11.93},"last":1.1659999999999999},{"interface":"front","average":{"1min":3.6400000000000001,"5min":2.7290000000000001,"15min":2.8849999999999998},"min":{"1min":1.593,"5min":0.60399999999999998,"15min":0.55400000000000005},"max":{"1min":13.006,"5min":13.006,"15min":13.006},"last":27.364000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T04:18:20.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T04:18:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.849+0000 7f4a1f4c9640 1 Processor -- start 2023-11-29T04:18:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.849+0000 7f4a1f4c9640 1 -- start start 2023-11-29T04:18:20.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.853+0000 7f4a1f4c9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a180b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:20.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.853+0000 7f4a1f4c9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4a18162890 0x7f4a180705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:20.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.853+0000 7f4a1f4c9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a180b32c0 con 0x7f4a18070b20 2023-11-29T04:18:20.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1f4c9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1806d580 con 0x7f4a18162890 2023-11-29T04:18:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1ca64640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4a18162890 0x7f4a180705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1ca64640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4a18162890 0x7f4a180705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53242/0 (socket says 172.21.15.6:53242) 2023-11-29T04:18:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1ca64640 1 -- 172.21.15.6:0/1080062152 learned_addr learned my addr 172.21.15.6:0/1080062152 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1d265640 1 --2- 172.21.15.6:0/1080062152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a180b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1f4c9640 1 -- 172.21.15.6:0/1080062152 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a18070f90 con 0x7f4a1815f230 2023-11-29T04:18:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1d265640 1 -- 172.21.15.6:0/1080062152 >> v2:172.21.15.31:3300/0 conn(0x7f4a18162890 msgr2=0x7f4a180705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1d265640 1 --2- 172.21.15.6:0/1080062152 >> v2:172.21.15.31:3300/0 conn(0x7f4a18162890 0x7f4a180705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:20.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a0ffff640 1 -- 172.21.15.6:0/1080062152 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709235308 0 0) 0x7f4a180b32c0 con 0x7f4a18070b20 2023-11-29T04:18:20.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1d265640 1 -- 172.21.15.6:0/1080062152 >> v1:172.21.15.31:6789/0 conn(0x7f4a18070b20 legacy=0x7f4a181651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:20.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.857+0000 7f4a1d265640 1 -- 172.21.15.6:0/1080062152 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1815f610 con 0x7f4a1815f230 2023-11-29T04:18:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a1d265640 1 --2- 172.21.15.6:0/1080062152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a180b1d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4a1806d6c0 tx=0x7f4a1001c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cdedc3c23206752 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a0ffff640 1 -- 172.21.15.6:0/1080062152 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100a5800 con 0x7f4a1815f230 2023-11-29T04:18:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a0ffff640 1 -- 172.21.15.6:0/1080062152 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a100a5960 con 0x7f4a1815f230 2023-11-29T04:18:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a0ffff640 1 -- 172.21.15.6:0/1080062152 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100a5cf0 con 0x7f4a1815f230 2023-11-29T04:18:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a1f4c9640 1 -- 172.21.15.6:0/1080062152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 msgr2=0x7f4a180b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a1f4c9640 1 --2- 172.21.15.6:0/1080062152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a180b1d90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4a1806d6c0 tx=0x7f4a1001c930 comp rx=0 tx=0).stop 2023-11-29T04:18:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a1f4c9640 1 -- 172.21.15.6:0/1080062152 shutdown_connections 2023-11-29T04:18:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a1f4c9640 1 --2- 172.21.15.6:0/1080062152 >> v2:172.21.15.31:3300/0 conn(0x7f4a18162890 0x7f4a180705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a1f4c9640 1 --2- 172.21.15.6:0/1080062152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a180b1d90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.869+0000 7f4a1f4c9640 1 -- 172.21.15.6:0/1080062152 >> 172.21.15.6:0/1080062152 conn(0x7f4a1806ab80 msgr2=0x7f4a180b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.873+0000 7f4a1f4c9640 1 -- 172.21.15.6:0/1080062152 shutdown_connections 2023-11-29T04:18:20.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.873+0000 7f4a1f4c9640 1 -- 172.21.15.6:0/1080062152 wait complete. 2023-11-29T04:18:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.877+0000 7f4a1f4c9640 1 Processor -- start 2023-11-29T04:18:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.877+0000 7f4a1f4c9640 1 -- start start 2023-11-29T04:18:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1f4c9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a18070b20 0x7f4a1815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1f4c9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a1816ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1f4c9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a18162890 0x7f4a18157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1f4c9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1815bc80 con 0x7f4a18162890 2023-11-29T04:18:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1f4c9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1815b6c0 con 0x7f4a18070b20 2023-11-29T04:18:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1f4c9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1815b9a0 con 0x7f4a1815f230 2023-11-29T04:18:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1d265640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a18070b20 0x7f4a1815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1d265640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a18070b20 0x7f4a1815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53248/0 (socket says 172.21.15.6:53248) 2023-11-29T04:18:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1d265640 1 -- 172.21.15.6:0/3906249182 learned_addr learned my addr 172.21.15.6:0/3906249182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1ca64640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a1816ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.881+0000 7f4a1da66640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a18162890 0x7f4a18157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a1d265640 1 -- 172.21.15.6:0/3906249182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 msgr2=0x7f4a1816ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a1d265640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a1816ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a1d265640 1 -- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a18162890 msgr2=0x7f4a18157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a1d265640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a18162890 0x7f4a18157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a1d265640 1 -- 172.21.15.6:0/3906249182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10009a70 con 0x7f4a18070b20 2023-11-29T04:18:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a1ca64640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a1816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:20.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a1d265640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a18070b20 0x7f4a1815afe0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4a100b0040 tx=0x7f4a100196d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:20.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a0dffb640 1 -- 172.21.15.6:0/3906249182 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100a5800 con 0x7f4a18070b20 2023-11-29T04:18:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a0dffb640 1 -- 172.21.15.6:0/3906249182 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a100ad870 con 0x7f4a18070b20 2023-11-29T04:18:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a1f4c9640 1 -- 172.21.15.6:0/3906249182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a180cc890 con 0x7f4a18070b20 2023-11-29T04:18:20.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.885+0000 7f4a0dffb640 1 -- 172.21.15.6:0/3906249182 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100adc20 con 0x7f4a18070b20 2023-11-29T04:18:20.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.889+0000 7f4a1f4c9640 1 -- 172.21.15.6:0/3906249182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1816b2e0 con 0x7f4a18070b20 2023-11-29T04:18:20.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.893+0000 7f4a0dffb640 1 -- 172.21.15.6:0/3906249182 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4a100b4050 con 0x7f4a18070b20 2023-11-29T04:18:20.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.893+0000 7f4a037fe640 1 -- 172.21.15.6:0/3906249182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a180674d0 con 0x7f4a18070b20 2023-11-29T04:18:20.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.897+0000 7f4a0dffb640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49fc066570 0x7f49fc068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:20.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.897+0000 7f4a0dffb640 1 -- 172.21.15.6:0/3906249182 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4a1011e100 con 0x7f4a18070b20 2023-11-29T04:18:20.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.897+0000 7f4a1ca64640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49fc066570 0x7f49fc068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:20.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.901+0000 7f4a1ca64640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49fc066570 0x7f49fc068a30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4a18160980 tx=0x7f4a08009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:20.901+0000 7f4a0dffb640 1 -- 172.21.15.6:0/3906249182 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a100eb910 con 0x7f4a18070b20 2023-11-29T04:18:21.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.589+0000 7f4a037fe640 1 -- 172.21.15.6:0/3906249182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a18164c90 con 0x7f4a18070b20 2023-11-29T04:18:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.589+0000 7f4a0dffb640 1 -- 172.21.15.6:0/3906249182 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12876 (secure 0 0 0) 0x7f4a100eef30 con 0x7f4a18070b20 2023-11-29T04:18:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:18:21.594 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"fsid":"3f552c97-91e2-4211-95f6-2c2c108871dc","created":"2023-11-28T21:07:45.412361+0000","modified":"2023-11-29T04:18:07.127748+0000","last_up_change":"2023-11-28T21:07:57.297939+0000","last_in_change":"2023-11-28T21:07:48.079706+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T21:07:56.713465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c47bc900-8369-4b12-9aec-0a4c5621cdd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6801","nonce":3567023430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6803","nonce":3567023430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6807","nonce":3567023430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3567023430},{"type":"v1","addr":"172.21.15.6:6805","nonce":3567023430}]},"public_addr":"172.21.15.6:6801/3567023430","cluster_addr":"172.21.15.6:6803/3567023430","heartbeat_back_addr":"172.21.15.6:6807/3567023430","heartbeat_front_addr":"172.21.15.6:6805/3567023430","state":["exists","up"]},{"osd":1,"uuid":"63de0d41-a0b7-406f-bdda-6e8473682536","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6825","nonce":3767937329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6827","nonce":3767937329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6831","nonce":3767937329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3767937329},{"type":"v1","addr":"172.21.15.6:6829","nonce":3767937329}]},"public_addr":"172.21.15.6:6825/3767937329","cluster_addr":"172.21.15.6:6827/3767937329","heartbeat_back_addr":"172.21.15.6:6831/3767937329","heartbeat_front_addr":"172.21.15.6:6829/3767937329","state":["exists","up"]},{"osd":2,"uuid":"977a5b8e-90a6-4561-adf3-df6847a959ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6817","nonce":78494204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6819","nonce":78494204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6823","nonce":78494204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":78494204},{"type":"v1","addr":"172.21.15.6:6821","nonce":78494204}]},"public_addr":"172.21.15.6:6817/78494204","cluster_addr":"172.21.15.6:6819/78494204","heartbeat_back_addr":"172.21.15.6:6823/78494204","heartbeat_front_addr":"172.21.15.6:6821/78494204","state":["exists","up"]},{"osd":3,"uuid":"b62e3c5a-1faf-4a5a-b403-29c316a80810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6809","nonce":3632028675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6811","nonce":3632028675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6815","nonce":3632028675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3632028675},{"type":"v1","addr":"172.21.15.6:6813","nonce":3632028675}]},"public_addr":"172.21.15.6:6809/3632028675","cluster_addr":"172.21.15.6:6811/3632028675","heartbeat_back_addr":"172.21.15.6:6815/3632028675","heartbeat_front_addr":"172.21.15.6:6813/3632028675","state":["exists","up"]},{"osd":4,"uuid":"d92bcc50-f2bf-4e3e-87ee-6756d9d57257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6817","nonce":1640965128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6819","nonce":1640965128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6827","nonce":1640965128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":1640965128},{"type":"v1","addr":"172.21.15.31:6823","nonce":1640965128}]},"public_addr":"172.21.15.31:6817/1640965128","cluster_addr":"172.21.15.31:6819/1640965128","heartbeat_back_addr":"172.21.15.31:6827/1640965128","heartbeat_front_addr":"172.21.15.31:6823/1640965128","state":["exists","up"]},{"osd":5,"uuid":"d5451f7b-5f2a-42aa-8c4f-8eb2ac9df600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6803","nonce":2692774501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6807","nonce":2692774501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6815","nonce":2692774501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2692774501},{"type":"v1","addr":"172.21.15.31:6811","nonce":2692774501}]},"public_addr":"172.21.15.31:6803/2692774501","cluster_addr":"172.21.15.31:6807/2692774501","heartbeat_back_addr":"172.21.15.31:6815/2692774501","heartbeat_front_addr":"172.21.15.31:6811/2692774501","state":["exists","up"]},{"osd":6,"uuid":"aa4289bd-ee2d-4345-abe9-b93fa3959a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6802","nonce":2769386372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6806","nonce":2769386372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6814","nonce":2769386372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2769386372},{"type":"v1","addr":"172.21.15.31:6810","nonce":2769386372}]},"public_addr":"172.21.15.31:6802/2769386372","cluster_addr":"172.21.15.31:6806/2769386372","heartbeat_back_addr":"172.21.15.31:6814/2769386372","heartbeat_front_addr":"172.21.15.31:6810/2769386372","state":["exists","up"]},{"osd":7,"uuid":"23093f16-67ee-42da-937f-762edf716078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6822","nonce":3973817173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6826","nonce":3973817173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6831","nonce":3973817173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3973817173},{"type":"v1","addr":"172.21.15.31:6829","nonce":3973817173}]},"public_addr":"172.21.15.31:6822/3973817173","cluster_addr":"172.21.15.31:6826/3973817173","heartbeat_back_addr":"172.21.15.31:6831/3973817173","heartbeat_front_addr":"172.21.15.31:6829/3973817173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.471186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.738949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.746406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:55.264169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.853513+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.838775+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:53.718137+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T21:07:54.091735+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/2805255705":"2023-11-30T04:18:02.225914+0000","172.21.15.6:6834/2805255705":"2023-11-30T04:18:02.225914+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T04:18:21.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 -- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49fc066570 msgr2=0x7f49fc068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:21.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49fc066570 0x7f49fc068a30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4a18160980 tx=0x7f4a08009240 comp rx=0 tx=0).stop 2023-11-29T04:18:21.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 -- 172.21.15.6:0/3906249182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a18070b20 msgr2=0x7f4a1815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:21.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a18070b20 0x7f4a1815afe0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4a100b0040 tx=0x7f4a100196d0 comp rx=0 tx=0).stop 2023-11-29T04:18:21.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 -- 172.21.15.6:0/3906249182 shutdown_connections 2023-11-29T04:18:21.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f49fc066570 0x7f49fc068a30 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:21.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a18162890 0x7f4a18157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:21.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a1815f230 0x7f4a1816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:21.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 --2- 172.21.15.6:0/3906249182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a18070b20 0x7f4a1815afe0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:21.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 -- 172.21.15.6:0/3906249182 >> 172.21.15.6:0/3906249182 conn(0x7f4a1806ab80 msgr2=0x7f4a180b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:21.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 -- 172.21.15.6:0/3906249182 shutdown_connections 2023-11-29T04:18:21.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:21.597+0000 7f4a037fe640 1 -- 172.21.15.6:0/3906249182 wait complete. 2023-11-29T04:18:22.674 INFO:tasks.ceph:Scrubbing osd.0 2023-11-29T04:18:22.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-29T04:18:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.133+0000 7f978f879640 1 Processor -- start 2023-11-29T04:18:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.133+0000 7f978f879640 1 -- start start 2023-11-29T04:18:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978f879640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9788160900 0x7f97880b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978f879640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f97880b2130 0x7f97880d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978f879640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97880cdd20 con 0x7f9788160ce0 2023-11-29T04:18:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978f879640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97880d3890 con 0x7f9788160900 2023-11-29T04:18:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978f879640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97880d2b90 con 0x7f97880b2130 2023-11-29T04:18:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978d615640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9788160900 0x7f97880b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978d615640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9788160900 0x7f97880b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57776/0 (socket says 172.21.15.6:57776) 2023-11-29T04:18:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978d615640 1 -- 172.21.15.6:0/301574 learned_addr learned my addr 172.21.15.6:0/301574 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978ce14640 1 --2- 172.21.15.6:0/301574 >> v2:172.21.15.31:3300/0 conn(0x7f97880b2130 0x7f97880d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978d615640 1 -- 172.21.15.6:0/301574 >> v2:172.21.15.31:3300/0 conn(0x7f97880b2130 msgr2=0x7f97880d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978d615640 1 --2- 172.21.15.6:0/301574 >> v2:172.21.15.31:3300/0 conn(0x7f97880b2130 0x7f97880d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978d615640 1 -- 172.21.15.6:0/301574 >> v1:172.21.15.31:6789/0 conn(0x7f9788160ce0 legacy=0x7f97880d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.137+0000 7f978d615640 1 -- 172.21.15.6:0/301574 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97880d4030 con 0x7f9788160900 2023-11-29T04:18:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.145+0000 7f978d615640 1 --2- 172.21.15.6:0/301574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9788160900 0x7f97880b2ae0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f97880b5d70 tx=0x7f978401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa20597e3b28141e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:23.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.145+0000 7f977ffff640 1 -- 172.21.15.6:0/301574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840ab5f0 con 0x7f9788160900 2023-11-29T04:18:23.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.145+0000 7f977ffff640 1 -- 172.21.15.6:0/301574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840ab750 con 0x7f9788160900 2023-11-29T04:18:23.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.145+0000 7f977ffff640 1 -- 172.21.15.6:0/301574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840abae0 con 0x7f9788160900 2023-11-29T04:18:23.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.149+0000 7f978f879640 1 -- 172.21.15.6:0/301574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9788160900 msgr2=0x7f97880b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.149+0000 7f978f879640 1 --2- 172.21.15.6:0/301574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9788160900 0x7f97880b2ae0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f97880b5d70 tx=0x7f978401c500 comp rx=0 tx=0).stop 2023-11-29T04:18:23.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.149+0000 7f978f879640 1 -- 172.21.15.6:0/301574 shutdown_connections 2023-11-29T04:18:23.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.149+0000 7f978f879640 1 --2- 172.21.15.6:0/301574 >> v2:172.21.15.31:3300/0 conn(0x7f97880b2130 0x7f97880d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.149+0000 7f978f879640 1 --2- 172.21.15.6:0/301574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9788160900 0x7f97880b2ae0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.149+0000 7f978f879640 1 -- 172.21.15.6:0/301574 >> 172.21.15.6:0/301574 conn(0x7f978809c4b0 msgr2=0x7f97880d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:23.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.149+0000 7f978f879640 1 -- 172.21.15.6:0/301574 shutdown_connections 2023-11-29T04:18:23.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.149+0000 7f978f879640 1 -- 172.21.15.6:0/301574 wait complete. 2023-11-29T04:18:23.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.153+0000 7f978f879640 1 Processor -- start 2023-11-29T04:18:23.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.153+0000 7f978f879640 1 -- start start 2023-11-29T04:18:23.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978f879640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97880b2130 0x7f9788159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978f879640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788160900 0x7f97880cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978f879640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9788160ce0 0x7f978815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978f879640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978815f9c0 con 0x7f9788160ce0 2023-11-29T04:18:23.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978f879640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880c7480 con 0x7f9788160900 2023-11-29T04:18:23.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978f879640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978815f6e0 con 0x7f97880b2130 2023-11-29T04:18:23.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978d615640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97880b2130 0x7f9788159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978ce14640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788160900 0x7f97880cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978ce14640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788160900 0x7f97880cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53274/0 (socket says 172.21.15.6:53274) 2023-11-29T04:18:23.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978d615640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97880b2130 0x7f9788159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:38456/0 (socket says 172.21.15.6:38456) 2023-11-29T04:18:23.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978ce14640 1 -- 172.21.15.6:0/2403007899 learned_addr learned my addr 172.21.15.6:0/2403007899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:23.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978de16640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9788160ce0 0x7f978815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978de16640 1 -- 172.21.15.6:0/2403007899 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97880b2130 msgr2=0x7f9788159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978de16640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97880b2130 0x7f9788159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978de16640 1 -- 172.21.15.6:0/2403007899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788160900 msgr2=0x7f97880cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978de16640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788160900 0x7f97880cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.157+0000 7f978de16640 1 -- 172.21.15.6:0/2403007899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840094d0 con 0x7f9788160ce0 2023-11-29T04:18:23.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.161+0000 7f978de16640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9788160ce0 0x7f978815ec20 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f978000c700 tx=0x7f978000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:23.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.161+0000 7f977dffb640 1 -- 172.21.15.6:0/2403007899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780003b80 con 0x7f9788160ce0 2023-11-29T04:18:23.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.161+0000 7f977dffb640 1 -- 172.21.15.6:0/2403007899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780003ce0 con 0x7f9788160ce0 2023-11-29T04:18:23.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.161+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97880c6e30 con 0x7f9788160ce0 2023-11-29T04:18:23.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.161+0000 7f977dffb640 1 -- 172.21.15.6:0/2403007899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780005310 con 0x7f9788160ce0 2023-11-29T04:18:23.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.161+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97881582e0 con 0x7f9788160ce0 2023-11-29T04:18:23.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.161+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97880c6cb0 con 0x7f9788160ce0 2023-11-29T04:18:23.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.165+0000 7f977dffb640 1 -- 172.21.15.6:0/2403007899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9780005470 con 0x7f9788160ce0 2023-11-29T04:18:23.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.165+0000 7f977dffb640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f976c066470 0x7f976c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.165+0000 7f977dffb640 1 -- 172.21.15.6:0/2403007899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9780083650 con 0x7f9788160ce0 2023-11-29T04:18:23.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.165+0000 7f978d615640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f976c066470 0x7f976c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.169+0000 7f977dffb640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f976c06c2d0 0x7f976c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.169+0000 7f977dffb640 1 -- 172.21.15.6:0/2403007899 --> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f976c06eda0 con 0x7f976c06c2d0 2023-11-29T04:18:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.169+0000 7f977dffb640 1 -- 172.21.15.6:0/2403007899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9780085c30 con 0x7f9788160ce0 2023-11-29T04:18:23.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.169+0000 7f978ce14640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f976c06c2d0 0x7f976c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.169+0000 7f978d615640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f976c066470 0x7f976c068930 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f97840af000 tx=0x7f97840b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:23.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.169+0000 7f978ce14640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f976c06c2d0 0x7f976c06e6f0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:23.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.181+0000 7f977dffb640 1 -- 172.21.15.6:0/2403007899 <== osd.0 v2:172.21.15.6:6800/3567023430 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f976c06eda0 con 0x7f976c06c2d0 2023-11-29T04:18:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.221+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 --> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f97880ce230 con 0x7f976c06c2d0 2023-11-29T04:18:23.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.237+0000 7f977dffb640 1 -- 172.21.15.6:0/2403007899 <== osd.0 v2:172.21.15.6:6800/3567023430 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9778007c40 con 0x7f976c06c2d0 2023-11-29T04:18:23.242 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-29T04:18:23.242 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T04:18:23.242 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-29T04:18:23.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.237+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f976c06c2d0 msgr2=0x7f976c06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.237+0000 7f978f879640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6800/3567023430,v1:172.21.15.6:6801/3567023430] conn(0x7f976c06c2d0 0x7f976c06e6f0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.241+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f976c066470 msgr2=0x7f976c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.241+0000 7f978f879640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f976c066470 0x7f976c068930 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f97840af000 tx=0x7f97840b6040 comp rx=0 tx=0).stop 2023-11-29T04:18:23.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.241+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9788160ce0 msgr2=0x7f978815ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.241+0000 7f978f879640 1 --2- 172.21.15.6:0/2403007899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9788160ce0 0x7f978815ec20 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f978000c700 tx=0x7f978000cbc0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.241+0000 7f978de16640 1 -- 172.21.15.6:0/2403007899 reap_dead start 2023-11-29T04:18:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.241+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 shutdown_connections 2023-11-29T04:18:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.241+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 >> 172.21.15.6:0/2403007899 conn(0x7f978809c4b0 msgr2=0x7f978815fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:23.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.241+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 shutdown_connections 2023-11-29T04:18:23.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.241+0000 7f978f879640 1 -- 172.21.15.6:0/2403007899 wait complete. 2023-11-29T04:18:23.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-29T04:18:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.709+0000 7ff4dbebb640 1 Processor -- start 2023-11-29T04:18:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.709+0000 7ff4dbebb640 1 -- start start 2023-11-29T04:18:23.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.713+0000 7ff4dbebb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d40cc3f0 0x7ff4d415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.713+0000 7ff4dbebb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d40ccb60 con 0x7ff4d415c270 2023-11-29T04:18:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.713+0000 7ff4dbebb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d40cce40 con 0x7ff4d406ca00 2023-11-29T04:18:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.713+0000 7ff4dbebb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40cd400 con 0x7ff4d40cc3f0 2023-11-29T04:18:23.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.717+0000 7ff4d9c57640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff4d406ca00 0x7ff4d406cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:40128/0 (socket says 172.21.15.6:40128) 2023-11-29T04:18:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.717+0000 7ff4d9c57640 1 -- 172.21.15.6:0/3732085238 learned_addr learned my addr 172.21.15.6:0/3732085238 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.717+0000 7ff4d9456640 1 --2- 172.21.15.6:0/3732085238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d40cc3f0 0x7ff4d415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.717+0000 7ff4d8c55640 1 -- 172.21.15.6:0/3732085238 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679718940 0 0) 0x7ff4d40cce40 con 0x7ff4d406ca00 2023-11-29T04:18:23.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.717+0000 7ff4d8c55640 1 -- 172.21.15.6:0/3732085238 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4bc003530 con 0x7ff4d406ca00 2023-11-29T04:18:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.717+0000 7ff4d8c55640 1 -- 172.21.15.6:0/3732085238 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1849499872 0 0) 0x7ff4bc003530 con 0x7ff4d406ca00 2023-11-29T04:18:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.717+0000 7ff4d9456640 1 -- 172.21.15.6:0/3732085238 >> v1:172.21.15.31:6789/0 conn(0x7ff4d406ca00 legacy=0x7ff4d406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.717+0000 7ff4d9456640 1 -- 172.21.15.6:0/3732085238 >> v1:172.21.15.6:6789/0 conn(0x7ff4d415c270 legacy=0x7ff4d415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.717+0000 7ff4d9456640 1 -- 172.21.15.6:0/3732085238 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d40cd120 con 0x7ff4d40cc3f0 2023-11-29T04:18:23.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.721+0000 7ff4d9456640 1 --2- 172.21.15.6:0/3732085238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d40cc3f0 0x7ff4d415bd30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009770 tx=0x7ff4c801c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426c15c882653030 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:23.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.721+0000 7ff4d8c55640 1 -- 172.21.15.6:0/3732085238 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4001a00 con 0x7ff4d40cc3f0 2023-11-29T04:18:23.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.721+0000 7ff4d8c55640 1 -- 172.21.15.6:0/3732085238 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c80a7050 con 0x7ff4d40cc3f0 2023-11-29T04:18:23.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.721+0000 7ff4d8c55640 1 -- 172.21.15.6:0/3732085238 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80ab600 con 0x7ff4d40cc3f0 2023-11-29T04:18:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.721+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3732085238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d40cc3f0 msgr2=0x7ff4d415bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.721+0000 7ff4dbebb640 1 --2- 172.21.15.6:0/3732085238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d40cc3f0 0x7ff4d415bd30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009770 tx=0x7ff4c801c2f0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.721+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3732085238 shutdown_connections 2023-11-29T04:18:23.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.721+0000 7ff4dbebb640 1 --2- 172.21.15.6:0/3732085238 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d40cc3f0 0x7ff4d415bd30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.721+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3732085238 >> 172.21.15.6:0/3732085238 conn(0x7ff4d406a980 msgr2=0x7ff4d406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:23.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.725+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3732085238 shutdown_connections 2023-11-29T04:18:23.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.725+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3732085238 wait complete. 2023-11-29T04:18:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.729+0000 7ff4dbebb640 1 Processor -- start 2023-11-29T04:18:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.733+0000 7ff4dbebb640 1 -- start start 2023-11-29T04:18:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4dbebb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d406ca00 0x7ff4d4159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4dbebb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d40cc3f0 0x7ff4d4148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4dbebb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4d415c270 0x7ff4d41558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4dbebb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d414a540 con 0x7ff4d40cc3f0 2023-11-29T04:18:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4dbebb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4157820 con 0x7ff4d415c270 2023-11-29T04:18:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4dbebb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d41574f0 con 0x7ff4d406ca00 2023-11-29T04:18:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9456640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d40cc3f0 0x7ff4d4148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9c57640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d406ca00 0x7ff4d4159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9456640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d40cc3f0 0x7ff4d4148990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57794/0 (socket says 172.21.15.6:57794) 2023-11-29T04:18:23.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9456640 1 -- 172.21.15.6:0/3641908881 learned_addr learned my addr 172.21.15.6:0/3641908881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:23.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4da458640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4d415c270 0x7ff4d41558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9c57640 1 -- 172.21.15.6:0/3641908881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4d415c270 msgr2=0x7ff4d41558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9c57640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4d415c270 0x7ff4d41558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9c57640 1 -- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d40cc3f0 msgr2=0x7ff4d4148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9c57640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d40cc3f0 0x7ff4d4148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9c57640 1 -- 172.21.15.6:0/3641908881 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c8009420 con 0x7ff4d406ca00 2023-11-29T04:18:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9456640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d40cc3f0 0x7ff4d4148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4da458640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4d415c270 0x7ff4d41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.737+0000 7ff4d9c57640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d406ca00 0x7ff4d4159010 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4002240 tx=0x7ff4c400cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.741+0000 7ff4d27fc640 1 -- 172.21.15.6:0/3641908881 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400a700 con 0x7ff4d406ca00 2023-11-29T04:18:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.741+0000 7ff4d27fc640 1 -- 172.21.15.6:0/3641908881 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c400a860 con 0x7ff4d406ca00 2023-11-29T04:18:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.741+0000 7ff4d27fc640 1 -- 172.21.15.6:0/3641908881 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400ac90 con 0x7ff4d406ca00 2023-11-29T04:18:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.741+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d4149ca0 con 0x7ff4d406ca00 2023-11-29T04:18:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.741+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d414a260 con 0x7ff4d406ca00 2023-11-29T04:18:23.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.741+0000 7ff4d27fc640 1 -- 172.21.15.6:0/3641908881 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4c40070d0 con 0x7ff4d406ca00 2023-11-29T04:18:23.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.741+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d4072b90 con 0x7ff4d406ca00 2023-11-29T04:18:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.745+0000 7ff4d27fc640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4c0066470 0x7ff4c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.745+0000 7ff4d27fc640 1 -- 172.21.15.6:0/3641908881 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff4c40830c0 con 0x7ff4d406ca00 2023-11-29T04:18:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.745+0000 7ff4d9456640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4c0066470 0x7ff4c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.745+0000 7ff4d9456640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4c0066470 0x7ff4c0068930 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff4c801c330 tx=0x7ff4c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:23.749+0000 7ff4d27fc640 1 -- 172.21.15.6:0/3641908881 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4c40508e0 con 0x7ff4d406ca00 2023-11-29T04:18:24.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.221+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4d4070390 con 0x7ff4c0066470 2023-11-29T04:18:24.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.221+0000 7ff4d27fc640 1 -- 172.21.15.6:0/3641908881 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff4c80abbf0 con 0x7ff4c0066470 2023-11-29T04:18:24.226 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2023-11-29T04:18:24.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.225+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4c0066470 msgr2=0x7ff4c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.225+0000 7ff4dbebb640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4c0066470 0x7ff4c0068930 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff4c801c330 tx=0x7ff4c8008040 comp rx=0 tx=0).stop 2023-11-29T04:18:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.225+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d406ca00 msgr2=0x7ff4d4159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.225+0000 7ff4dbebb640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d406ca00 0x7ff4d4159010 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4002240 tx=0x7ff4c400cf50 comp rx=0 tx=0).stop 2023-11-29T04:18:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.225+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 shutdown_connections 2023-11-29T04:18:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.225+0000 7ff4dbebb640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ff4c0066470 0x7ff4c0068930 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.225+0000 7ff4dbebb640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4d415c270 0x7ff4d41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.225+0000 7ff4dbebb640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d40cc3f0 0x7ff4d4148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.225+0000 7ff4dbebb640 1 --2- 172.21.15.6:0/3641908881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4d406ca00 0x7ff4d4159010 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.229+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 >> 172.21.15.6:0/3641908881 conn(0x7ff4d406a980 msgr2=0x7ff4d415e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.229+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 shutdown_connections 2023-11-29T04:18:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.229+0000 7ff4dbebb640 1 -- 172.21.15.6:0/3641908881 wait complete. 2023-11-29T04:18:24.281 INFO:tasks.ceph:Scrubbing osd.1 2023-11-29T04:18:24.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-29T04:18:24.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.681+0000 7f7baeabb640 1 Processor -- start 2023-11-29T04:18:24.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.681+0000 7f7baeabb640 1 -- start start 2023-11-29T04:18:24.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.681+0000 7f7baeabb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba80b2130 0x7f7ba80d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:24.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.681+0000 7f7baeabb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ba8160ce0 0x7f7ba80d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:24.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7baeabb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba80cdd20 con 0x7f7ba8160900 2023-11-29T04:18:24.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7baeabb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba80d3890 con 0x7f7ba8160ce0 2023-11-29T04:18:24.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7baeabb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80d2b90 con 0x7f7ba80b2130 2023-11-29T04:18:24.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7ba7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba80b2130 0x7f7ba80d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:24.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7bac857640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7ba8160900 0x7f7ba80b2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50648/0 (socket says 172.21.15.6:50648) 2023-11-29T04:18:24.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7bac857640 1 -- 172.21.15.6:0/2989492922 learned_addr learned my addr 172.21.15.6:0/2989492922 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:24.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7bad058640 1 --2- 172.21.15.6:0/2989492922 >> v2:172.21.15.6:3300/0 conn(0x7f7ba8160ce0 0x7f7ba80d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:24.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7ba77fe640 1 -- 172.21.15.6:0/2989492922 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684564828 0 0) 0x7f7ba80cdd20 con 0x7f7ba8160900 2023-11-29T04:18:24.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7ba77fe640 1 -- 172.21.15.6:0/2989492922 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b98003530 con 0x7f7ba8160900 2023-11-29T04:18:24.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7ba7fff640 1 -- 172.21.15.6:0/2989492922 >> v2:172.21.15.6:3300/0 conn(0x7f7ba8160ce0 msgr2=0x7f7ba80d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:24.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7ba7fff640 1 --2- 172.21.15.6:0/2989492922 >> v2:172.21.15.6:3300/0 conn(0x7f7ba8160ce0 0x7f7ba80d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7ba7fff640 1 -- 172.21.15.6:0/2989492922 >> v1:172.21.15.6:6789/0 conn(0x7f7ba8160900 legacy=0x7f7ba80b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:24.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.685+0000 7f7ba7fff640 1 -- 172.21.15.6:0/2989492922 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba80d4030 con 0x7f7ba80b2130 2023-11-29T04:18:24.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.693+0000 7f7ba7fff640 1 --2- 172.21.15.6:0/2989492922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba80b2130 0x7f7ba80d0560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7b940097c0 tx=0x7f7b9401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e67bfa5a90f66c37 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.693+0000 7f7ba77fe640 1 -- 172.21.15.6:0/2989492922 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940ad640 con 0x7f7ba80b2130 2023-11-29T04:18:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.693+0000 7f7ba77fe640 1 -- 172.21.15.6:0/2989492922 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b940ad7a0 con 0x7f7ba80b2130 2023-11-29T04:18:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.693+0000 7f7ba77fe640 1 -- 172.21.15.6:0/2989492922 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940adb30 con 0x7f7ba80b2130 2023-11-29T04:18:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 -- 172.21.15.6:0/2989492922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba80b2130 msgr2=0x7f7ba80d0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 --2- 172.21.15.6:0/2989492922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba80b2130 0x7f7ba80d0560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7b940097c0 tx=0x7f7b9401c480 comp rx=0 tx=0).stop 2023-11-29T04:18:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 -- 172.21.15.6:0/2989492922 shutdown_connections 2023-11-29T04:18:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 --2- 172.21.15.6:0/2989492922 >> v2:172.21.15.6:3300/0 conn(0x7f7ba8160ce0 0x7f7ba80d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 --2- 172.21.15.6:0/2989492922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba80b2130 0x7f7ba80d0560 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 -- 172.21.15.6:0/2989492922 >> 172.21.15.6:0/2989492922 conn(0x7f7ba809c4b0 msgr2=0x7f7ba80d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 -- 172.21.15.6:0/2989492922 shutdown_connections 2023-11-29T04:18:24.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 -- 172.21.15.6:0/2989492922 wait complete. 2023-11-29T04:18:24.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 Processor -- start 2023-11-29T04:18:24.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.697+0000 7f7baeabb640 1 -- start start 2023-11-29T04:18:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7baeabb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ba80b2130 0x7f7ba8150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7baeabb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba8160900 0x7f7ba815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7baeabb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba8160ce0 0x7f7ba80b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7baeabb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80cb980 con 0x7f7ba8160ce0 2023-11-29T04:18:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7baeabb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80cad00 con 0x7f7ba80b2130 2023-11-29T04:18:24.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7baeabb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80cafe0 con 0x7f7ba8160900 2023-11-29T04:18:24.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba8160900 0x7f7ba815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7bac857640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ba80b2130 0x7f7ba8150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba7fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba8160900 0x7f7ba815ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:38498/0 (socket says 172.21.15.6:38498) 2023-11-29T04:18:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba7fff640 1 -- 172.21.15.6:0/4185675038 learned_addr learned my addr 172.21.15.6:0/4185675038 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7bad058640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba8160ce0 0x7f7ba80b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba7fff640 1 -- 172.21.15.6:0/4185675038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ba80b2130 msgr2=0x7f7ba8150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:24.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba7fff640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ba80b2130 0x7f7ba8150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba7fff640 1 -- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba8160ce0 msgr2=0x7f7ba80b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba7fff640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba8160ce0 0x7f7ba80b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba7fff640 1 -- 172.21.15.6:0/4185675038 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94009420 con 0x7f7ba8160900 2023-11-29T04:18:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba7fff640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba8160900 0x7f7ba815ce00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7b9401a0b0 tx=0x7f7b94019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:24.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba57fa640 1 -- 172.21.15.6:0/4185675038 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940b6610 con 0x7f7ba8160900 2023-11-29T04:18:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba57fa640 1 -- 172.21.15.6:0/4185675038 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b940a6040 con 0x7f7ba8160900 2023-11-29T04:18:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba80cb2c0 con 0x7f7ba8160900 2023-11-29T04:18:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7ba57fa640 1 -- 172.21.15.6:0/4185675038 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940b69d0 con 0x7f7ba8160900 2023-11-29T04:18:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.701+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba8151cf0 con 0x7f7ba8160900 2023-11-29T04:18:24.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.705+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ba80a0ff0 con 0x7f7ba8160900 2023-11-29T04:18:24.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.709+0000 7f7ba57fa640 1 -- 172.21.15.6:0/4185675038 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b940b4040 con 0x7f7ba8160900 2023-11-29T04:18:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.709+0000 7f7ba57fa640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b8c066470 0x7f7b8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.709+0000 7f7ba57fa640 1 -- 172.21.15.6:0/4185675038 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7b9411e1b0 con 0x7f7ba8160900 2023-11-29T04:18:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.709+0000 7f7bac857640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b8c066470 0x7f7b8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.709+0000 7f7ba57fa640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7f7b8c06c2d0 0x7f7b8c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.709+0000 7f7ba57fa640 1 -- 172.21.15.6:0/4185675038 --> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b8c06eda0 con 0x7f7b8c06c2d0 2023-11-29T04:18:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.709+0000 7f7ba57fa640 1 -- 172.21.15.6:0/4185675038 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b9411e520 con 0x7f7ba8160900 2023-11-29T04:18:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.713+0000 7f7bad058640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7f7b8c06c2d0 0x7f7b8c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:24.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.713+0000 7f7bad058640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7f7b8c06c2d0 0x7f7b8c06e6f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:24.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.713+0000 7f7bac857640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b8c066470 0x7f7b8c068930 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0011f0 tx=0x7f7b9c007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.713+0000 7f7ba57fa640 1 -- 172.21.15.6:0/4185675038 <== osd.1 v2:172.21.15.6:6824/3767937329 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7b8c06eda0 con 0x7f7b8c06c2d0 2023-11-29T04:18:24.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.729+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 --> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7ba80c9630 con 0x7f7b8c06c2d0 2023-11-29T04:18:24.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.729+0000 7f7ba57fa640 1 -- 172.21.15.6:0/4185675038 <== osd.1 v2:172.21.15.6:6824/3767937329 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7ba80c9630 con 0x7f7b8c06c2d0 2023-11-29T04:18:24.734 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-29T04:18:24.734 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T04:18:24.734 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-29T04:18:24.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.729+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7f7b8c06c2d0 msgr2=0x7f7b8c06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.729+0000 7f7baeabb640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6824/3767937329,v1:172.21.15.6:6825/3767937329] conn(0x7f7b8c06c2d0 0x7f7b8c06e6f0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.733+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b8c066470 msgr2=0x7f7b8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.733+0000 7f7baeabb640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7b8c066470 0x7f7b8c068930 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0011f0 tx=0x7f7b9c007d40 comp rx=0 tx=0).stop 2023-11-29T04:18:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.733+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba8160900 msgr2=0x7f7ba815ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.733+0000 7f7baeabb640 1 --2- 172.21.15.6:0/4185675038 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ba8160900 0x7f7ba815ce00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7b9401a0b0 tx=0x7f7b94019220 comp rx=0 tx=0).stop 2023-11-29T04:18:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.733+0000 7f7bad058640 1 -- 172.21.15.6:0/4185675038 reap_dead start 2023-11-29T04:18:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.733+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 shutdown_connections 2023-11-29T04:18:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.733+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 >> 172.21.15.6:0/4185675038 conn(0x7f7ba809c4b0 msgr2=0x7f7ba806ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.733+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 shutdown_connections 2023-11-29T04:18:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:24.733+0000 7f7baeabb640 1 -- 172.21.15.6:0/4185675038 wait complete. 2023-11-29T04:18:24.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-29T04:18:25.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.161+0000 7fb8a9c9c640 1 Processor -- start 2023-11-29T04:18:25.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.161+0000 7fb8a9c9c640 1 -- start start 2023-11-29T04:18:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a9c9c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8a415fcf0 0x7fb8a40d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a9c9c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb8a40ceec0 0x7fb8a40b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a9c9c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40cea30 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a9c9c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40d3ef0 con 0x7fb8a415fcf0 2023-11-29T04:18:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a9c9c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40b2430 con 0x7fb8a40ceec0 2023-11-29T04:18:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8a415fcf0 0x7fb8a40d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a2ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb8a40ceec0 0x7fb8a40b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a2ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb8a40ceec0 0x7fb8a40b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53300/0 (socket says 172.21.15.6:53300) 2023-11-29T04:18:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a2ffd640 1 -- 172.21.15.6:0/2207656923 learned_addr learned my addr 172.21.15.6:0/2207656923 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a37fe640 1 -- 172.21.15.6:0/2207656923 >> v2:172.21.15.31:3300/0 conn(0x7fb8a40ceec0 msgr2=0x7fb8a40b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a37fe640 1 --2- 172.21.15.6:0/2207656923 >> v2:172.21.15.31:3300/0 conn(0x7fb8a40ceec0 0x7fb8a40b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a37fe640 1 -- 172.21.15.6:0/2207656923 >> v1:172.21.15.6:6789/0 conn(0x7fb8a40b2ff0 legacy=0x7fb8a40cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.165+0000 7fb8a37fe640 1 -- 172.21.15.6:0/2207656923 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a41610e0 con 0x7fb8a415fcf0 2023-11-29T04:18:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.169+0000 7fb8a37fe640 1 --2- 172.21.15.6:0/2207656923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8a415fcf0 0x7fb8a40d3860 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40b2620 tx=0x7fb89401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8188b2b8e4fa633e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.169+0000 7fb8a27fc640 1 -- 172.21.15.6:0/2207656923 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940ab600 con 0x7fb8a415fcf0 2023-11-29T04:18:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.169+0000 7fb8a27fc640 1 -- 172.21.15.6:0/2207656923 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8940a7050 con 0x7fb8a415fcf0 2023-11-29T04:18:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.169+0000 7fb8a27fc640 1 -- 172.21.15.6:0/2207656923 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940ab980 con 0x7fb8a415fcf0 2023-11-29T04:18:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.173+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/2207656923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8a415fcf0 msgr2=0x7fb8a40d3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.173+0000 7fb8a9c9c640 1 --2- 172.21.15.6:0/2207656923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8a415fcf0 0x7fb8a40d3860 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40b2620 tx=0x7fb89401c3a0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.173+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/2207656923 shutdown_connections 2023-11-29T04:18:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.173+0000 7fb8a9c9c640 1 --2- 172.21.15.6:0/2207656923 >> v2:172.21.15.31:3300/0 conn(0x7fb8a40ceec0 0x7fb8a40b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.173+0000 7fb8a9c9c640 1 --2- 172.21.15.6:0/2207656923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8a415fcf0 0x7fb8a40d3860 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.173+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/2207656923 >> 172.21.15.6:0/2207656923 conn(0x7fb8a409c480 msgr2=0x7fb8a40d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.173+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/2207656923 shutdown_connections 2023-11-29T04:18:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.173+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/2207656923 wait complete. 2023-11-29T04:18:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.177+0000 7fb8a9c9c640 1 Processor -- start 2023-11-29T04:18:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.177+0000 7fb8a9c9c640 1 -- start start 2023-11-29T04:18:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a9c9c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a40b2ff0 0x7fb8a415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a9c9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8a40ceec0 0x7fb8a40cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a9c9c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8a415fcf0 0x7fb8a415c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a9c9c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c7d00 con 0x7fb8a40ceec0 2023-11-29T04:18:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a9c9c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c70f0 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a9c9c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c73d0 con 0x7fb8a415fcf0 2023-11-29T04:18:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8a40ceec0 0x7fb8a40cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a40b2ff0 0x7fb8a415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a40b2ff0 0x7fb8a415aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53302/0 (socket says 172.21.15.6:53302) 2023-11-29T04:18:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a37fe640 1 -- 172.21.15.6:0/666307069 learned_addr learned my addr 172.21.15.6:0/666307069 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a3fff640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8a415fcf0 0x7fb8a415c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a37fe640 1 -- 172.21.15.6:0/666307069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8a415fcf0 msgr2=0x7fb8a415c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a37fe640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8a415fcf0 0x7fb8a415c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a37fe640 1 -- 172.21.15.6:0/666307069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8a40ceec0 msgr2=0x7fb8a40cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a37fe640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8a40ceec0 0x7fb8a40cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a37fe640 1 -- 172.21.15.6:0/666307069 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb894009420 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.181+0000 7fb8a37fe640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a40b2ff0 0x7fb8a415aa50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb8940ae040 tx=0x7fb89401abe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.185+0000 7fb88bfff640 1 -- 172.21.15.6:0/666307069 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940b7450 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.185+0000 7fb88bfff640 1 -- 172.21.15.6:0/666307069 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8940b75d0 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.185+0000 7fb88bfff640 1 -- 172.21.15.6:0/666307069 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940b7980 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.185+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40c76b0 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.185+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40cc390 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.185+0000 7fb88bfff640 1 -- 172.21.15.6:0/666307069 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb8940b7ae0 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.185+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a40c7e70 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.189+0000 7fb88bfff640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb890066470 0x7fb890068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.189+0000 7fb88bfff640 1 -- 172.21.15.6:0/666307069 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb89411e340 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.189+0000 7fb8a2ffd640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb890066470 0x7fb890068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.189+0000 7fb8a2ffd640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb890066470 0x7fb890068930 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40b8ad0 tx=0x7fb898009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:25.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.193+0000 7fb88bfff640 1 -- 172.21.15.6:0/666307069 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb8940ebc50 con 0x7fb8a40b2ff0 2023-11-29T04:18:25.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.661+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8a416a370 con 0x7fb890066470 2023-11-29T04:18:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.661+0000 7fb88bfff640 1 -- 172.21.15.6:0/666307069 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb898011a30 con 0x7fb890066470 2023-11-29T04:18:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2023-11-29T04:18:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.665+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb890066470 msgr2=0x7fb890068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb890066470 0x7fb890068930 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40b8ad0 tx=0x7fb898009240 comp rx=0 tx=0).stop 2023-11-29T04:18:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a40b2ff0 msgr2=0x7fb8a415aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a40b2ff0 0x7fb8a415aa50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb8940ae040 tx=0x7fb89401abe0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 shutdown_connections 2023-11-29T04:18:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fb890066470 0x7fb890068930 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8a415fcf0 0x7fb8a415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8a40ceec0 0x7fb8a40cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 --2- 172.21.15.6:0/666307069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8a40b2ff0 0x7fb8a415aa50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 >> 172.21.15.6:0/666307069 conn(0x7fb8a409c480 msgr2=0x7fb8a406b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 shutdown_connections 2023-11-29T04:18:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.669+0000 7fb8a9c9c640 1 -- 172.21.15.6:0/666307069 wait complete. 2023-11-29T04:18:25.722 INFO:tasks.ceph:Scrubbing osd.2 2023-11-29T04:18:25.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-29T04:18:25.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.945+0000 7fea0e13b640 1 Processor -- start 2023-11-29T04:18:25.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.945+0000 7fea0e13b640 1 -- start start 2023-11-29T04:18:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fea0e13b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea0806e160 0x7fea0806c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fea0e13b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea0806c5b0 0x7fea08070350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fea0e13b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080b3220 con 0x7fea08072080 2023-11-29T04:18:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fea0e13b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea0806ca40 con 0x7fea0806c5b0 2023-11-29T04:18:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fea0e13b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea080b36b0 con 0x7fea0806e160 2023-11-29T04:18:25.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fea0d139640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fea08072080 0x7fea080b38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:40142/0 (socket says 172.21.15.6:40142) 2023-11-29T04:18:25.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fea0d139640 1 -- 172.21.15.6:0/654572937 learned_addr learned my addr 172.21.15.6:0/654572937 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:25.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fea0c938640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea0806e160 0x7fea0806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fea0d93a640 1 --2- 172.21.15.6:0/654572937 >> v2:172.21.15.6:3300/0 conn(0x7fea0806c5b0 0x7fea08070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016718085 0 0) 0x7fea080b3220 con 0x7fea08072080 2023-11-29T04:18:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f4003530 con 0x7fea08072080 2023-11-29T04:18:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4066418936 0 0) 0x7fe9f4003530 con 0x7fea08072080 2023-11-29T04:18:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea0806e160 msgr2=0x7fea0806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea0806e160 0x7fea0806c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 >> v2:172.21.15.6:3300/0 conn(0x7fea0806c5b0 msgr2=0x7fea08070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 --2- 172.21.15.6:0/654572937 >> v2:172.21.15.6:3300/0 conn(0x7fea0806c5b0 0x7fea08070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08072460 con 0x7fea08072080 2023-11-29T04:18:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3227987906 0 0) 0x7fea04001680 con 0x7fea08072080 2023-11-29T04:18:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 >> v1:172.21.15.31:6789/0 conn(0x7fea08072080 legacy=0x7fea080b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9f40039b0 0x7fe9f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40047d0 0x7fe9f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.949+0000 7fe9fffff640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f4005190 0x7fe9f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0806ca40 con 0x7fe9f40039b0 2023-11-29T04:18:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080b36b0 con 0x7fe9f40047d0 2023-11-29T04:18:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f400bf80 con 0x7fe9f4005190 2023-11-29T04:18:25.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fea0d139640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9f40039b0 0x7fe9f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fea0d139640 1 -- 172.21.15.6:0/654572937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f4005190 msgr2=0x7fe9f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fea0d139640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9f4005190 0x7fe9f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fea0d139640 1 -- 172.21.15.6:0/654572937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40047d0 msgr2=0x7fe9f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fea0d139640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40047d0 0x7fe9f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fea0d139640 1 -- 172.21.15.6:0/654572937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f4003530 con 0x7fe9f40039b0 2023-11-29T04:18:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.953+0000 7fea0d139640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9f40039b0 0x7fe9f4003dd0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fea04007fa0 tx=0x7fea0401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9523032686be0126 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040058e0 con 0x7fe9f40039b0 2023-11-29T04:18:25.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea04005a40 con 0x7fe9f40039b0 2023-11-29T04:18:25.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fe9fffff640 1 -- 172.21.15.6:0/654572937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04005df0 con 0x7fe9f40039b0 2023-11-29T04:18:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fea0e13b640 1 -- 172.21.15.6:0/654572937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9f40039b0 msgr2=0x7fe9f4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fea0e13b640 1 --2- 172.21.15.6:0/654572937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9f40039b0 0x7fe9f4003dd0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fea04007fa0 tx=0x7fea0401cab0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fea0d93a640 1 -- 172.21.15.6:0/654572937 reap_dead start 2023-11-29T04:18:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fea0e13b640 1 -- 172.21.15.6:0/654572937 shutdown_connections 2023-11-29T04:18:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fea0e13b640 1 -- 172.21.15.6:0/654572937 >> 172.21.15.6:0/654572937 conn(0x7fea080b0860 msgr2=0x7fea080b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:25.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fea0e13b640 1 -- 172.21.15.6:0/654572937 shutdown_connections 2023-11-29T04:18:25.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.957+0000 7fea0e13b640 1 -- 172.21.15.6:0/654572937 wait complete. 2023-11-29T04:18:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0e13b640 1 Processor -- start 2023-11-29T04:18:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0e13b640 1 -- start start 2023-11-29T04:18:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0e13b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40039b0 0x7fea081632e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0e13b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea0812f640 0x7fea08130c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0e13b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea08131190 0x7fea08132b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0e13b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea08130830 con 0x7fea08131190 2023-11-29T04:18:25.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0e13b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea08140a20 con 0x7fe9f40039b0 2023-11-29T04:18:25.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0e13b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0812fbb0 con 0x7fea0812f640 2023-11-29T04:18:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d93a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea08131190 0x7fea08132b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d93a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea08131190 0x7fea08132b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57860/0 (socket says 172.21.15.6:57860) 2023-11-29T04:18:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d93a640 1 -- 172.21.15.6:0/2494487562 learned_addr learned my addr 172.21.15.6:0/2494487562 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0c938640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea0812f640 0x7fea08130c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d139640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40039b0 0x7fea081632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d93a640 1 -- 172.21.15.6:0/2494487562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea0812f640 msgr2=0x7fea08130c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d93a640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea0812f640 0x7fea08130c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d93a640 1 -- 172.21.15.6:0/2494487562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40039b0 msgr2=0x7fea081632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d93a640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40039b0 0x7fea081632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d93a640 1 -- 172.21.15.6:0/2494487562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0812fe90 con 0x7fea08131190 2023-11-29T04:18:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d139640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40039b0 0x7fea081632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T04:18:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fea0d93a640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea08131190 0x7fea08132b30 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fea0809d000 tx=0x7fea0000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:25.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.961+0000 7fe9fdffb640 1 -- 172.21.15.6:0/2494487562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00010040 con 0x7fea08131190 2023-11-29T04:18:25.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.965+0000 7fe9fdffb640 1 -- 172.21.15.6:0/2494487562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0000bae0 con 0x7fea08131190 2023-11-29T04:18:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.965+0000 7fe9fdffb640 1 -- 172.21.15.6:0/2494487562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0000be90 con 0x7fea08131190 2023-11-29T04:18:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.965+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea08130170 con 0x7fea08131190 2023-11-29T04:18:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.965+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea08133070 con 0x7fea08131190 2023-11-29T04:18:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.965+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea0806d570 con 0x7fea08131190 2023-11-29T04:18:25.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.965+0000 7fe9fdffb640 1 -- 172.21.15.6:0/2494487562 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fea00028430 con 0x7fea08131190 2023-11-29T04:18:25.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.969+0000 7fe9fdffb640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe9ec0664f0 0x7fe9ec0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.969+0000 7fe9fdffb640 1 -- 172.21.15.6:0/2494487562 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fea00084690 con 0x7fea08131190 2023-11-29T04:18:25.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.969+0000 7fea0d139640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe9ec0664f0 0x7fe9ec0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.969+0000 7fe9fdffb640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fe9ec06c1e0 0x7fe9ec06e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:25.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.969+0000 7fe9fdffb640 1 -- 172.21.15.6:0/2494487562 --> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9ec06ecb0 con 0x7fe9ec06c1e0 2023-11-29T04:18:25.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.969+0000 7fe9fdffb640 1 -- 172.21.15.6:0/2494487562 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea00084a00 con 0x7fea08131190 2023-11-29T04:18:25.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.969+0000 7fea0c938640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fe9ec06c1e0 0x7fe9ec06e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:25.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.973+0000 7fea0d139640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe9ec0664f0 0x7fe9ec0689b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fea040aa000 tx=0x7fea080ce830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:25.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.973+0000 7fea0c938640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fe9ec06c1e0 0x7fe9ec06e600 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:25.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.973+0000 7fe9fdffb640 1 -- 172.21.15.6:0/2494487562 <== osd.2 v2:172.21.15.6:6816/78494204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe9ec06ecb0 con 0x7fe9ec06c1e0 2023-11-29T04:18:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 --> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fea080b2eb0 con 0x7fe9ec06c1e0 2023-11-29T04:18:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fe9fdffb640 1 -- 172.21.15.6:0/2494487562 <== osd.2 v2:172.21.15.6:6816/78494204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe9f8009ac0 con 0x7fe9ec06c1e0 2023-11-29T04:18:25.993 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-29T04:18:25.993 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T04:18:25.993 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-29T04:18:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fe9ec06c1e0 msgr2=0x7fe9ec06e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6816/78494204,v1:172.21.15.6:6817/78494204] conn(0x7fe9ec06c1e0 0x7fe9ec06e600 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe9ec0664f0 msgr2=0x7fe9ec0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe9ec0664f0 0x7fe9ec0689b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fea040aa000 tx=0x7fea080ce830 comp rx=0 tx=0).stop 2023-11-29T04:18:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea08131190 msgr2=0x7fea08132b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 --2- 172.21.15.6:0/2494487562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea08131190 0x7fea08132b30 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fea0809d000 tx=0x7fea0000b480 comp rx=0 tx=0).stop 2023-11-29T04:18:25.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0d93a640 1 -- 172.21.15.6:0/2494487562 reap_dead start 2023-11-29T04:18:25.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 shutdown_connections 2023-11-29T04:18:25.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 >> 172.21.15.6:0/2494487562 conn(0x7fea080b0860 msgr2=0x7fea080af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:25.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 shutdown_connections 2023-11-29T04:18:25.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:25.989+0000 7fea0e13b640 1 -- 172.21.15.6:0/2494487562 wait complete. 2023-11-29T04:18:26.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-29T04:18:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.449+0000 7f51ff209640 1 Processor -- start 2023-11-29T04:18:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.449+0000 7f51ff209640 1 -- start start 2023-11-29T04:18:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51ff209640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51f815fcf0 0x7f51f80d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51ff209640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f80b31c0 0x7f51f81600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51ff209640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f80cea30 con 0x7f51f80ceec0 2023-11-29T04:18:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51ff209640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f80d3ef0 con 0x7f51f815fcf0 2023-11-29T04:18:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51ff209640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80b2430 con 0x7f51f80b31c0 2023-11-29T04:18:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51fcfa5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51f815fcf0 0x7f51f80d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51f7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51f80ceec0 0x7f51f80b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50668/0 (socket says 172.21.15.6:50668) 2023-11-29T04:18:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51f7fff640 1 -- 172.21.15.6:0/4102586063 learned_addr learned my addr 172.21.15.6:0/4102586063 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51fd7a6640 1 --2- 172.21.15.6:0/4102586063 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f80b31c0 0x7f51f81600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51fd7a6640 1 -- 172.21.15.6:0/4102586063 >> v2:172.21.15.6:3300/0 conn(0x7f51f815fcf0 msgr2=0x7f51f80d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51fd7a6640 1 --2- 172.21.15.6:0/4102586063 >> v2:172.21.15.6:3300/0 conn(0x7f51f815fcf0 0x7f51f80d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51fd7a6640 1 -- 172.21.15.6:0/4102586063 >> v1:172.21.15.6:6789/0 conn(0x7f51f80ceec0 legacy=0x7f51f80b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:26.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.453+0000 7f51fd7a6640 1 -- 172.21.15.6:0/4102586063 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f80d1c00 con 0x7f51f80b31c0 2023-11-29T04:18:26.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.457+0000 7f51fd7a6640 1 --2- 172.21.15.6:0/4102586063 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f80b31c0 0x7f51f81600d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009d90 tx=0x7f51f001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b429420b30bbbfd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:26.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.457+0000 7f51f77fe640 1 -- 172.21.15.6:0/4102586063 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00a5930 con 0x7f51f80b31c0 2023-11-29T04:18:26.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.457+0000 7f51f77fe640 1 -- 172.21.15.6:0/4102586063 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f00a5a90 con 0x7f51f80b31c0 2023-11-29T04:18:26.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.457+0000 7f51f77fe640 1 -- 172.21.15.6:0/4102586063 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00a5e20 con 0x7f51f80b31c0 2023-11-29T04:18:26.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.457+0000 7f51ff209640 1 -- 172.21.15.6:0/4102586063 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f80b31c0 msgr2=0x7f51f81600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:26.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.457+0000 7f51ff209640 1 --2- 172.21.15.6:0/4102586063 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f80b31c0 0x7f51f81600d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009d90 tx=0x7f51f001c890 comp rx=0 tx=0).stop 2023-11-29T04:18:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.461+0000 7f51ff209640 1 -- 172.21.15.6:0/4102586063 shutdown_connections 2023-11-29T04:18:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.461+0000 7f51ff209640 1 --2- 172.21.15.6:0/4102586063 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f80b31c0 0x7f51f81600d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.461+0000 7f51ff209640 1 --2- 172.21.15.6:0/4102586063 >> v2:172.21.15.6:3300/0 conn(0x7f51f815fcf0 0x7f51f80d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.461+0000 7f51ff209640 1 -- 172.21.15.6:0/4102586063 >> 172.21.15.6:0/4102586063 conn(0x7f51f809c480 msgr2=0x7f51f80d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.461+0000 7f51ff209640 1 -- 172.21.15.6:0/4102586063 shutdown_connections 2023-11-29T04:18:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.461+0000 7f51ff209640 1 -- 172.21.15.6:0/4102586063 wait complete. 2023-11-29T04:18:26.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.465+0000 7f51ff209640 1 Processor -- start 2023-11-29T04:18:26.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.465+0000 7f51ff209640 1 -- start start 2023-11-29T04:18:26.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51ff209640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51f80b31c0 0x7f51f81f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:26.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51ff209640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f80ceec0 0x7f51f8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:26.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51ff209640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f815fcf0 0x7f51f80b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:26.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51ff209640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81521e0 con 0x7f51f80ceec0 2023-11-29T04:18:26.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51ff209640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81523d0 con 0x7f51f80b31c0 2023-11-29T04:18:26.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51ff209640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f81fa2b0 con 0x7f51f815fcf0 2023-11-29T04:18:26.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fcfa5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51f80b31c0 0x7f51f81f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:26.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fcfa5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51f80b31c0 0x7f51f81f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53328/0 (socket says 172.21.15.6:53328) 2023-11-29T04:18:26.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fcfa5640 1 -- 172.21.15.6:0/645978053 learned_addr learned my addr 172.21.15.6:0/645978053 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:26.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fd7a6640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f815fcf0 0x7f51f80b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:26.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51f7fff640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f80ceec0 0x7f51f8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:26.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fcfa5640 1 -- 172.21.15.6:0/645978053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f815fcf0 msgr2=0x7f51f80b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fcfa5640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f815fcf0 0x7f51f80b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fcfa5640 1 -- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f80ceec0 msgr2=0x7f51f8151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fcfa5640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f80ceec0 0x7f51f8151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fcfa5640 1 -- 172.21.15.6:0/645978053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009a70 con 0x7f51f80b31c0 2023-11-29T04:18:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fd7a6640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f815fcf0 0x7f51f80b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:26.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51fcfa5640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51f80b31c0 0x7f51f81f6780 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00e8a0 tx=0x7f51ec00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51f57fa640 1 -- 172.21.15.6:0/645978053 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec009510 con 0x7f51f80b31c0 2023-11-29T04:18:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51f57fa640 1 -- 172.21.15.6:0/645978053 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec00c940 con 0x7f51f80b31c0 2023-11-29T04:18:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51f57fa640 1 -- 172.21.15.6:0/645978053 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00ccb0 con 0x7f51f80b31c0 2023-11-29T04:18:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f81fa590 con 0x7f51f80b31c0 2023-11-29T04:18:26.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.469+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f81fab50 con 0x7f51f80b31c0 2023-11-29T04:18:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.473+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f804e930 con 0x7f51f80b31c0 2023-11-29T04:18:26.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.473+0000 7f51f57fa640 1 -- 172.21.15.6:0/645978053 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f51ec013470 con 0x7f51f80b31c0 2023-11-29T04:18:26.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.477+0000 7f51f57fa640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f51dc0664a0 0x7f51dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.477+0000 7f51f57fa640 1 -- 172.21.15.6:0/645978053 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f51ec083c60 con 0x7f51f80b31c0 2023-11-29T04:18:26.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.477+0000 7f51f7fff640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f51dc0664a0 0x7f51dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.481+0000 7f51f7fff640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f51dc0664a0 0x7f51dc068960 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f51f8073880 tx=0x7f51e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.481+0000 7f51f57fa640 1 -- 172.21.15.6:0/645978053 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f51ec0513f0 con 0x7f51f80b31c0 2023-11-29T04:18:26.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.957+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f51f8161070 con 0x7f51dc0664a0 2023-11-29T04:18:26.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.957+0000 7f51f57fa640 1 -- 172.21.15.6:0/645978053 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f51e4001ce0 con 0x7f51dc0664a0 2023-11-29T04:18:26.962 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2023-11-29T04:18:26.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f51dc0664a0 msgr2=0x7f51dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:26.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f51dc0664a0 0x7f51dc068960 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f51f8073880 tx=0x7f51e4009040 comp rx=0 tx=0).stop 2023-11-29T04:18:26.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51f80b31c0 msgr2=0x7f51f81f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:26.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51f80b31c0 0x7f51f81f6780 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00e8a0 tx=0x7f51ec00eca0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 shutdown_connections 2023-11-29T04:18:26.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f51dc0664a0 0x7f51dc068960 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51f815fcf0 0x7f51f80b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f80ceec0 0x7f51f8151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 --2- 172.21.15.6:0/645978053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51f80b31c0 0x7f51f81f6780 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:26.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 >> 172.21.15.6:0/645978053 conn(0x7f51f809c480 msgr2=0x7f51f8156c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:26.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 shutdown_connections 2023-11-29T04:18:26.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:26.961+0000 7f51ff209640 1 -- 172.21.15.6:0/645978053 wait complete. 2023-11-29T04:18:26.996 INFO:tasks.ceph:Scrubbing osd.3 2023-11-29T04:18:26.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-29T04:18:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.413+0000 7fe4ef59e640 1 Processor -- start 2023-11-29T04:18:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.413+0000 7fe4ef59e640 1 -- start start 2023-11-29T04:18:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.417+0000 7fe4ef59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f006b970 0x7fe4f00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.417+0000 7fe4ef59e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4f00ae7f0 0x7fe4f01631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.417+0000 7fe4ef59e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f0159a20 con 0x7fe4f00b26f0 2023-11-29T04:18:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.417+0000 7fe4ef59e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f006e890 con 0x7fe4f00ae7f0 2023-11-29T04:18:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.417+0000 7fe4ef59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f006d500 con 0x7fe4f006b970 2023-11-29T04:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.421+0000 7fe4eed9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4f00ae7f0 0x7fe4f01631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.421+0000 7fe4eed9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4f00ae7f0 0x7fe4f01631d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53336/0 (socket says 172.21.15.6:53336) 2023-11-29T04:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.421+0000 7fe4eed9d640 1 -- 172.21.15.6:0/825977066 learned_addr learned my addr 172.21.15.6:0/825977066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.421+0000 7fe4edd9b640 1 --2- 172.21.15.6:0/825977066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f006b970 0x7fe4f00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.421+0000 7fe4eed9d640 1 -- 172.21.15.6:0/825977066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f006b970 msgr2=0x7fe4f00b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.421+0000 7fe4eed9d640 1 --2- 172.21.15.6:0/825977066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f006b970 0x7fe4f00b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.421+0000 7fe4eed9d640 1 -- 172.21.15.6:0/825977066 >> v1:172.21.15.6:6789/0 conn(0x7fe4f00b26f0 legacy=0x7fe4f00b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.421+0000 7fe4eed9d640 1 -- 172.21.15.6:0/825977066 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f006d7e0 con 0x7fe4f00ae7f0 2023-11-29T04:18:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4eed9d640 1 --2- 172.21.15.6:0/825977066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f00ae7f0 0x7fe4f01631d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009e50 tx=0x7fe4e801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99f3f62857b7bbf server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ed59a640 1 -- 172.21.15.6:0/825977066 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80a5790 con 0x7fe4f00ae7f0 2023-11-29T04:18:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ed59a640 1 -- 172.21.15.6:0/825977066 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e80a58f0 con 0x7fe4f00ae7f0 2023-11-29T04:18:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ed59a640 1 -- 172.21.15.6:0/825977066 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80a5c80 con 0x7fe4f00ae7f0 2023-11-29T04:18:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ef59e640 1 -- 172.21.15.6:0/825977066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f00ae7f0 msgr2=0x7fe4f01631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ef59e640 1 --2- 172.21.15.6:0/825977066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f00ae7f0 0x7fe4f01631d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009e50 tx=0x7fe4e801c950 comp rx=0 tx=0).stop 2023-11-29T04:18:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ef59e640 1 -- 172.21.15.6:0/825977066 shutdown_connections 2023-11-29T04:18:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ef59e640 1 --2- 172.21.15.6:0/825977066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f006b970 0x7fe4f00b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ef59e640 1 --2- 172.21.15.6:0/825977066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f00ae7f0 0x7fe4f01631d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ef59e640 1 -- 172.21.15.6:0/825977066 >> 172.21.15.6:0/825977066 conn(0x7fe4f00cf4a0 msgr2=0x7fe4f00cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:27.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ef59e640 1 -- 172.21.15.6:0/825977066 shutdown_connections 2023-11-29T04:18:27.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.425+0000 7fe4ef59e640 1 -- 172.21.15.6:0/825977066 wait complete. 2023-11-29T04:18:27.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.429+0000 7fe4ef59e640 1 Processor -- start 2023-11-29T04:18:27.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4ef59e640 1 -- start start 2023-11-29T04:18:27.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4ef59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4f006b970 0x7fe4f0144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4ef59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f00ae7f0 0x7fe4f00c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4ef59e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f00b26f0 0x7fe4f00c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4ef59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00cb590 con 0x7fe4f006b970 2023-11-29T04:18:27.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4ef59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f00cb100 con 0x7fe4f00ae7f0 2023-11-29T04:18:27.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4ef59e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0145450 con 0x7fe4f00b26f0 2023-11-29T04:18:27.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4eed9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f00b26f0 0x7fe4f00c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4edd9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f00ae7f0 0x7fe4f00c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4eed9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f00b26f0 0x7fe4f00c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:38576/0 (socket says 172.21.15.6:38576) 2023-11-29T04:18:27.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4eed9d640 1 -- 172.21.15.6:0/698002854 learned_addr learned my addr 172.21.15.6:0/698002854 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:27.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.433+0000 7fe4ee59c640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4f006b970 0x7fe4f0144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4eed9d640 1 -- 172.21.15.6:0/698002854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f00ae7f0 msgr2=0x7fe4f00c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4eed9d640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4f00ae7f0 0x7fe4f00c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4eed9d640 1 -- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4f006b970 msgr2=0x7fe4f0144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4eed9d640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4f006b970 0x7fe4f0144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4eed9d640 1 -- 172.21.15.6:0/698002854 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e8009b30 con 0x7fe4f00b26f0 2023-11-29T04:18:27.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4eed9d640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f00b26f0 0x7fe4f00c7bd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80af040 tx=0x7fe4e80196f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:27.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4deffd640 1 -- 172.21.15.6:0/698002854 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80b8670 con 0x7fe4f00b26f0 2023-11-29T04:18:27.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4deffd640 1 -- 172.21.15.6:0/698002854 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e80b87d0 con 0x7fe4f00b26f0 2023-11-29T04:18:27.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4deffd640 1 -- 172.21.15.6:0/698002854 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80b8b80 con 0x7fe4f00b26f0 2023-11-29T04:18:27.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f00ca4f0 con 0x7fe4f00b26f0 2023-11-29T04:18:27.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f00caab0 con 0x7fe4f00b26f0 2023-11-29T04:18:27.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.437+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4f004e850 con 0x7fe4f00b26f0 2023-11-29T04:18:27.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.441+0000 7fe4deffd640 1 -- 172.21.15.6:0/698002854 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4e80b8ce0 con 0x7fe4f00b26f0 2023-11-29T04:18:27.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.441+0000 7fe4deffd640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe4d0066470 0x7fe4d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.441+0000 7fe4deffd640 1 -- 172.21.15.6:0/698002854 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe4e811f200 con 0x7fe4f00b26f0 2023-11-29T04:18:27.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.441+0000 7fe4deffd640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fe4d006c2d0 0x7fe4d006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.441+0000 7fe4ee59c640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe4d0066470 0x7fe4d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.441+0000 7fe4deffd640 1 -- 172.21.15.6:0/698002854 --> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4d006eda0 con 0x7fe4d006c2d0 2023-11-29T04:18:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.441+0000 7fe4deffd640 1 -- 172.21.15.6:0/698002854 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4e81217e0 con 0x7fe4f00b26f0 2023-11-29T04:18:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.445+0000 7fe4edd9b640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fe4d006c2d0 0x7fe4d006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.445+0000 7fe4ee59c640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe4d0066470 0x7fe4d0068930 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0000f70 tx=0x7fe4e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:27.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.445+0000 7fe4edd9b640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fe4d006c2d0 0x7fe4d006e6f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:27.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.445+0000 7fe4deffd640 1 -- 172.21.15.6:0/698002854 <== osd.3 v2:172.21.15.6:6808/3632028675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe4d006eda0 con 0x7fe4d006c2d0 2023-11-29T04:18:27.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.485+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 --> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe4f00cb290 con 0x7fe4d006c2d0 2023-11-29T04:18:27.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.485+0000 7fe4deffd640 1 -- 172.21.15.6:0/698002854 <== osd.3 v2:172.21.15.6:6808/3632028675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe4f00cb290 con 0x7fe4d006c2d0 2023-11-29T04:18:27.490 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-29T04:18:27.490 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T04:18:27.491 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-29T04:18:27.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fe4d006c2d0 msgr2=0x7fe4d006e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6808/3632028675,v1:172.21.15.6:6809/3632028675] conn(0x7fe4d006c2d0 0x7fe4d006e6f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe4d0066470 msgr2=0x7fe4d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe4d0066470 0x7fe4d0068930 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0000f70 tx=0x7fe4e0009040 comp rx=0 tx=0).stop 2023-11-29T04:18:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f00b26f0 msgr2=0x7fe4f00c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 --2- 172.21.15.6:0/698002854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe4f00b26f0 0x7fe4f00c7bd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80af040 tx=0x7fe4e80196f0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4eed9d640 1 -- 172.21.15.6:0/698002854 reap_dead start 2023-11-29T04:18:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 shutdown_connections 2023-11-29T04:18:27.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 >> 172.21.15.6:0/698002854 conn(0x7fe4f00cf4a0 msgr2=0x7fe4f00b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:27.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 shutdown_connections 2023-11-29T04:18:27.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.489+0000 7fe4ef59e640 1 -- 172.21.15.6:0/698002854 wait complete. 2023-11-29T04:18:27.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-29T04:18:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.953+0000 7f5638d80640 1 Processor -- start 2023-11-29T04:18:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.957+0000 7f5638d80640 1 -- start start 2023-11-29T04:18:27.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.957+0000 7f5638d80640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5634099980 0x7f5634099d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.957+0000 7f5638d80640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56340b1ad0 0x7f56340b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.957+0000 7f5638d80640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56340cc1d0 con 0x7f56340b0900 2023-11-29T04:18:27.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.957+0000 7f5638d80640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56340b2870 con 0x7f5634099980 2023-11-29T04:18:27.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.957+0000 7f5638d80640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56340cb8e0 con 0x7f56340b1ad0 2023-11-29T04:18:27.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f562bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56340b1ad0 0x7f56340b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f563259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5634099980 0x7f5634099d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f562bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56340b1ad0 0x7f56340b1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53346/0 (socket says 172.21.15.6:53346) 2023-11-29T04:18:27.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f563259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5634099980 0x7f5634099d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57906/0 (socket says 172.21.15.6:57906) 2023-11-29T04:18:27.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f5632d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f56340b0900 0x7f56340b0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50688/0 (socket says 172.21.15.6:50688) 2023-11-29T04:18:27.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f562bfff640 1 -- 172.21.15.6:0/2389503916 learned_addr learned my addr 172.21.15.6:0/2389503916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:27.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f562bfff640 1 -- 172.21.15.6:0/2389503916 >> v2:172.21.15.6:3300/0 conn(0x7f5634099980 msgr2=0x7f5634099d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:27.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f562bfff640 1 --2- 172.21.15.6:0/2389503916 >> v2:172.21.15.6:3300/0 conn(0x7f5634099980 0x7f5634099d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f562bfff640 1 -- 172.21.15.6:0/2389503916 >> v1:172.21.15.6:6789/0 conn(0x7f56340b0900 legacy=0x7f56340b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.961+0000 7f562bfff640 1 -- 172.21.15.6:0/2389503916 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563409a2a0 con 0x7f56340b1ad0 2023-11-29T04:18:27.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f562bfff640 1 --2- 172.21.15.6:0/2389503916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56340b1ad0 0x7f56340b1f40 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f56340b7080 tx=0x7f561c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d92cf916ca93d9c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5631d9b640 1 -- 172.21.15.6:0/2389503916 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c0aa430 con 0x7f56340b1ad0 2023-11-29T04:18:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5631d9b640 1 -- 172.21.15.6:0/2389503916 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c0aa590 con 0x7f56340b1ad0 2023-11-29T04:18:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5631d9b640 1 -- 172.21.15.6:0/2389503916 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c0aa920 con 0x7f56340b1ad0 2023-11-29T04:18:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5638d80640 1 -- 172.21.15.6:0/2389503916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56340b1ad0 msgr2=0x7f56340b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5638d80640 1 --2- 172.21.15.6:0/2389503916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56340b1ad0 0x7f56340b1f40 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f56340b7080 tx=0x7f561c01c4d0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5638d80640 1 -- 172.21.15.6:0/2389503916 shutdown_connections 2023-11-29T04:18:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5638d80640 1 --2- 172.21.15.6:0/2389503916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56340b1ad0 0x7f56340b1f40 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5638d80640 1 --2- 172.21.15.6:0/2389503916 >> v2:172.21.15.6:3300/0 conn(0x7f5634099980 0x7f5634099d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5638d80640 1 -- 172.21.15.6:0/2389503916 >> 172.21.15.6:0/2389503916 conn(0x7f56340b2ac0 msgr2=0x7f56340b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5638d80640 1 -- 172.21.15.6:0/2389503916 shutdown_connections 2023-11-29T04:18:27.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.965+0000 7f5638d80640 1 -- 172.21.15.6:0/2389503916 wait complete. 2023-11-29T04:18:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f5638d80640 1 Processor -- start 2023-11-29T04:18:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f5638d80640 1 -- start start 2023-11-29T04:18:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f5638d80640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5634099980 0x7f5634154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f5638d80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b0900 0x7f56340ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f5638d80640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56340b1ad0 0x7f563406f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f5638d80640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340ae150 con 0x7f56340b0900 2023-11-29T04:18:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f5638d80640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5634154b60 con 0x7f5634099980 2023-11-29T04:18:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f5638d80640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5634164360 con 0x7f56340b1ad0 2023-11-29T04:18:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f563259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5634099980 0x7f5634154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.973+0000 7f562bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b0900 0x7f56340ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f562bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b0900 0x7f56340ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57918/0 (socket says 172.21.15.6:57918) 2023-11-29T04:18:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f563259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5634099980 0x7f5634154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:53356/0 (socket says 172.21.15.6:53356) 2023-11-29T04:18:27.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f562bfff640 1 -- 172.21.15.6:0/3821276200 learned_addr learned my addr 172.21.15.6:0/3821276200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:27.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f5632d9d640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56340b1ad0 0x7f563406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f563259c640 1 -- 172.21.15.6:0/3821276200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56340b1ad0 msgr2=0x7f563406f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f563259c640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56340b1ad0 0x7f563406f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f563259c640 1 -- 172.21.15.6:0/3821276200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b0900 msgr2=0x7f56340ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:27.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f563259c640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b0900 0x7f56340ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:27.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f563259c640 1 -- 172.21.15.6:0/3821276200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c0094d0 con 0x7f5634099980 2023-11-29T04:18:27.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f5632d9d640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56340b1ad0 0x7f563406f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T04:18:27.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f563259c640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5634099980 0x7f5634154620 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f562400e870 tx=0x7f562400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:27.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f562affd640 1 -- 172.21.15.6:0/3821276200 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56240095d0 con 0x7f5634099980 2023-11-29T04:18:27.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f562affd640 1 -- 172.21.15.6:0/3821276200 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562400c940 con 0x7f5634099980 2023-11-29T04:18:27.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5634164640 con 0x7f5634099980 2023-11-29T04:18:27.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f562affd640 1 -- 172.21.15.6:0/3821276200 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562400ccb0 con 0x7f5634099980 2023-11-29T04:18:27.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.977+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5634164920 con 0x7f5634099980 2023-11-29T04:18:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.981+0000 7f562affd640 1 -- 172.21.15.6:0/3821276200 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5624013470 con 0x7f5634099980 2023-11-29T04:18:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.981+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56340cb380 con 0x7f5634099980 2023-11-29T04:18:27.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.981+0000 7f562affd640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f56140664c0 0x7f5614068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:27.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.981+0000 7f562affd640 1 -- 172.21.15.6:0/3821276200 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5624083bd0 con 0x7f5634099980 2023-11-29T04:18:27.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.985+0000 7f562bfff640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f56140664c0 0x7f5614068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:27.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.985+0000 7f562bfff640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f56140664c0 0x7f5614068980 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f561c01c510 tx=0x7f561c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:27.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:27.985+0000 7f562affd640 1 -- 172.21.15.6:0/3821276200 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5624051470 con 0x7f5634099980 2023-11-29T04:18:28.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.453+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f563415eb80 con 0x7f56140664c0 2023-11-29T04:18:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.453+0000 7f562affd640 1 -- 172.21.15.6:0/3821276200 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f561c0aa860 con 0x7f56140664c0 2023-11-29T04:18:28.457 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2023-11-29T04:18:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f56140664c0 msgr2=0x7f5614068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f56140664c0 0x7f5614068980 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f561c01c510 tx=0x7f561c0a7000 comp rx=0 tx=0).stop 2023-11-29T04:18:28.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5634099980 msgr2=0x7f5634154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5634099980 0x7f5634154620 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f562400e870 tx=0x7f562400ed30 comp rx=0 tx=0).stop 2023-11-29T04:18:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 shutdown_connections 2023-11-29T04:18:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f56140664c0 0x7f5614068980 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56340b1ad0 0x7f563406f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56340b0900 0x7f56340ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:28.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 --2- 172.21.15.6:0/3821276200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5634099980 0x7f5634154620 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 >> 172.21.15.6:0/3821276200 conn(0x7f56340b2ac0 msgr2=0x7f56340b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 shutdown_connections 2023-11-29T04:18:28.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.457+0000 7f5638d80640 1 -- 172.21.15.6:0/3821276200 wait complete. 2023-11-29T04:18:28.513 INFO:tasks.ceph:Scrubbing osd.4 2023-11-29T04:18:28.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-29T04:18:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.937+0000 7fd5918bb640 1 Processor -- start 2023-11-29T04:18:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.937+0000 7fd5918bb640 1 -- start start 2023-11-29T04:18:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.941+0000 7fd5918bb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd58c0b3a70 0x7fd58c0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:28.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.941+0000 7fd5918bb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c0b4470 con 0x7fd58c160a70 2023-11-29T04:18:28.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.941+0000 7fd5918bb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c0b4750 con 0x7fd58c0d01f0 2023-11-29T04:18:28.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.941+0000 7fd5918bb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c0d2330 con 0x7fd58c0b3a70 2023-11-29T04:18:28.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.941+0000 7fd58affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd58c160a70 0x7fd58c0cfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32938/0 (socket says 172.21.15.6:32938) 2023-11-29T04:18:28.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.941+0000 7fd58affd640 1 -- 172.21.15.6:0/3787007366 learned_addr learned my addr 172.21.15.6:0/3787007366 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:28.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.941+0000 7fd58a7fc640 1 --2- 172.21.15.6:0/3787007366 >> v2:172.21.15.6:3300/0 conn(0x7fd58c0b3a70 0x7fd58c0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:28.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.941+0000 7fd589ffb640 1 -- 172.21.15.6:0/3787007366 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606903623 0 0) 0x7fd58c0b4470 con 0x7fd58c160a70 2023-11-29T04:18:28.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.945+0000 7fd589ffb640 1 -- 172.21.15.6:0/3787007366 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd574003530 con 0x7fd58c160a70 2023-11-29T04:18:28.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.945+0000 7fd589ffb640 1 -- 172.21.15.6:0/3787007366 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111500926 0 0) 0x7fd58c0b4750 con 0x7fd58c0d01f0 2023-11-29T04:18:28.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.945+0000 7fd58a7fc640 1 -- 172.21.15.6:0/3787007366 >> v1:172.21.15.31:6789/0 conn(0x7fd58c0d01f0 legacy=0x7fd58c0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.945+0000 7fd58a7fc640 1 -- 172.21.15.6:0/3787007366 >> v1:172.21.15.6:6789/0 conn(0x7fd58c160a70 legacy=0x7fd58c0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.945+0000 7fd58a7fc640 1 -- 172.21.15.6:0/3787007366 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c0b4a30 con 0x7fd58c0b3a70 2023-11-29T04:18:28.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd58a7fc640 1 --2- 172.21.15.6:0/3787007366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd58c0b3a70 0x7fd58c0b1f70 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fd5800097c0 tx=0x7fd58001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f383d5c4da97a82 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:28.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd589ffb640 1 -- 172.21.15.6:0/3787007366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800ab650 con 0x7fd58c0b3a70 2023-11-29T04:18:28.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd589ffb640 1 -- 172.21.15.6:0/3787007366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5800ab7b0 con 0x7fd58c0b3a70 2023-11-29T04:18:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd589ffb640 1 -- 172.21.15.6:0/3787007366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800abb40 con 0x7fd58c0b3a70 2023-11-29T04:18:28.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd5918bb640 1 -- 172.21.15.6:0/3787007366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd58c0b3a70 msgr2=0x7fd58c0b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd5918bb640 1 --2- 172.21.15.6:0/3787007366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd58c0b3a70 0x7fd58c0b1f70 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fd5800097c0 tx=0x7fd58001c450 comp rx=0 tx=0).stop 2023-11-29T04:18:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd5918bb640 1 -- 172.21.15.6:0/3787007366 shutdown_connections 2023-11-29T04:18:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd5918bb640 1 --2- 172.21.15.6:0/3787007366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd58c0b3a70 0x7fd58c0b1f70 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd5918bb640 1 -- 172.21.15.6:0/3787007366 >> 172.21.15.6:0/3787007366 conn(0x7fd58c09c4b0 msgr2=0x7fd58c0d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd5918bb640 1 -- 172.21.15.6:0/3787007366 shutdown_connections 2023-11-29T04:18:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.953+0000 7fd5918bb640 1 -- 172.21.15.6:0/3787007366 wait complete. 2023-11-29T04:18:28.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.957+0000 7fd5918bb640 1 Processor -- start 2023-11-29T04:18:28.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.961+0000 7fd5918bb640 1 -- start start 2023-11-29T04:18:28.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.961+0000 7fd5918bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd58c0b3a70 0x7fd58c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:28.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.961+0000 7fd5918bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd58c0d01f0 0x7fd58c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.961+0000 7fd5918bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd58c160a70 0x7fd58c06be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.961+0000 7fd5918bb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c159300 con 0x7fd58c160a70 2023-11-29T04:18:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.961+0000 7fd5918bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c1595e0 con 0x7fd58c0b3a70 2023-11-29T04:18:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.961+0000 7fd5918bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c1598c0 con 0x7fd58c0d01f0 2023-11-29T04:18:28.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.961+0000 7fd58affd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd58c0b3a70 0x7fd58c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd58c160a70 0x7fd58c06be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58a7fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd58c0d01f0 0x7fd58c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58a7fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd58c0d01f0 0x7fd58c1588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:58564/0 (socket says 172.21.15.6:58564) 2023-11-29T04:18:28.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58a7fc640 1 -- 172.21.15.6:0/3451681163 learned_addr learned my addr 172.21.15.6:0/3451681163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58a7fc640 1 -- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd58c0b3a70 msgr2=0x7fd58c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58a7fc640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd58c0b3a70 0x7fd58c153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58a7fc640 1 -- 172.21.15.6:0/3451681163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd58c160a70 msgr2=0x7fd58c06be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58a7fc640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd58c160a70 0x7fd58c06be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:28.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58a7fc640 1 -- 172.21.15.6:0/3451681163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580009420 con 0x7fd58c0d01f0 2023-11-29T04:18:28.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd58a7fc640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd58c0d01f0 0x7fd58c1588b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd5800ad040 tx=0x7fd58001ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:28.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd573fff640 1 -- 172.21.15.6:0/3451681163 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800b5600 con 0x7fd58c0d01f0 2023-11-29T04:18:28.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd573fff640 1 -- 172.21.15.6:0/3451681163 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5800b5760 con 0x7fd58c0d01f0 2023-11-29T04:18:28.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd573fff640 1 -- 172.21.15.6:0/3451681163 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800b5af0 con 0x7fd58c0d01f0 2023-11-29T04:18:28.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c159ba0 con 0x7fd58c0d01f0 2023-11-29T04:18:28.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c1535b0 con 0x7fd58c0d01f0 2023-11-29T04:18:28.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.965+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd58c159750 con 0x7fd58c0d01f0 2023-11-29T04:18:28.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.969+0000 7fd573fff640 1 -- 172.21.15.6:0/3451681163 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5800b5c50 con 0x7fd58c0d01f0 2023-11-29T04:18:28.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.973+0000 7fd573fff640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd5780664c0 0x7fd578068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:28.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.973+0000 7fd573fff640 1 -- 172.21.15.6:0/3451681163 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd58011e3e0 con 0x7fd58c0d01f0 2023-11-29T04:18:28.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.973+0000 7fd573fff640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7fd57806c320 0x7fd57806e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:28.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.973+0000 7fd573fff640 1 -- 172.21.15.6:0/3451681163 --> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd57806edf0 con 0x7fd57806c320 2023-11-29T04:18:28.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.973+0000 7fd573fff640 1 -- 172.21.15.6:0/3451681163 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5801209c0 con 0x7fd58c0d01f0 2023-11-29T04:18:28.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.973+0000 7fd58affd640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd5780664c0 0x7fd578068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:28.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.973+0000 7fd58b7fe640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7fd57806c320 0x7fd57806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:28.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.973+0000 7fd58affd640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd5780664c0 0x7fd578068980 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd57c007fd0 tx=0x7fd57c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:28.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.973+0000 7fd58b7fe640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7fd57806c320 0x7fd57806e740 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:28.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.977+0000 7fd573fff640 1 -- 172.21.15.6:0/3451681163 <== osd.4 v2:172.21.15.31:6816/1640965128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd57806edf0 con 0x7fd57806c320 2023-11-29T04:18:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 --> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd58c0674d0 con 0x7fd57806c320 2023-11-29T04:18:28.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd573fff640 1 -- 172.21.15.6:0/3451681163 <== osd.4 v2:172.21.15.31:6816/1640965128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd58c0674d0 con 0x7fd57806c320 2023-11-29T04:18:28.996 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-29T04:18:28.997 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T04:18:28.997 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-29T04:18:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7fd57806c320 msgr2=0x7fd57806e740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:6816/1640965128,v1:172.21.15.31:6817/1640965128] conn(0x7fd57806c320 0x7fd57806e740 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd5780664c0 msgr2=0x7fd578068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd5780664c0 0x7fd578068980 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd57c007fd0 tx=0x7fd57c009040 comp rx=0 tx=0).stop 2023-11-29T04:18:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd58c0d01f0 msgr2=0x7fd58c1588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 --2- 172.21.15.6:0/3451681163 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd58c0d01f0 0x7fd58c1588b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd5800ad040 tx=0x7fd58001ac90 comp rx=0 tx=0).stop 2023-11-29T04:18:28.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd58b7fe640 1 -- 172.21.15.6:0/3451681163 reap_dead start 2023-11-29T04:18:28.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 shutdown_connections 2023-11-29T04:18:28.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 >> 172.21.15.6:0/3451681163 conn(0x7fd58c09c4b0 msgr2=0x7fd58c0cee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:28.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 shutdown_connections 2023-11-29T04:18:28.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:28.993+0000 7fd5918bb640 1 -- 172.21.15.6:0/3451681163 wait complete. 2023-11-29T04:18:29.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-29T04:18:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.457+0000 7f210cc79640 1 Processor -- start 2023-11-29T04:18:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.457+0000 7f210cc79640 1 -- start start 2023-11-29T04:18:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210cc79640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f210815fcf0 0x7f21080d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210cc79640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f21080ceec0 0x7f21080b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210cc79640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21080cea30 con 0x7f21080cf320 2023-11-29T04:18:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210cc79640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21080d3ef0 con 0x7f21080ceec0 2023-11-29T04:18:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210cc79640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21080b2430 con 0x7f210815fcf0 2023-11-29T04:18:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f2106d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f21080cf320 0x7f21080b2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32948/0 (socket says 172.21.15.6:32948) 2023-11-29T04:18:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f2106d9d640 1 -- 172.21.15.6:0/3040830876 learned_addr learned my addr 172.21.15.6:0/3040830876 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210659c640 1 --2- 172.21.15.6:0/3040830876 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f210815fcf0 0x7f21080d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f2105d9b640 1 --2- 172.21.15.6:0/3040830876 >> v2:172.21.15.31:3300/0 conn(0x7f21080ceec0 0x7f21080b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210559a640 1 -- 172.21.15.6:0/3040830876 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975173162 0 0) 0x7f21080cea30 con 0x7f21080cf320 2023-11-29T04:18:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210559a640 1 -- 172.21.15.6:0/3040830876 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f0003530 con 0x7f21080cf320 2023-11-29T04:18:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210659c640 1 -- 172.21.15.6:0/3040830876 >> v2:172.21.15.31:3300/0 conn(0x7f21080ceec0 msgr2=0x7f21080b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210659c640 1 --2- 172.21.15.6:0/3040830876 >> v2:172.21.15.31:3300/0 conn(0x7f21080ceec0 0x7f21080b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210659c640 1 -- 172.21.15.6:0/3040830876 >> v1:172.21.15.6:6789/0 conn(0x7f21080cf320 legacy=0x7f21080b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.461+0000 7f210659c640 1 -- 172.21.15.6:0/3040830876 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21081610e0 con 0x7f210815fcf0 2023-11-29T04:18:29.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.469+0000 7f210659c640 1 --2- 172.21.15.6:0/3040830876 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f210815fcf0 0x7f21080d3860 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f20f80097c0 tx=0x7f20f801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bfe05ebf477d55c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:29.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.469+0000 7f210559a640 1 -- 172.21.15.6:0/3040830876 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80ac620 con 0x7f210815fcf0 2023-11-29T04:18:29.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210559a640 1 -- 172.21.15.6:0/3040830876 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f80ac780 con 0x7f210815fcf0 2023-11-29T04:18:29.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210559a640 1 -- 172.21.15.6:0/3040830876 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80acb10 con 0x7f210815fcf0 2023-11-29T04:18:29.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210cc79640 1 -- 172.21.15.6:0/3040830876 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f210815fcf0 msgr2=0x7f21080d3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:29.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210cc79640 1 --2- 172.21.15.6:0/3040830876 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f210815fcf0 0x7f21080d3860 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f20f80097c0 tx=0x7f20f801c3c0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210cc79640 1 -- 172.21.15.6:0/3040830876 shutdown_connections 2023-11-29T04:18:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210cc79640 1 --2- 172.21.15.6:0/3040830876 >> v2:172.21.15.31:3300/0 conn(0x7f21080ceec0 0x7f21080b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210cc79640 1 --2- 172.21.15.6:0/3040830876 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f210815fcf0 0x7f21080d3860 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210cc79640 1 -- 172.21.15.6:0/3040830876 >> 172.21.15.6:0/3040830876 conn(0x7f210809c480 msgr2=0x7f21080d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210cc79640 1 -- 172.21.15.6:0/3040830876 shutdown_connections 2023-11-29T04:18:29.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.473+0000 7f210cc79640 1 -- 172.21.15.6:0/3040830876 wait complete. 2023-11-29T04:18:29.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.477+0000 7f210cc79640 1 Processor -- start 2023-11-29T04:18:29.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210cc79640 1 -- start start 2023-11-29T04:18:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210cc79640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21080ceec0 0x7f21080cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210cc79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210815fcf0 0x7f2108155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210cc79640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21080cf970 0x7f210814c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210cc79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080cb480 con 0x7f210815fcf0 2023-11-29T04:18:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210cc79640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080cb760 con 0x7f21080ceec0 2023-11-29T04:18:29.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210cc79640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21080cba40 con 0x7f21080cf970 2023-11-29T04:18:29.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21080ceec0 0x7f21080cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21080ceec0 0x7f21080cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:51784/0 (socket says 172.21.15.6:51784) 2023-11-29T04:18:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f210659c640 1 -- 172.21.15.6:0/3149296157 learned_addr learned my addr 172.21.15.6:0/3149296157 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f2105d9b640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210815fcf0 0x7f2108155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.481+0000 7f2106d9d640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21080cf970 0x7f210814c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f210659c640 1 -- 172.21.15.6:0/3149296157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21080cf970 msgr2=0x7f210814c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f210659c640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21080cf970 0x7f210814c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f210659c640 1 -- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210815fcf0 msgr2=0x7f2108155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:29.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f210659c640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210815fcf0 0x7f2108155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f210659c640 1 -- 172.21.15.6:0/3149296157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f8009420 con 0x7f21080ceec0 2023-11-29T04:18:29.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f210659c640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21080ceec0 0x7f21080cc520 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f20f801aa70 tx=0x7f20f8019160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:29.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f20f6ffd640 1 -- 172.21.15.6:0/3149296157 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80ac620 con 0x7f21080ceec0 2023-11-29T04:18:29.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f20f6ffd640 1 -- 172.21.15.6:0/3149296157 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f80b6470 con 0x7f21080ceec0 2023-11-29T04:18:29.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21080cbd20 con 0x7f21080ceec0 2023-11-29T04:18:29.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f20f6ffd640 1 -- 172.21.15.6:0/3149296157 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80b6840 con 0x7f21080ceec0 2023-11-29T04:18:29.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.485+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21080cb130 con 0x7f21080ceec0 2023-11-29T04:18:29.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.489+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21080cc1d0 con 0x7f21080ceec0 2023-11-29T04:18:29.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.489+0000 7f20f6ffd640 1 -- 172.21.15.6:0/3149296157 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20f80b3040 con 0x7f21080ceec0 2023-11-29T04:18:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.489+0000 7f20f6ffd640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f20e80664a0 0x7f20e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:29.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.489+0000 7f20f6ffd640 1 -- 172.21.15.6:0/3149296157 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f20f811df20 con 0x7f21080ceec0 2023-11-29T04:18:29.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.489+0000 7f2105d9b640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f20e80664a0 0x7f20e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.493+0000 7f2105d9b640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f20e80664a0 0x7f20e8068960 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f21080ce840 tx=0x7f20fc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:29.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.493+0000 7f20f6ffd640 1 -- 172.21.15.6:0/3149296157 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f20f80eb600 con 0x7f21080ceec0 2023-11-29T04:18:29.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.969+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f210804e930 con 0x7f20e80664a0 2023-11-29T04:18:29.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.969+0000 7f20f6ffd640 1 -- 172.21.15.6:0/3149296157 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f210804e930 con 0x7f20e80664a0 2023-11-29T04:18:29.974 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2023-11-29T04:18:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f20e80664a0 msgr2=0x7f20e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f20e80664a0 0x7f20e8068960 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f21080ce840 tx=0x7f20fc009190 comp rx=0 tx=0).stop 2023-11-29T04:18:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21080ceec0 msgr2=0x7f21080cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21080ceec0 0x7f21080cc520 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f20f801aa70 tx=0x7f20f8019160 comp rx=0 tx=0).stop 2023-11-29T04:18:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 shutdown_connections 2023-11-29T04:18:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f20e80664a0 0x7f20e8068960 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f21080cf970 0x7f210814c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210815fcf0 0x7f2108155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 --2- 172.21.15.6:0/3149296157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21080ceec0 0x7f21080cc520 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:29.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.973+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 >> 172.21.15.6:0/3149296157 conn(0x7f210809c480 msgr2=0x7f21080b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:29.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.977+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 shutdown_connections 2023-11-29T04:18:29.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:29.977+0000 7f210cc79640 1 -- 172.21.15.6:0/3149296157 wait complete. 2023-11-29T04:18:30.034 INFO:tasks.ceph:Scrubbing osd.5 2023-11-29T04:18:30.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-29T04:18:30.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.457+0000 7fd56ed65640 1 Processor -- start 2023-11-29T04:18:30.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.457+0000 7fd56ed65640 1 -- start start 2023-11-29T04:18:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56ed65640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5680d19a0 0x7fd5680cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56ed65640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5680cf400 0x7fd568161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56ed65640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680d1d80 0x7fd568161a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56ed65640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680afde0 con 0x7fd5680cf400 2023-11-29T04:18:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56ed65640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680d04d0 con 0x7fd5680d19a0 2023-11-29T04:18:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56ed65640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b0030 con 0x7fd5680d1d80 2023-11-29T04:18:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56cb01640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5680d19a0 0x7fd5680cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56cb01640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5680d19a0 0x7fd5680cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:51786/0 (socket says 172.21.15.6:51786) 2023-11-29T04:18:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56cb01640 1 -- 172.21.15.6:0/1915985157 learned_addr learned my addr 172.21.15.6:0/1915985157 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56d302640 1 --2- 172.21.15.6:0/1915985157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680d1d80 0x7fd568161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd55ffff640 1 --2- 172.21.15.6:0/1915985157 >> v2:172.21.15.6:3300/0 conn(0x7fd5680cf400 0x7fd568161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56cb01640 1 -- 172.21.15.6:0/1915985157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680d1d80 msgr2=0x7fd568161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56cb01640 1 --2- 172.21.15.6:0/1915985157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680d1d80 0x7fd568161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56cb01640 1 -- 172.21.15.6:0/1915985157 >> v2:172.21.15.6:3300/0 conn(0x7fd5680cf400 msgr2=0x7fd568161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56cb01640 1 --2- 172.21.15.6:0/1915985157 >> v2:172.21.15.6:3300/0 conn(0x7fd5680cf400 0x7fd568161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.461+0000 7fd56cb01640 1 -- 172.21.15.6:0/1915985157 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680b0310 con 0x7fd5680d19a0 2023-11-29T04:18:30.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.465+0000 7fd56cb01640 1 --2- 172.21.15.6:0/1915985157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5680d19a0 0x7fd5680cfb60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd56808b7b0 tx=0x7fd56401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3139aad0bd4a602 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:30.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.465+0000 7fd55f7fe640 1 -- 172.21.15.6:0/1915985157 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640ab600 con 0x7fd5680d19a0 2023-11-29T04:18:30.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.465+0000 7fd55f7fe640 1 -- 172.21.15.6:0/1915985157 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5640a7050 con 0x7fd5680d19a0 2023-11-29T04:18:30.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.465+0000 7fd55f7fe640 1 -- 172.21.15.6:0/1915985157 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640ab980 con 0x7fd5680d19a0 2023-11-29T04:18:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.469+0000 7fd56ed65640 1 -- 172.21.15.6:0/1915985157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5680d19a0 msgr2=0x7fd5680cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.469+0000 7fd56ed65640 1 --2- 172.21.15.6:0/1915985157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5680d19a0 0x7fd5680cfb60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd56808b7b0 tx=0x7fd56401c4d0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.469+0000 7fd56ed65640 1 -- 172.21.15.6:0/1915985157 shutdown_connections 2023-11-29T04:18:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.469+0000 7fd56ed65640 1 --2- 172.21.15.6:0/1915985157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680d1d80 0x7fd568161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.469+0000 7fd56ed65640 1 --2- 172.21.15.6:0/1915985157 >> v2:172.21.15.6:3300/0 conn(0x7fd5680cf400 0x7fd568161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.469+0000 7fd56ed65640 1 --2- 172.21.15.6:0/1915985157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5680d19a0 0x7fd5680cfb60 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.469+0000 7fd56ed65640 1 -- 172.21.15.6:0/1915985157 >> 172.21.15.6:0/1915985157 conn(0x7fd56809c480 msgr2=0x7fd5680d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.469+0000 7fd56ed65640 1 -- 172.21.15.6:0/1915985157 shutdown_connections 2023-11-29T04:18:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.469+0000 7fd56ed65640 1 -- 172.21.15.6:0/1915985157 wait complete. 2023-11-29T04:18:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.473+0000 7fd56ed65640 1 Processor -- start 2023-11-29T04:18:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.473+0000 7fd56ed65640 1 -- start start 2023-11-29T04:18:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56ed65640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680cf400 0x7fd5680b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56ed65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5680d19a0 0x7fd5680b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56ed65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5680d1d80 0x7fd5680b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56ed65640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b7680 con 0x7fd5680d1d80 2023-11-29T04:18:30.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56ed65640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b7870 con 0x7fd5680d19a0 2023-11-29T04:18:30.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56ed65640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b7b50 con 0x7fd5680cf400 2023-11-29T04:18:30.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56cb01640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680cf400 0x7fd5680b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd55ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5680d19a0 0x7fd5680b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56cb01640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680cf400 0x7fd5680b6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:58612/0 (socket says 172.21.15.6:58612) 2023-11-29T04:18:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56cb01640 1 -- 172.21.15.6:0/4192053109 learned_addr learned my addr 172.21.15.6:0/4192053109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56d302640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5680d1d80 0x7fd5680b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56cb01640 1 -- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5680d19a0 msgr2=0x7fd5680b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56cb01640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5680d19a0 0x7fd5680b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56cb01640 1 -- 172.21.15.6:0/4192053109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5680d1d80 msgr2=0x7fd5680b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56cb01640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5680d1d80 0x7fd5680b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56cb01640 1 -- 172.21.15.6:0/4192053109 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640094d0 con 0x7fd5680cf400 2023-11-29T04:18:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56cb01640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680cf400 0x7fd5680b6870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd56401a100 tx=0x7fd564019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd55d7fa640 1 -- 172.21.15.6:0/4192053109 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640abea0 con 0x7fd5680cf400 2023-11-29T04:18:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd55d7fa640 1 -- 172.21.15.6:0/4192053109 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5640b5400 con 0x7fd5680cf400 2023-11-29T04:18:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5680b7e30 con 0x7fd5680cf400 2023-11-29T04:18:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd55d7fa640 1 -- 172.21.15.6:0/4192053109 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640b57b0 con 0x7fd5680cf400 2023-11-29T04:18:30.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.477+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5680b83f0 con 0x7fd5680cf400 2023-11-29T04:18:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.481+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5680d02b0 con 0x7fd5680cf400 2023-11-29T04:18:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.481+0000 7fd55d7fa640 1 -- 172.21.15.6:0/4192053109 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5640b5910 con 0x7fd5680cf400 2023-11-29T04:18:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.485+0000 7fd55d7fa640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd554066470 0x7fd554068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.485+0000 7fd55d7fa640 1 -- 172.21.15.6:0/4192053109 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd56411dde0 con 0x7fd5680cf400 2023-11-29T04:18:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.485+0000 7fd55ffff640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd554066470 0x7fd554068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.485+0000 7fd55d7fa640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7fd55406c2d0 0x7fd55406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.485+0000 7fd55d7fa640 1 -- 172.21.15.6:0/4192053109 --> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd55406eda0 con 0x7fd55406c2d0 2023-11-29T04:18:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.485+0000 7fd55d7fa640 1 -- 172.21.15.6:0/4192053109 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd564123370 con 0x7fd5680cf400 2023-11-29T04:18:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.485+0000 7fd56d302640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7fd55406c2d0 0x7fd55406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.485+0000 7fd55ffff640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd554066470 0x7fd554068930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd5680b70d0 tx=0x7fd558008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:30.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.485+0000 7fd56d302640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7fd55406c2d0 0x7fd55406e6f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:30.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.489+0000 7fd55d7fa640 1 -- 172.21.15.6:0/4192053109 <== osd.5 v2:172.21.15.31:6801/2692774501 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd55406eda0 con 0x7fd55406c2d0 2023-11-29T04:18:30.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 --> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd568162390 con 0x7fd55406c2d0 2023-11-29T04:18:30.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd55d7fa640 1 -- 172.21.15.6:0/4192053109 <== osd.5 v2:172.21.15.31:6801/2692774501 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd56000f040 con 0x7fd55406c2d0 2023-11-29T04:18:30.508 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-29T04:18:30.508 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T04:18:30.509 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-29T04:18:30.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7fd55406c2d0 msgr2=0x7fd55406e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:6801/2692774501,v1:172.21.15.31:6803/2692774501] conn(0x7fd55406c2d0 0x7fd55406e6f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd554066470 msgr2=0x7fd554068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fd554066470 0x7fd554068930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd5680b70d0 tx=0x7fd558008040 comp rx=0 tx=0).stop 2023-11-29T04:18:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680cf400 msgr2=0x7fd5680b6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 --2- 172.21.15.6:0/4192053109 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd5680cf400 0x7fd5680b6870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd56401a100 tx=0x7fd564019270 comp rx=0 tx=0).stop 2023-11-29T04:18:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56d302640 1 -- 172.21.15.6:0/4192053109 reap_dead start 2023-11-29T04:18:30.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 shutdown_connections 2023-11-29T04:18:30.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 >> 172.21.15.6:0/4192053109 conn(0x7fd56809c480 msgr2=0x7fd56815ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:30.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 shutdown_connections 2023-11-29T04:18:30.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.505+0000 7fd56ed65640 1 -- 172.21.15.6:0/4192053109 wait complete. 2023-11-29T04:18:30.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-29T04:18:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.973+0000 7f162592a640 1 Processor -- start 2023-11-29T04:18:30.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.973+0000 7f162592a640 1 -- start start 2023-11-29T04:18:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.977+0000 7f162592a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f16200d0730 0x7f16200ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.977+0000 7f162592a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015aba0 0x7f16200ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.977+0000 7f162592a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162015b3c0 con 0x7f162015e690 2023-11-29T04:18:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.977+0000 7f162592a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200cfe90 con 0x7f16200d0730 2023-11-29T04:18:30.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.977+0000 7f162592a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162015b0e0 con 0x7f162015aba0 2023-11-29T04:18:30.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.977+0000 7f161e7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f162015e690 0x7f162015a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32952/0 (socket says 172.21.15.6:32952) 2023-11-29T04:18:30.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.977+0000 7f161e7fc640 1 -- 172.21.15.6:0/1587601461 learned_addr learned my addr 172.21.15.6:0/1587601461 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:30.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.981+0000 7f161f7fe640 1 --2- 172.21.15.6:0/1587601461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015aba0 0x7f16200ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.981+0000 7f161effd640 1 --2- 172.21.15.6:0/1587601461 >> v2:172.21.15.31:3300/0 conn(0x7f16200d0730 0x7f16200ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:30.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.981+0000 7f161dffb640 1 -- 172.21.15.6:0/1587601461 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321436714 0 0) 0x7f162015b3c0 con 0x7f162015e690 2023-11-29T04:18:30.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.981+0000 7f161dffb640 1 -- 172.21.15.6:0/1587601461 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1608003530 con 0x7f162015e690 2023-11-29T04:18:30.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.981+0000 7f161effd640 1 -- 172.21.15.6:0/1587601461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015aba0 msgr2=0x7f16200ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:30.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.981+0000 7f161effd640 1 --2- 172.21.15.6:0/1587601461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015aba0 0x7f16200ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.981+0000 7f161effd640 1 -- 172.21.15.6:0/1587601461 >> v1:172.21.15.6:6789/0 conn(0x7f162015e690 legacy=0x7f162015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:30.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.981+0000 7f161effd640 1 -- 172.21.15.6:0/1587601461 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162015dbb0 con 0x7f16200d0730 2023-11-29T04:18:30.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.981+0000 7f161f7fe640 1 --2- 172.21.15.6:0/1587601461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015aba0 0x7f16200ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.989+0000 7f161effd640 1 --2- 172.21.15.6:0/1587601461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 0x7f16200ce5e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f16100097c0 tx=0x7f161001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7671839ed32c2ab3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.989+0000 7f161dffb640 1 -- 172.21.15.6:0/1587601461 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100ab5f0 con 0x7f16200d0730 2023-11-29T04:18:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.989+0000 7f161dffb640 1 -- 172.21.15.6:0/1587601461 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100ab750 con 0x7f16200d0730 2023-11-29T04:18:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.989+0000 7f161dffb640 1 -- 172.21.15.6:0/1587601461 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100abae0 con 0x7f16200d0730 2023-11-29T04:18:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.993+0000 7f162592a640 1 -- 172.21.15.6:0/1587601461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 msgr2=0x7f16200ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.993+0000 7f162592a640 1 --2- 172.21.15.6:0/1587601461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 0x7f16200ce5e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f16100097c0 tx=0x7f161001c3f0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.993+0000 7f162592a640 1 -- 172.21.15.6:0/1587601461 shutdown_connections 2023-11-29T04:18:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.993+0000 7f162592a640 1 --2- 172.21.15.6:0/1587601461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015aba0 0x7f16200ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.993+0000 7f162592a640 1 --2- 172.21.15.6:0/1587601461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 0x7f16200ce5e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.993+0000 7f162592a640 1 -- 172.21.15.6:0/1587601461 >> 172.21.15.6:0/1587601461 conn(0x7f16200cc940 msgr2=0x7f16200ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.993+0000 7f162592a640 1 -- 172.21.15.6:0/1587601461 shutdown_connections 2023-11-29T04:18:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.993+0000 7f162592a640 1 -- 172.21.15.6:0/1587601461 wait complete. 2023-11-29T04:18:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.997+0000 7f162592a640 1 Processor -- start 2023-11-29T04:18:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:30.997+0000 7f162592a640 1 -- start start 2023-11-29T04:18:31.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f162592a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 0x7f162015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f162592a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f162015aba0 0x7f1620148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f162592a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015e690 0x7f1620148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f162592a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620167d10 con 0x7f162015aba0 2023-11-29T04:18:31.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f162592a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1620166e20 con 0x7f16200d0730 2023-11-29T04:18:31.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f162592a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1620167100 con 0x7f162015e690 2023-11-29T04:18:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 0x7f162015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f162015aba0 0x7f1620148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161f7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015e690 0x7f1620148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 0x7f162015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:51812/0 (socket says 172.21.15.6:51812) 2023-11-29T04:18:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161effd640 1 -- 172.21.15.6:0/3555723077 learned_addr learned my addr 172.21.15.6:0/3555723077 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:31.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161f7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015e690 0x7f1620148640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:58636/0 (socket says 172.21.15.6:58636) 2023-11-29T04:18:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161f7fe640 1 -- 172.21.15.6:0/3555723077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 msgr2=0x7f162015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161f7fe640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 0x7f162015c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161f7fe640 1 -- 172.21.15.6:0/3555723077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f162015aba0 msgr2=0x7f1620148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161f7fe640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f162015aba0 0x7f1620148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161f7fe640 1 -- 172.21.15.6:0/3555723077 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618009a70 con 0x7f162015e690 2023-11-29T04:18:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.001+0000 7f161f7fe640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015e690 0x7f1620148640 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f161800ef90 tx=0x7f161800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.005+0000 7f1607fff640 1 -- 172.21.15.6:0/3555723077 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161800cd30 con 0x7f162015e690 2023-11-29T04:18:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.005+0000 7f1607fff640 1 -- 172.21.15.6:0/3555723077 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161800f040 con 0x7f162015e690 2023-11-29T04:18:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.005+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1610009420 con 0x7f162015e690 2023-11-29T04:18:31.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.005+0000 7f1607fff640 1 -- 172.21.15.6:0/3555723077 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618003be0 con 0x7f162015e690 2023-11-29T04:18:31.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.005+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16201676c0 con 0x7f162015e690 2023-11-29T04:18:31.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.005+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1620167e80 con 0x7f162015e690 2023-11-29T04:18:31.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.009+0000 7f1607fff640 1 -- 172.21.15.6:0/3555723077 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1618014480 con 0x7f162015e690 2023-11-29T04:18:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.013+0000 7f1607fff640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f160c0664c0 0x7f160c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.013+0000 7f1607fff640 1 -- 172.21.15.6:0/3555723077 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f16180844e0 con 0x7f162015e690 2023-11-29T04:18:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.013+0000 7f161effd640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f160c0664c0 0x7f160c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.013+0000 7f161effd640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f160c0664c0 0x7f160c068980 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f161001c430 tx=0x7f16100a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:31.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.017+0000 7f1607fff640 1 -- 172.21.15.6:0/3555723077 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1618051cf0 con 0x7f162015e690 2023-11-29T04:18:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.181+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f162006e750 con 0x7f160c0664c0 2023-11-29T04:18:31.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.181+0000 7f1607fff640 1 -- 172.21.15.6:0/3555723077 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f162006e750 con 0x7f160c0664c0 2023-11-29T04:18:31.186 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2023-11-29T04:18:31.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f160c0664c0 msgr2=0x7f160c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f160c0664c0 0x7f160c068980 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f161001c430 tx=0x7f16100a7000 comp rx=0 tx=0).stop 2023-11-29T04:18:31.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015e690 msgr2=0x7f1620148640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015e690 0x7f1620148640 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f161800ef90 tx=0x7f161800c490 comp rx=0 tx=0).stop 2023-11-29T04:18:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 shutdown_connections 2023-11-29T04:18:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f160c0664c0 0x7f160c068980 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f162015e690 0x7f1620148640 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f162015aba0 0x7f1620148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 --2- 172.21.15.6:0/3555723077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200d0730 0x7f162015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 >> 172.21.15.6:0/3555723077 conn(0x7f16200cc940 msgr2=0x7f16200b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:31.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 shutdown_connections 2023-11-29T04:18:31.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.185+0000 7f162592a640 1 -- 172.21.15.6:0/3555723077 wait complete. 2023-11-29T04:18:31.214 INFO:tasks.ceph:Scrubbing osd.6 2023-11-29T04:18:31.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-29T04:18:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.629+0000 7ffbead16640 1 Processor -- start 2023-11-29T04:18:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.629+0000 7ffbead16640 1 -- start start 2023-11-29T04:18:31.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.633+0000 7ffbead16640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffbe4160900 0x7ffbe40b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.633+0000 7ffbead16640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffbe40b2130 0x7ffbe40d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.633+0000 7ffbead16640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40cdd20 con 0x7ffbe4160ce0 2023-11-29T04:18:31.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.633+0000 7ffbead16640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40d3890 con 0x7ffbe4160900 2023-11-29T04:18:31.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.633+0000 7ffbead16640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40d2b90 con 0x7ffbe40b2130 2023-11-29T04:18:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.633+0000 7ffbe8ab2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffbe4160900 0x7ffbe40b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.633+0000 7ffbe8ab2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffbe4160900 0x7ffbe40b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56530/0 (socket says 172.21.15.6:56530) 2023-11-29T04:18:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.633+0000 7ffbe8ab2640 1 -- 172.21.15.6:0/1910826100 learned_addr learned my addr 172.21.15.6:0/1910826100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.633+0000 7ffbe3fff640 1 --2- 172.21.15.6:0/1910826100 >> v2:172.21.15.31:3300/0 conn(0x7ffbe40b2130 0x7ffbe40d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.637+0000 7ffbe8ab2640 1 -- 172.21.15.6:0/1910826100 >> v2:172.21.15.31:3300/0 conn(0x7ffbe40b2130 msgr2=0x7ffbe40d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.637+0000 7ffbe8ab2640 1 --2- 172.21.15.6:0/1910826100 >> v2:172.21.15.31:3300/0 conn(0x7ffbe40b2130 0x7ffbe40d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.637+0000 7ffbe8ab2640 1 -- 172.21.15.6:0/1910826100 >> v1:172.21.15.6:6789/0 conn(0x7ffbe4160ce0 legacy=0x7ffbe40d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.637+0000 7ffbe37fe640 1 -- 172.21.15.6:0/1910826100 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533770286 0 0) 0x7ffbe40cdd20 con 0x7ffbe4160ce0 2023-11-29T04:18:31.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.637+0000 7ffbe8ab2640 1 -- 172.21.15.6:0/1910826100 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40d4030 con 0x7ffbe4160900 2023-11-29T04:18:31.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbe8ab2640 1 --2- 172.21.15.6:0/1910826100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbe4160900 0x7ffbe40b2ae0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40b5d70 tx=0x7ffbd801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f1f603dcd593c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:31.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbe37fe640 1 -- 172.21.15.6:0/1910826100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80ab5f0 con 0x7ffbe4160900 2023-11-29T04:18:31.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbe37fe640 1 -- 172.21.15.6:0/1910826100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd80ab750 con 0x7ffbe4160900 2023-11-29T04:18:31.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbe37fe640 1 -- 172.21.15.6:0/1910826100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80abae0 con 0x7ffbe4160900 2023-11-29T04:18:31.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbead16640 1 -- 172.21.15.6:0/1910826100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbe4160900 msgr2=0x7ffbe40b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbead16640 1 --2- 172.21.15.6:0/1910826100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbe4160900 0x7ffbe40b2ae0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40b5d70 tx=0x7ffbd801c500 comp rx=0 tx=0).stop 2023-11-29T04:18:31.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbead16640 1 -- 172.21.15.6:0/1910826100 shutdown_connections 2023-11-29T04:18:31.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbead16640 1 --2- 172.21.15.6:0/1910826100 >> v2:172.21.15.31:3300/0 conn(0x7ffbe40b2130 0x7ffbe40d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbead16640 1 --2- 172.21.15.6:0/1910826100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbe4160900 0x7ffbe40b2ae0 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbead16640 1 -- 172.21.15.6:0/1910826100 >> 172.21.15.6:0/1910826100 conn(0x7ffbe409c4b0 msgr2=0x7ffbe40d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:31.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbead16640 1 -- 172.21.15.6:0/1910826100 shutdown_connections 2023-11-29T04:18:31.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.641+0000 7ffbead16640 1 -- 172.21.15.6:0/1910826100 wait complete. 2023-11-29T04:18:31.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.645+0000 7ffbead16640 1 Processor -- start 2023-11-29T04:18:31.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.645+0000 7ffbead16640 1 -- start start 2023-11-29T04:18:31.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbead16640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40b2130 0x7ffbe40b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbead16640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4160900 0x7ffbe40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbead16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbe4160ce0 0x7ffbe41590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbead16640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4159e30 con 0x7ffbe4160ce0 2023-11-29T04:18:31.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbead16640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40b8dd0 con 0x7ffbe40b2130 2023-11-29T04:18:31.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbead16640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40b8af0 con 0x7ffbe4160900 2023-11-29T04:18:31.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe8ab2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40b2130 0x7ffbe40b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe3fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4160900 0x7ffbe40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe8ab2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40b2130 0x7ffbe40b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:51830/0 (socket says 172.21.15.6:51830) 2023-11-29T04:18:31.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe8ab2640 1 -- 172.21.15.6:0/844230719 learned_addr learned my addr 172.21.15.6:0/844230719 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:31.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe92b3640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbe4160ce0 0x7ffbe41590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe8ab2640 1 -- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4160900 msgr2=0x7ffbe40b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe8ab2640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4160900 0x7ffbe40b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe8ab2640 1 -- 172.21.15.6:0/844230719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbe4160ce0 msgr2=0x7ffbe41590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe8ab2640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbe4160ce0 0x7ffbe41590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe8ab2640 1 -- 172.21.15.6:0/844230719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80094d0 con 0x7ffbe40b2130 2023-11-29T04:18:31.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.649+0000 7ffbe92b3640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbe4160ce0 0x7ffbe41590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T04:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.653+0000 7ffbe8ab2640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40b2130 0x7ffbe40b4290 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ffbd801abb0 tx=0x7ffbd801ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.653+0000 7ffbe17fa640 1 -- 172.21.15.6:0/844230719 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80abcd0 con 0x7ffbe40b2130 2023-11-29T04:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.653+0000 7ffbe17fa640 1 -- 172.21.15.6:0/844230719 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd80b8070 con 0x7ffbe40b2130 2023-11-29T04:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.653+0000 7ffbe17fa640 1 -- 172.21.15.6:0/844230719 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8004220 con 0x7ffbe40b2130 2023-11-29T04:18:31.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.653+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe40cc9f0 con 0x7ffbe40b2130 2023-11-29T04:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.653+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe40ccfb0 con 0x7ffbe40b2130 2023-11-29T04:18:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.653+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffbe40ce230 con 0x7ffbe40b2130 2023-11-29T04:18:31.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.657+0000 7ffbe17fa640 1 -- 172.21.15.6:0/844230719 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffbd8004380 con 0x7ffbe40b2130 2023-11-29T04:18:31.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.661+0000 7ffbe17fa640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffbc80664c0 0x7ffbc8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.661+0000 7ffbe17fa640 1 -- 172.21.15.6:0/844230719 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffbd80a8050 con 0x7ffbe40b2130 2023-11-29T04:18:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.661+0000 7ffbe3fff640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffbc80664c0 0x7ffbc8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.661+0000 7ffbe17fa640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7ffbc806c320 0x7ffbc806e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:31.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.661+0000 7ffbe17fa640 1 -- 172.21.15.6:0/844230719 --> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffbc806edf0 con 0x7ffbc806c320 2023-11-29T04:18:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.661+0000 7ffbe17fa640 1 -- 172.21.15.6:0/844230719 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbd81222a0 con 0x7ffbe40b2130 2023-11-29T04:18:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.661+0000 7ffbe92b3640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7ffbc806c320 0x7ffbc806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:31.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.661+0000 7ffbe3fff640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffbc80664c0 0x7ffbc8068980 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40b2ff0 tx=0x7ffbd0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:31.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.661+0000 7ffbe92b3640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7ffbc806c320 0x7ffbc806e740 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:31.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.665+0000 7ffbe17fa640 1 -- 172.21.15.6:0/844230719 <== osd.6 v2:172.21.15.31:6800/2769386372 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffbc806edf0 con 0x7ffbc806c320 2023-11-29T04:18:31.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 --> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffbe40cdf50 con 0x7ffbc806c320 2023-11-29T04:18:31.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbe17fa640 1 -- 172.21.15.6:0/844230719 <== osd.6 v2:172.21.15.31:6800/2769386372 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffbdc001f00 con 0x7ffbc806c320 2023-11-29T04:18:31.708 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-29T04:18:31.708 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T04:18:31.709 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-29T04:18:31.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7ffbc806c320 msgr2=0x7ffbc806e740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:6800/2769386372,v1:172.21.15.31:6802/2769386372] conn(0x7ffbc806c320 0x7ffbc806e740 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:31.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffbc80664c0 msgr2=0x7ffbc8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7ffbc80664c0 0x7ffbc8068980 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40b2ff0 tx=0x7ffbd0009190 comp rx=0 tx=0).stop 2023-11-29T04:18:31.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40b2130 msgr2=0x7ffbe40b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:31.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 --2- 172.21.15.6:0/844230719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40b2130 0x7ffbe40b4290 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ffbd801abb0 tx=0x7ffbd801ad40 comp rx=0 tx=0).stop 2023-11-29T04:18:31.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbe92b3640 1 -- 172.21.15.6:0/844230719 reap_dead start 2023-11-29T04:18:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 shutdown_connections 2023-11-29T04:18:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 >> 172.21.15.6:0/844230719 conn(0x7ffbe409c4b0 msgr2=0x7ffbe40b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 shutdown_connections 2023-11-29T04:18:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:31.705+0000 7ffbead16640 1 -- 172.21.15.6:0/844230719 wait complete. 2023-11-29T04:18:31.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-29T04:18:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.173+0000 7f87c54bb640 1 Processor -- start 2023-11-29T04:18:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.173+0000 7f87c54bb640 1 -- start start 2023-11-29T04:18:32.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87c54bb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87c014b0e0 0x7f87c00b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:32.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87c54bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:32.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87c54bb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00b3e30 con 0x7f87c00b1e70 2023-11-29T04:18:32.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87c54bb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c014b4c0 con 0x7f87c014b0e0 2023-11-29T04:18:32.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87c54bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00b2850 con 0x7f87c006d060 2023-11-29T04:18:32.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87beffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87c014b0e0 0x7f87c00b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:32.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87beffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87c014b0e0 0x7f87c00b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56548/0 (socket says 172.21.15.6:56548) 2023-11-29T04:18:32.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87beffd640 1 -- 172.21.15.6:0/1213519423 learned_addr learned my addr 172.21.15.6:0/1213519423 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:32.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87beffd640 1 -- 172.21.15.6:0/1213519423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 msgr2=0x7f87c00cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:32.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.177+0000 7f87bf7fe640 1 --2- 172.21.15.6:0/1213519423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:32.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.181+0000 7f87beffd640 1 --2- 172.21.15.6:0/1213519423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.181+0000 7f87beffd640 1 -- 172.21.15.6:0/1213519423 >> v1:172.21.15.31:6789/0 conn(0x7f87c00b1e70 legacy=0x7f87c006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:32.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.181+0000 7f87beffd640 1 -- 172.21.15.6:0/1213519423 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00b2b30 con 0x7f87c014b0e0 2023-11-29T04:18:32.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.181+0000 7f87bf7fe640 1 --2- 172.21.15.6:0/1213519423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T04:18:32.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.181+0000 7f87beffd640 1 --2- 172.21.15.6:0/1213519423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c014b0e0 0x7f87c00b38f0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009870 tx=0x7f87b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8078e89981fc1832 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:32.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87be7fc640 1 -- 172.21.15.6:0/1213519423 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00aa5f0 con 0x7f87c014b0e0 2023-11-29T04:18:32.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87be7fc640 1 -- 172.21.15.6:0/1213519423 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b00aa750 con 0x7f87c014b0e0 2023-11-29T04:18:32.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87be7fc640 1 -- 172.21.15.6:0/1213519423 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00aaae0 con 0x7f87c014b0e0 2023-11-29T04:18:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87c54bb640 1 -- 172.21.15.6:0/1213519423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c014b0e0 msgr2=0x7f87c00b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87c54bb640 1 --2- 172.21.15.6:0/1213519423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c014b0e0 0x7f87c00b38f0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009870 tx=0x7f87b001c4d0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87c54bb640 1 -- 172.21.15.6:0/1213519423 shutdown_connections 2023-11-29T04:18:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87c54bb640 1 --2- 172.21.15.6:0/1213519423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87c54bb640 1 --2- 172.21.15.6:0/1213519423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c014b0e0 0x7f87c00b38f0 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87c54bb640 1 -- 172.21.15.6:0/1213519423 >> 172.21.15.6:0/1213519423 conn(0x7f87c006a980 msgr2=0x7f87c006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87c54bb640 1 -- 172.21.15.6:0/1213519423 shutdown_connections 2023-11-29T04:18:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.185+0000 7f87c54bb640 1 -- 172.21.15.6:0/1213519423 wait complete. 2023-11-29T04:18:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.189+0000 7f87c54bb640 1 Processor -- start 2023-11-29T04:18:32.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.189+0000 7f87c54bb640 1 -- start start 2023-11-29T04:18:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87c54bb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87c54bb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c00b1e70 0x7f87c00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87c54bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87c014b0e0 0x7f87c016b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87c54bb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a8e20 con 0x7f87c00b1e70 2023-11-29T04:18:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87c54bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00ae1f0 con 0x7f87c014b0e0 2023-11-29T04:18:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87c54bb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a8480 con 0x7f87c006d060 2023-11-29T04:18:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c00b1e70 0x7f87c00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87beffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c00b1e70 0x7f87c00ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56556/0 (socket says 172.21.15.6:56556) 2023-11-29T04:18:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87b7fff640 1 -- 172.21.15.6:0/169604570 learned_addr learned my addr 172.21.15.6:0/169604570 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87bf7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87c014b0e0 0x7f87c016b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87beffd640 1 -- 172.21.15.6:0/169604570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87c014b0e0 msgr2=0x7f87c016b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87beffd640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87c014b0e0 0x7f87c016b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87beffd640 1 -- 172.21.15.6:0/169604570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c00b1e70 msgr2=0x7f87c00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87beffd640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c00b1e70 0x7f87c00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87beffd640 1 -- 172.21.15.6:0/169604570 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00094d0 con 0x7f87c006d060 2023-11-29T04:18:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.193+0000 7f87bf7fe640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87c014b0e0 0x7f87c016b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.197+0000 7f87beffd640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00ab660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f87b00ab000 tx=0x7f87b001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.197+0000 7f87b77fe640 1 -- 172.21.15.6:0/169604570 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00b3800 con 0x7f87c006d060 2023-11-29T04:18:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.197+0000 7f87b77fe640 1 -- 172.21.15.6:0/169604570 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b00b3980 con 0x7f87c006d060 2023-11-29T04:18:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.197+0000 7f87b77fe640 1 -- 172.21.15.6:0/169604570 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00b3d30 con 0x7f87c006d060 2023-11-29T04:18:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.197+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c00a8760 con 0x7f87c006d060 2023-11-29T04:18:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.197+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c00adef0 con 0x7f87c006d060 2023-11-29T04:18:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.201+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c0072b90 con 0x7f87c006d060 2023-11-29T04:18:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.201+0000 7f87b77fe640 1 -- 172.21.15.6:0/169604570 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87b00c6390 con 0x7f87c006d060 2023-11-29T04:18:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.205+0000 7f87b77fe640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f87a00664f0 0x7f87a00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.205+0000 7f87b77fe640 1 -- 172.21.15.6:0/169604570 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f87b00a7070 con 0x7f87c006d060 2023-11-29T04:18:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.205+0000 7f87b7fff640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f87a00664f0 0x7f87a00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.205+0000 7f87b7fff640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f87a00664f0 0x7f87a00689b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f87c01fda80 tx=0x7f87a8003700 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:32.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.209+0000 7f87b77fe640 1 -- 172.21.15.6:0/169604570 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87b00ebca0 con 0x7f87c006d060 2023-11-29T04:18:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.677+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f87c016e230 con 0x7f87a00664f0 2023-11-29T04:18:32.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.677+0000 7f87b77fe640 1 -- 172.21.15.6:0/169604570 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f87a8003a30 con 0x7f87a00664f0 2023-11-29T04:18:32.680 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2023-11-29T04:18:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f87a00664f0 msgr2=0x7f87a00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f87a00664f0 0x7f87a00689b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f87c01fda80 tx=0x7f87a8003700 comp rx=0 tx=0).stop 2023-11-29T04:18:32.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 msgr2=0x7f87c00ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00ab660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f87b00ab000 tx=0x7f87b001ad10 comp rx=0 tx=0).stop 2023-11-29T04:18:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 shutdown_connections 2023-11-29T04:18:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f87a00664f0 0x7f87a00689b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87c014b0e0 0x7f87c016b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c00b1e70 0x7f87c00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 --2- 172.21.15.6:0/169604570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87c006d060 0x7f87c00ab660 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 >> 172.21.15.6:0/169604570 conn(0x7f87c006a980 msgr2=0x7f87c01645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 shutdown_connections 2023-11-29T04:18:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:32.681+0000 7f87c54bb640 1 -- 172.21.15.6:0/169604570 wait complete. 2023-11-29T04:18:32.736 INFO:tasks.ceph:Scrubbing osd.7 2023-11-29T04:18:32.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-29T04:18:33.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.161+0000 7f7c05b9d640 1 Processor -- start 2023-11-29T04:18:33.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.161+0000 7f7c05b9d640 1 -- start start 2023-11-29T04:18:33.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7c05b9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c000d2000 0x7f7c000d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7c05b9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c000d0110 0x7f7c000b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7c05b9d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c000b2920 con 0x7f7c000d38d0 2023-11-29T04:18:33.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7c05b9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c000cea10 con 0x7f7c000d2000 2023-11-29T04:18:33.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7c05b9d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c000cecf0 con 0x7f7c000d0110 2023-11-29T04:18:33.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7bff7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c000d2000 0x7f7c000d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7bfffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c000d0110 0x7f7c000b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7bfeffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7c000d38d0 0x7f7c000cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:49812/0 (socket says 172.21.15.6:49812) 2023-11-29T04:18:33.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7bff7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7c000d2000 0x7f7c000d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56560/0 (socket says 172.21.15.6:56560) 2023-11-29T04:18:33.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7bff7fe640 1 -- 172.21.15.6:0/575930072 learned_addr learned my addr 172.21.15.6:0/575930072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:33.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7bfffff640 1 -- 172.21.15.6:0/575930072 >> v2:172.21.15.6:3300/0 conn(0x7f7c000d2000 msgr2=0x7f7c000d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:33.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7bfffff640 1 --2- 172.21.15.6:0/575930072 >> v2:172.21.15.6:3300/0 conn(0x7f7c000d2000 0x7f7c000d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7bfffff640 1 -- 172.21.15.6:0/575930072 >> v1:172.21.15.31:6789/0 conn(0x7f7c000d38d0 legacy=0x7f7c000cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.165+0000 7f7bfffff640 1 -- 172.21.15.6:0/575930072 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000cefd0 con 0x7f7c000d0110 2023-11-29T04:18:33.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.173+0000 7f7bfffff640 1 --2- 172.21.15.6:0/575930072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c000d0110 0x7f7c000b3090 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7c0008b770 tx=0x7f7bf801c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a56cbc107704e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:33.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7bfe7fc640 1 -- 172.21.15.6:0/575930072 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000b4350 con 0x7f7c000d0110 2023-11-29T04:18:33.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7bfe7fc640 1 -- 172.21.15.6:0/575930072 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf80a59f0 con 0x7f7c000d0110 2023-11-29T04:18:33.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7bfe7fc640 1 -- 172.21.15.6:0/575930072 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf80a5d80 con 0x7f7c000d0110 2023-11-29T04:18:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7c05b9d640 1 -- 172.21.15.6:0/575930072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c000d0110 msgr2=0x7f7c000b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7c05b9d640 1 --2- 172.21.15.6:0/575930072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c000d0110 0x7f7c000b3090 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7c0008b770 tx=0x7f7bf801c910 comp rx=0 tx=0).stop 2023-11-29T04:18:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7c05b9d640 1 -- 172.21.15.6:0/575930072 shutdown_connections 2023-11-29T04:18:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7c05b9d640 1 --2- 172.21.15.6:0/575930072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c000d0110 0x7f7c000b3090 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7c05b9d640 1 --2- 172.21.15.6:0/575930072 >> v2:172.21.15.6:3300/0 conn(0x7f7c000d2000 0x7f7c000d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7c05b9d640 1 -- 172.21.15.6:0/575930072 >> 172.21.15.6:0/575930072 conn(0x7f7c0009c490 msgr2=0x7f7c000d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7c05b9d640 1 -- 172.21.15.6:0/575930072 shutdown_connections 2023-11-29T04:18:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.177+0000 7f7c05b9d640 1 -- 172.21.15.6:0/575930072 wait complete. 2023-11-29T04:18:33.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.181+0000 7f7c05b9d640 1 Processor -- start 2023-11-29T04:18:33.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.181+0000 7f7c05b9d640 1 -- start start 2023-11-29T04:18:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7c05b9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c000d0110 0x7f7c000c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7c05b9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c000d2000 0x7f7c000b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7c05b9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c000d38d0 0x7f7c000cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7c05b9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c9260 con 0x7f7c000d0110 2023-11-29T04:18:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7c05b9d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c85e0 con 0x7f7c000d2000 2023-11-29T04:18:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7c05b9d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c88c0 con 0x7f7c000d38d0 2023-11-29T04:18:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c000d0110 0x7f7c000c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c000d0110 0x7f7c000c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56562/0 (socket says 172.21.15.6:56562) 2023-11-29T04:18:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bff7fe640 1 -- 172.21.15.6:0/79229645 learned_addr learned my addr 172.21.15.6:0/79229645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bfeffd640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c000d2000 0x7f7c000b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bfffff640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c000d38d0 0x7f7c000cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bff7fe640 1 -- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c000d38d0 msgr2=0x7f7c000cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bff7fe640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c000d38d0 0x7f7c000cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bff7fe640 1 -- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c000d2000 msgr2=0x7f7c000b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bff7fe640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c000d2000 0x7f7c000b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bff7fe640 1 -- 172.21.15.6:0/79229645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8009a70 con 0x7f7c000d0110 2023-11-29T04:18:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.185+0000 7f7bfffff640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7c000d38d0 0x7f7c000cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T04:18:33.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.189+0000 7f7bff7fe640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c000d0110 0x7f7c000c9680 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000e890 tx=0x7f7bf000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:33.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.189+0000 7f7be7fff640 1 -- 172.21.15.6:0/79229645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0009620 con 0x7f7c000d0110 2023-11-29T04:18:33.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.189+0000 7f7be7fff640 1 -- 172.21.15.6:0/79229645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf000c940 con 0x7f7c000d0110 2023-11-29T04:18:33.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.189+0000 7f7be7fff640 1 -- 172.21.15.6:0/79229645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf000ccf0 con 0x7f7c000d0110 2023-11-29T04:18:33.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.189+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c000c8ba0 con 0x7f7c000d0110 2023-11-29T04:18:33.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.189+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c000c8200 con 0x7f7c000d0110 2023-11-29T04:18:33.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.189+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c00068520 con 0x7f7c000d0110 2023-11-29T04:18:33.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.193+0000 7f7be7fff640 1 -- 172.21.15.6:0/79229645 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7bf0013470 con 0x7f7c000d0110 2023-11-29T04:18:33.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.193+0000 7f7be7fff640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7bec066470 0x7f7bec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.193+0000 7f7be7fff640 1 -- 172.21.15.6:0/79229645 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7bf0083cc0 con 0x7f7c000d0110 2023-11-29T04:18:33.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.193+0000 7f7be7fff640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7f7bec06c2d0 0x7f7bec06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.193+0000 7f7be7fff640 1 -- 172.21.15.6:0/79229645 --> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bec06eda0 con 0x7f7bec06c2d0 2023-11-29T04:18:33.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.193+0000 7f7be7fff640 1 -- 172.21.15.6:0/79229645 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bf00882a0 con 0x7f7c000d0110 2023-11-29T04:18:33.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.197+0000 7f7bfeffd640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7bec066470 0x7f7bec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.197+0000 7f7bfffff640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7f7bec06c2d0 0x7f7bec06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.197+0000 7f7bfffff640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7f7bec06c2d0 0x7f7bec06e6f0 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:33.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.197+0000 7f7bfeffd640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7bec066470 0x7f7bec068930 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7c000b0be0 tx=0x7f7bf4007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:33.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.197+0000 7f7be7fff640 1 -- 172.21.15.6:0/79229645 <== osd.7 v2:172.21.15.31:6820/3973817173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7bec06eda0 con 0x7f7bec06c2d0 2023-11-29T04:18:33.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.213+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 --> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7c000c94d0 con 0x7f7bec06c2d0 2023-11-29T04:18:33.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.213+0000 7f7be7fff640 1 -- 172.21.15.6:0/79229645 <== osd.7 v2:172.21.15.31:6820/3973817173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7c000c94d0 con 0x7f7bec06c2d0 2023-11-29T04:18:33.218 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-11-29T04:18:33.219 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T04:18:33.219 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-11-29T04:18:33.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.213+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7f7bec06c2d0 msgr2=0x7f7bec06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.213+0000 7f7c05b9d640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.31:6820/3973817173,v1:172.21.15.31:6822/3973817173] conn(0x7f7bec06c2d0 0x7f7bec06e6f0 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.217+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7bec066470 msgr2=0x7f7bec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.217+0000 7f7c05b9d640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f7bec066470 0x7f7bec068930 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7c000b0be0 tx=0x7f7bf4007e50 comp rx=0 tx=0).stop 2023-11-29T04:18:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.217+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c000d0110 msgr2=0x7f7c000c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.217+0000 7f7c05b9d640 1 --2- 172.21.15.6:0/79229645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c000d0110 0x7f7c000c9680 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000e890 tx=0x7f7bf000ed50 comp rx=0 tx=0).stop 2023-11-29T04:18:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.217+0000 7f7bfffff640 1 -- 172.21.15.6:0/79229645 reap_dead start 2023-11-29T04:18:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.217+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 shutdown_connections 2023-11-29T04:18:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.217+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 >> 172.21.15.6:0/79229645 conn(0x7f7c0009c490 msgr2=0x7f7c00160540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:33.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.217+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 shutdown_connections 2023-11-29T04:18:33.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.217+0000 7f7c05b9d640 1 -- 172.21.15.6:0/79229645 wait complete. 2023-11-29T04:18:33.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-29T04:18:33.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.657+0000 7eff88ebb640 1 Processor -- start 2023-11-29T04:18:33.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.661+0000 7eff88ebb640 1 -- start start 2023-11-29T04:18:33.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.661+0000 7eff88ebb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff840d1c00 0x7eff840b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff88ebb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff840d3a00 con 0x7eff840b3f60 2023-11-29T04:18:33.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff88ebb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff840ceed0 con 0x7eff840b3250 2023-11-29T04:18:33.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff88ebb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff840d3d50 con 0x7eff840d1c00 2023-11-29T04:18:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff82ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff840d1c00 0x7eff840b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff837fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7eff840b3250 0x7eff840d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:49818/0 (socket says 172.21.15.6:49818) 2023-11-29T04:18:33.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff837fe640 1 -- 172.21.15.6:0/3458435468 learned_addr learned my addr 172.21.15.6:0/3458435468 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff82ffd640 1 -- 172.21.15.6:0/3458435468 >> v1:172.21.15.31:6789/0 conn(0x7eff840b3250 legacy=0x7eff840d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff82ffd640 1 -- 172.21.15.6:0/3458435468 >> v1:172.21.15.6:6789/0 conn(0x7eff840b3f60 legacy=0x7eff840b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff827fc640 1 -- 172.21.15.6:0/3458435468 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731424129 0 0) 0x7eff840ceed0 con 0x7eff840b3250 2023-11-29T04:18:33.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.665+0000 7eff82ffd640 1 -- 172.21.15.6:0/3458435468 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840b3bb0 con 0x7eff840d1c00 2023-11-29T04:18:33.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.673+0000 7eff82ffd640 1 --2- 172.21.15.6:0/3458435468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff840d1c00 0x7eff840b5e40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7eff780097c0 tx=0x7eff840b72a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4df84d8a99afd65 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:33.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.673+0000 7eff827fc640 1 -- 172.21.15.6:0/3458435468 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780ab600 con 0x7eff840d1c00 2023-11-29T04:18:33.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.673+0000 7eff827fc640 1 -- 172.21.15.6:0/3458435468 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff780a7050 con 0x7eff840d1c00 2023-11-29T04:18:33.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.673+0000 7eff827fc640 1 -- 172.21.15.6:0/3458435468 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780ab980 con 0x7eff840d1c00 2023-11-29T04:18:33.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.677+0000 7eff88ebb640 1 -- 172.21.15.6:0/3458435468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff840d1c00 msgr2=0x7eff840b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.677+0000 7eff88ebb640 1 --2- 172.21.15.6:0/3458435468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff840d1c00 0x7eff840b5e40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7eff780097c0 tx=0x7eff840b72a0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.677+0000 7eff88ebb640 1 -- 172.21.15.6:0/3458435468 shutdown_connections 2023-11-29T04:18:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.677+0000 7eff88ebb640 1 --2- 172.21.15.6:0/3458435468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff840d1c00 0x7eff840b5e40 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.677+0000 7eff88ebb640 1 -- 172.21.15.6:0/3458435468 >> 172.21.15.6:0/3458435468 conn(0x7eff840d2f10 msgr2=0x7eff840d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.677+0000 7eff88ebb640 1 -- 172.21.15.6:0/3458435468 shutdown_connections 2023-11-29T04:18:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.677+0000 7eff88ebb640 1 -- 172.21.15.6:0/3458435468 wait complete. 2023-11-29T04:18:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.681+0000 7eff88ebb640 1 Processor -- start 2023-11-29T04:18:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.681+0000 7eff88ebb640 1 -- start start 2023-11-29T04:18:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff88ebb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff840b3250 0x7eff840c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff88ebb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff840b3f60 0x7eff840c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff88ebb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff840d1c00 0x7eff84157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff88ebb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8415c8f0 con 0x7eff840b3250 2023-11-29T04:18:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff88ebb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff840cb0e0 con 0x7eff840d1c00 2023-11-29T04:18:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff88ebb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff840c9950 con 0x7eff840b3f60 2023-11-29T04:18:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff82ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff840b3f60 0x7eff840c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff837fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff840b3250 0x7eff840c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff82ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff840b3f60 0x7eff840c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:58678/0 (socket says 172.21.15.6:58678) 2023-11-29T04:18:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff82ffd640 1 -- 172.21.15.6:0/2145734251 learned_addr learned my addr 172.21.15.6:0/2145734251 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff83fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff840d1c00 0x7eff84157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff82ffd640 1 -- 172.21.15.6:0/2145734251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff840d1c00 msgr2=0x7eff84157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff82ffd640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff840d1c00 0x7eff84157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff82ffd640 1 -- 172.21.15.6:0/2145734251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff840b3250 msgr2=0x7eff840c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff82ffd640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff840b3250 0x7eff840c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.685+0000 7eff82ffd640 1 -- 172.21.15.6:0/2145734251 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff78009420 con 0x7eff840b3f60 2023-11-29T04:18:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.689+0000 7eff82ffd640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff840b3f60 0x7eff840c6a40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7eff78018f70 tx=0x7eff78019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.689+0000 7eff6bfff640 1 -- 172.21.15.6:0/2145734251 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780b4810 con 0x7eff840b3f60 2023-11-29T04:18:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.689+0000 7eff6bfff640 1 -- 172.21.15.6:0/2145734251 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff780b49b0 con 0x7eff840b3f60 2023-11-29T04:18:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.689+0000 7eff6bfff640 1 -- 172.21.15.6:0/2145734251 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780b4d60 con 0x7eff840b3f60 2023-11-29T04:18:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.689+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8415cb00 con 0x7eff840b3f60 2023-11-29T04:18:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.689+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff840cad70 con 0x7eff840b3f60 2023-11-29T04:18:33.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.689+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff840cb270 con 0x7eff840b3f60 2023-11-29T04:18:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.693+0000 7eff6bfff640 1 -- 172.21.15.6:0/2145734251 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff780b2040 con 0x7eff840b3f60 2023-11-29T04:18:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.693+0000 7eff6bfff640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff700664c0 0x7eff70068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.697+0000 7eff6bfff640 1 -- 172.21.15.6:0/2145734251 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7eff7811dd60 con 0x7eff840b3f60 2023-11-29T04:18:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.697+0000 7eff837fe640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff700664c0 0x7eff70068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:33.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.697+0000 7eff837fe640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff700664c0 0x7eff70068980 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7eff74000f70 tx=0x7eff74007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:33.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.701+0000 7eff6bfff640 1 -- 172.21.15.6:0/2145734251 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff780eb700 con 0x7eff840b3f60 2023-11-29T04:18:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.861+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7eff840b3840 con 0x7eff700664c0 2023-11-29T04:18:33.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff6bfff640 1 -- 172.21.15.6:0/2145734251 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7eff74004d40 con 0x7eff700664c0 2023-11-29T04:18:33.868 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2023-11-29T04:18:33.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff700664c0 msgr2=0x7eff70068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff700664c0 0x7eff70068980 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7eff74000f70 tx=0x7eff74007240 comp rx=0 tx=0).stop 2023-11-29T04:18:33.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff840b3f60 msgr2=0x7eff840c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:33.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff840b3f60 0x7eff840c6a40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7eff78018f70 tx=0x7eff78019100 comp rx=0 tx=0).stop 2023-11-29T04:18:33.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 shutdown_connections 2023-11-29T04:18:33.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7eff700664c0 0x7eff70068980 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff840d1c00 0x7eff84157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff840b3f60 0x7eff840c6a40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 --2- 172.21.15.6:0/2145734251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff840b3250 0x7eff840c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:33.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 >> 172.21.15.6:0/2145734251 conn(0x7eff840d2f10 msgr2=0x7eff840b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:33.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 shutdown_connections 2023-11-29T04:18:33.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:33.865+0000 7eff88ebb640 1 -- 172.21.15.6:0/2145734251 wait complete. 2023-11-29T04:18:33.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T04:18:34.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.301+0000 7f413ad80640 1 Processor -- start 2023-11-29T04:18:34.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.301+0000 7f413ad80640 1 -- start start 2023-11-29T04:18:34.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.305+0000 7f413ad80640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4134160cd0 0x7f41340b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:34.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.305+0000 7f413ad80640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340b2550 0x7f41340b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:34.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.305+0000 7f413ad80640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41340aff60 con 0x7f41340d1880 2023-11-29T04:18:34.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.305+0000 7f413ad80640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41340b0240 con 0x7f4134160cd0 2023-11-29T04:18:34.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.305+0000 7f413ad80640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41340b0520 con 0x7f41340b2550 2023-11-29T04:18:34.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.305+0000 7f4138b1c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f41340d1880 0x7f41341605c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:49834/0 (socket says 172.21.15.6:49834) 2023-11-29T04:18:34.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.305+0000 7f4138b1c640 1 -- 172.21.15.6:0/756521743 learned_addr learned my addr 172.21.15.6:0/756521743 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-11-29T04:18:34.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.305+0000 7f413931d640 1 --2- 172.21.15.6:0/756521743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340b2550 0x7f41340b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:34.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.305+0000 7f4133fff640 1 --2- 172.21.15.6:0/756521743 >> v2:172.21.15.6:3300/0 conn(0x7f4134160cd0 0x7f41340b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:34.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.309+0000 7f413931d640 1 -- 172.21.15.6:0/756521743 >> v2:172.21.15.6:3300/0 conn(0x7f4134160cd0 msgr2=0x7f41340b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:34.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.309+0000 7f413931d640 1 --2- 172.21.15.6:0/756521743 >> v2:172.21.15.6:3300/0 conn(0x7f4134160cd0 0x7f41340b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.309+0000 7f413931d640 1 -- 172.21.15.6:0/756521743 >> v1:172.21.15.31:6789/0 conn(0x7f41340d1880 legacy=0x7f41341605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:34.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.309+0000 7f413931d640 1 -- 172.21.15.6:0/756521743 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340b0800 con 0x7f41340b2550 2023-11-29T04:18:34.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.309+0000 7f41337fe640 1 -- 172.21.15.6:0/756521743 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393132684 0 0) 0x7f41340aff60 con 0x7f41340d1880 2023-11-29T04:18:34.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.309+0000 7f413931d640 1 --2- 172.21.15.6:0/756521743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340b2550 0x7f41340b1260 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f412c009d90 tx=0x7f412c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b0c10ddfe35aa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.309+0000 7f41337fe640 1 -- 172.21.15.6:0/756521743 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c0a5920 con 0x7f41340b2550 2023-11-29T04:18:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.309+0000 7f41337fe640 1 -- 172.21.15.6:0/756521743 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c0a5a80 con 0x7f41340b2550 2023-11-29T04:18:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f41337fe640 1 -- 172.21.15.6:0/756521743 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c0a5e10 con 0x7f41340b2550 2023-11-29T04:18:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 -- 172.21.15.6:0/756521743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340b2550 msgr2=0x7f41340b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 --2- 172.21.15.6:0/756521743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340b2550 0x7f41340b1260 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f412c009d90 tx=0x7f412c01c950 comp rx=0 tx=0).stop 2023-11-29T04:18:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 -- 172.21.15.6:0/756521743 shutdown_connections 2023-11-29T04:18:34.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 --2- 172.21.15.6:0/756521743 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340b2550 0x7f41340b1260 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 --2- 172.21.15.6:0/756521743 >> v2:172.21.15.6:3300/0 conn(0x7f4134160cd0 0x7f41340b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 -- 172.21.15.6:0/756521743 >> 172.21.15.6:0/756521743 conn(0x7f413409c460 msgr2=0x7f41340d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:34.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 -- 172.21.15.6:0/756521743 shutdown_connections 2023-11-29T04:18:34.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 -- 172.21.15.6:0/756521743 wait complete. 2023-11-29T04:18:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 Processor -- start 2023-11-29T04:18:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.313+0000 7f413ad80640 1 -- start start 2023-11-29T04:18:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f413ad80640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41340b2550 0x7f413406bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f413ad80640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340d1880 0x7f41340b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4133fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340d1880 0x7f41340b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4138b1c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41340b2550 0x7f413406bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f413ad80640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4134160cd0 0x7f41340b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f413ad80640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41340b75a0 con 0x7f4134160cd0 2023-11-29T04:18:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f413ad80640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41340b52e0 con 0x7f41340b2550 2023-11-29T04:18:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f413ad80640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41340b55c0 con 0x7f41340d1880 2023-11-29T04:18:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4133fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340d1880 0x7f41340b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:58700/0 (socket says 172.21.15.6:58700) 2023-11-29T04:18:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4133fff640 1 -- 172.21.15.6:0/2266464084 learned_addr learned my addr 172.21.15.6:0/2266464084 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f413931d640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4134160cd0 0x7f41340b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4133fff640 1 -- 172.21.15.6:0/2266464084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41340b2550 msgr2=0x7f413406bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4133fff640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41340b2550 0x7f413406bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4133fff640 1 -- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4134160cd0 msgr2=0x7f41340b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4133fff640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4134160cd0 0x7f41340b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4133fff640 1 -- 172.21.15.6:0/2266464084 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c009a70 con 0x7f41340d1880 2023-11-29T04:18:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f4133fff640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340d1880 0x7f41340b7a80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f412000d5f0 tx=0x7f412000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f41317fa640 1 -- 172.21.15.6:0/2266464084 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41200125f0 con 0x7f41340d1880 2023-11-29T04:18:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f41317fa640 1 -- 172.21.15.6:0/2266464084 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120012750 con 0x7f41340d1880 2023-11-29T04:18:34.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f41317fa640 1 -- 172.21.15.6:0/2266464084 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120012ae0 con 0x7f41340d1880 2023-11-29T04:18:34.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41340b58a0 con 0x7f41340d1880 2023-11-29T04:18:34.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.317+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41340b5e60 con 0x7f41340d1880 2023-11-29T04:18:34.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.321+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41340b7710 con 0x7f41340d1880 2023-11-29T04:18:34.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.321+0000 7f41317fa640 1 -- 172.21.15.6:0/2266464084 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4120012c40 con 0x7f41340d1880 2023-11-29T04:18:34.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.325+0000 7f41317fa640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4118066470 0x7f4118068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:34.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.325+0000 7f41317fa640 1 -- 172.21.15.6:0/2266464084 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4120083ff0 con 0x7f41340d1880 2023-11-29T04:18:34.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.325+0000 7f4138b1c640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4118066470 0x7f4118068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:34.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.325+0000 7f41317fa640 1 -- 172.21.15.6:0/2266464084 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41200b5280 con 0x7f41340d1880 2023-11-29T04:18:34.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.329+0000 7f4138b1c640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4118066470 0x7f4118068930 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4128000f70 tx=0x7f4128007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:34.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.785+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41340674d0 con 0x7f4118066470 2023-11-29T04:18:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.789+0000 7f41317fa640 1 -- 172.21.15.6:0/2266464084 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49482 (secure 0 0 0) 0x7f41340674d0 con 0x7f4118066470 2023-11-29T04:18:34.794 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:18:34.795 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-29T04:18:34.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.793+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4118066470 msgr2=0x7f4118068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:34.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.793+0000 7f413ad80640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4118066470 0x7f4118068930 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4128000f70 tx=0x7f4128007240 comp rx=0 tx=0).stop 2023-11-29T04:18:34.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.793+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340d1880 msgr2=0x7f41340b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:34.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.793+0000 7f413ad80640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340d1880 0x7f41340b7a80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f412000d5f0 tx=0x7f412000dab0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.797+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 shutdown_connections 2023-11-29T04:18:34.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.797+0000 7f413ad80640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f4118066470 0x7f4118068930 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.797+0000 7f413ad80640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4134160cd0 0x7f41340b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.797+0000 7f413ad80640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41340d1880 0x7f41340b7a80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.797+0000 7f413ad80640 1 --2- 172.21.15.6:0/2266464084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41340b2550 0x7f413406bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:34.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.797+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 >> 172.21.15.6:0/2266464084 conn(0x7f413409c460 msgr2=0x7f413415fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:34.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.797+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 shutdown_connections 2023-11-29T04:18:34.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:34.797+0000 7f413ad80640 1 -- 172.21.15.6:0/2266464084 wait complete. 2023-11-29T04:18:34.850 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":12938,"stamp":"2023-11-29T04:18:34.636061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11021800,"kb_used_data":4456,"kb_used_omap":4861,"kb_used_meta":11012418,"kb_avail":743952920,"statfs":{"total":773094113280,"available":761807790080,"internally_reserved":0,"allocated":4562944,"data_stored":2505040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4978608,"internal_metadata":11276716112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002890"},"pg_stats":[{"pgid":"1.0","version":"34'161","reported_seq":446,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-29T04:18:05.452717+0000","last_change":"2023-11-28T21:07:58.509259+0000","last_active":"2023-11-29T04:18:05.452717+0000","last_peered":"2023-11-29T04:18:05.452717+0000","last_clean":"2023-11-29T04:18:05.452717+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-29T04:18:05.452717+0000","last_undegraded":"2023-11-29T04:18:05.452717+0000","last_fullsized":"2023-11-29T04:18:05.452717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T21:07:57.297939+0000","last_clean_scrub_stamp":"2023-11-28T21:07:57.297939+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:57:08.251595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514607,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1599208,"kb_used_data":992,"kb_used_omap":22,"kb_used_meta":1598185,"kb_avail":92772632,"statfs":{"total":96636764160,"available":94999175168,"internally_reserved":0,"allocated":1015808,"data_stored":755906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22957,"internal_metadata":1636542035},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.516,"15min":1.577},"min":{"1min":0.51900000000000002,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":14.651,"5min":14.651,"15min":14.651},"last":1.113},{"interface":"front","average":{"1min":2.395,"5min":1.9710000000000001,"15min":1.706},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.312},"max":{"1min":16.303000000000001,"5min":16.303000000000001,"15min":16.303000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":1.7529999999999999,"15min":1.6080000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":8.0619999999999994,"5min":8.0619999999999994,"15min":8.0619999999999994},"last":0.82499999999999996},{"interface":"front","average":{"1min":2.7589999999999999,"5min":1.9039999999999999,"15min":1.6599999999999999},"min":{"1min":0.62,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":16.123999999999999,"5min":16.123999999999999,"15min":16.123999999999999},"last":0.90200000000000002}]},{"osd":2,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":2.6880000000000002,"5min":2.2650000000000001,"15min":1.764},"min":{"1min":0.64800000000000002,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":19.091999999999999,"5min":47,"15min":47},"last":0.63100000000000001},{"interface":"front","average":{"1min":3.0049999999999999,"5min":1.8799999999999999,"15min":1.806},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":24.178000000000001,"5min":24.178000000000001,"15min":24.178000000000001},"last":0.77900000000000003}]},{"osd":3,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":2.2229999999999999,"15min":1.887},"min":{"1min":0.497,"5min":0.496,"15min":0.496},"max":{"1min":8.4649999999999999,"5min":46.820999999999998,"15min":46.820999999999998},"last":1.093},{"interface":"front","average":{"1min":2.472,"5min":1.9950000000000001,"15min":1.774},"min":{"1min":0.56499999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":9.1449999999999996,"5min":9.7899999999999991,"15min":9.7899999999999991},"last":0.86099999999999999}]},{"osd":4,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.22,"15min":0.83099999999999996},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":15.996,"5min":29.809000000000001,"15min":29.809000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.2589999999999999,"15min":0.84899999999999998},"min":{"1min":0.42499999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.2230000000000008,"5min":46.726999999999997,"15min":46.726999999999997},"last":0.57499999999999996}]},{"osd":5,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.018,"15min":0.77700000000000002},"min":{"1min":0.39200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":7.9889999999999999,"5min":16.276,"15min":16.276},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.3979999999999999,"15min":0.95299999999999996},"min":{"1min":0.42099999999999999,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":16.09,"5min":32.847000000000001,"15min":32.847000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":0.97499999999999998,"15min":0.84099999999999997},"min":{"1min":0.498,"5min":0.441,"15min":0.42899999999999999},"max":{"1min":16.170999999999999,"5min":16.170999999999999,"15min":16.170999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.234,"5min":1.3089999999999999,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.41299999999999998},"max":{"1min":10.278,"5min":46.865000000000002,"15min":46.865000000000002},"last":0.70999999999999996}]}]},{"osd":6,"up_from":15,"seq":64424514610,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1549412,"kb_used_data":412,"kb_used_omap":415,"kb_used_meta":1548576,"kb_avail":92822428,"statfs":{"total":96636764160,"available":95050166272,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":425474,"internal_metadata":1585742334},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.4019999999999999,"15min":1.3919999999999999},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":4.9569999999999999,"5min":8.9809999999999999,"15min":9.7270000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":1.7310000000000001,"5min":1.6619999999999999,"15min":1.5780000000000001},"min":{"1min":0.432,"5min":0.39700000000000002,"15min":0.33600000000000002},"max":{"1min":7.1079999999999997,"5min":13.32,"15min":13.32},"last":0.878}]},{"osd":1,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.78,"15min":1.6579999999999999},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.373},"max":{"1min":7.04,"5min":21.614999999999998,"15min":21.614999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.597,"5min":1.5820000000000001,"15min":1.8340000000000001},"min":{"1min":0.43099999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":7.218,"5min":12.239000000000001,"15min":12.603999999999999},"last":0.97499999999999998}]},{"osd":2,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":1.712,"15min":1.7110000000000001},"min":{"1min":0.50800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":6.8840000000000003,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.8839999999999999,"5min":1.851,"15min":1.621},"min":{"1min":0.66900000000000004,"5min":0.49299999999999999,"15min":0.48299999999999998},"max":{"1min":6.0659999999999998,"5min":7.5330000000000004,"15min":9.4369999999999994},"last":0.73399999999999999}]},{"osd":3,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.7010000000000001,"5min":1.72,"15min":1.7030000000000001},"min":{"1min":0.52900000000000003,"5min":0.52600000000000002,"15min":0.48799999999999999},"max":{"1min":4.0419999999999998,"5min":12.911,"15min":12.911},"last":0.99099999999999999},{"interface":"front","average":{"1min":2.1760000000000002,"5min":1.8160000000000001,"15min":1.8049999999999999},"min":{"1min":0.58899999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":6.9800000000000004,"5min":21.228999999999999,"15min":21.228999999999999},"last":0.85999999999999999}]},{"osd":4,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.71599999999999997,"15min":0.65100000000000002},"min":{"1min":0.42699999999999999,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":2.2810000000000001,"5min":8.9100000000000001,"15min":8.9100000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":1.631,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":0.51400000000000001}]},{"osd":5,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.85699999999999998,"15min":0.73499999999999999},"min":{"1min":0.40999999999999998,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":2.0129999999999999,"5min":16.655000000000001,"15min":16.655000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.85799999999999998,"15min":0.77200000000000002},"min":{"1min":0.48099999999999998,"5min":0.41799999999999998,"15min":0.38100000000000001},"max":{"1min":2.786,"5min":9.2260000000000009,"15min":9.2260000000000009},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Nov 29 04:17:34 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.81899999999999995,"15min":0.753},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":4.4400000000000004,"5min":7.4299999999999997,"15min":7.4299999999999997},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.90900000000000003,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.0590000000000002,"5min":16.710000000000001,"15min":16.710000000000001},"last":0.69899999999999995}]}]},{"osd":5,"up_from":15,"seq":64424514608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1533476,"kb_used_data":412,"kb_used_omap":130,"kb_used_meta":1532925,"kb_avail":92838364,"statfs":{"total":96636764160,"available":95066484736,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":133284,"internal_metadata":1569716060},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":2.8660000000000001,"5min":1.6899999999999999,"15min":1.4730000000000001},"min":{"1min":0.498,"5min":0.43099999999999999,"15min":0.309},"max":{"1min":19.132000000000001,"5min":19.132000000000001,"15min":19.132000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":2.3660000000000001,"5min":1.5469999999999999,"15min":1.472},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":8.8079999999999998,"5min":8.8079999999999998,"15min":8.8079999999999998},"last":0.97999999999999998}]},{"osd":1,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.3580000000000001,"15min":1.544},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":6.0599999999999996,"5min":7.5730000000000004,"15min":50.093000000000004},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.3740000000000001,"15min":1.768},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":6.9809999999999999,"5min":6.9809999999999999,"15min":49.384},"last":0.72599999999999998}]},{"osd":2,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":1.694,"15min":1.8720000000000001},"min":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.36699999999999999},"max":{"1min":13.563000000000001,"5min":13.563000000000001,"15min":50.744},"last":1.0589999999999999},{"interface":"front","average":{"1min":2.2789999999999999,"5min":1.7849999999999999,"15min":1.9399999999999999},"min":{"1min":0.64900000000000002,"5min":0.439,"15min":0.439},"max":{"1min":12.554,"5min":12.554,"15min":49.237000000000002},"last":1.0369999999999999}]},{"osd":3,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.6299999999999999,"15min":1.8520000000000001},"min":{"1min":0.55800000000000005,"5min":0.45000000000000001,"15min":0.41999999999999998},"max":{"1min":5.8129999999999997,"5min":6.4779999999999998,"15min":11.491},"last":1.093},{"interface":"front","average":{"1min":3.04,"5min":1.8720000000000001,"15min":1.734},"min":{"1min":0.63,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.49,"5min":12.49,"15min":12.49},"last":1}]},{"osd":4,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.70199999999999996,"15min":0.63},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.32800000000000001},"max":{"1min":5.0110000000000001,"5min":5.0110000000000001,"15min":5.0110000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.75900000000000001,"15min":0.69899999999999995},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.373},"max":{"1min":3.5150000000000001,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":1.026}]},{"osd":6,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.79900000000000004,"15min":0.72899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.34799999999999998},"max":{"1min":5.1989999999999998,"5min":6.3499999999999996,"15min":6.3499999999999996},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":0.82499999999999996,"15min":0.73899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41799999999999998},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":0.83999999999999997}]},{"osd":7,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.78100000000000003,"15min":0.77200000000000002},"min":{"1min":0.48899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":4.0069999999999997,"5min":4.0069999999999997,"15min":4.032},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.95399999999999996,"15min":0.82399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45000000000000001,"15min":0.41399999999999998},"max":{"1min":8.7210000000000001,"5min":8.7210000000000001,"15min":8.7210000000000001},"last":0.95699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424514609,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1626020,"kb_used_data":412,"kb_used_omap":1141,"kb_used_meta":1624458,"kb_avail":92745820,"statfs":{"total":96636764160,"available":94971719680,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1169084,"internal_metadata":1663445316},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":1.7609999999999999,"15min":1.6100000000000001},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.307},"max":{"1min":13.701000000000001,"5min":13.701000000000001,"15min":13.701000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":2.9460000000000002,"5min":2.1320000000000001,"15min":1.8759999999999999},"min":{"1min":0.56000000000000005,"5min":0.35699999999999998,"15min":0.34000000000000002},"max":{"1min":14.587999999999999,"5min":14.587999999999999,"15min":14.587999999999999},"last":0.93400000000000005}]},{"osd":1,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.542,"15min":1.8100000000000001},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.0190000000000001,"5min":26.338000000000001,"15min":26.338000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.9379999999999999,"5min":1.7769999999999999,"15min":1.802},"min":{"1min":0.58099999999999996,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.1859999999999999,"5min":25.989000000000001,"15min":25.989000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.0169999999999999,"5min":1.7230000000000001,"15min":1.671},"min":{"1min":0.435,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":5.4299999999999997,"5min":9.3420000000000005,"15min":9.6120000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.9590000000000001,"5min":1.825,"15min":1.7010000000000001},"min":{"1min":0.56000000000000005,"5min":0.45100000000000001,"15min":0.40500000000000003},"max":{"1min":5.5730000000000004,"5min":6.5049999999999999,"15min":12.461},"last":0.84499999999999997}]},{"osd":3,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.804,"15min":1.6579999999999999},"min":{"1min":0.69199999999999995,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":4.1109999999999998,"5min":8.4030000000000005,"15min":8.4030000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":2.1949999999999998,"5min":1.5549999999999999,"15min":1.804},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":6.9980000000000002,"5min":6.9980000000000002,"15min":12.52},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.73199999999999998,"15min":0.627},"min":{"1min":0.376,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":5.5810000000000004,"5min":5.5810000000000004,"15min":5.5810000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.68200000000000005,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.33200000000000002},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.802},"last":0.64000000000000001}]},{"osd":6,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":0.76900000000000002,"15min":0.70099999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":6.9980000000000002,"5min":6.9980000000000002,"15min":6.9980000000000002},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.077,"5min":0.81100000000000005,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.4710000000000001,"5min":4.7060000000000004,"15min":4.7060000000000004},"last":0.95199999999999996}]},{"osd":7,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":0.79300000000000004,"15min":0.72399999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.373},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.077},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.2729999999999999,"5min":0.87,"15min":0.78100000000000003},"min":{"1min":0.496,"5min":0.433,"15min":0.40799999999999997},"max":{"1min":5.4619999999999997,"5min":5.4619999999999997,"15min":5.4619999999999997},"last":0.73599999999999999}]}]},{"osd":2,"up_from":15,"seq":64424514573,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1183652,"kb_used_data":412,"kb_used_omap":339,"kb_used_meta":1182892,"kb_avail":93188188,"statfs":{"total":96636764160,"available":95424704512,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":347851,"internal_metadata":1211281717},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.3740000000000001,"5min":2.8940000000000001,"15min":2.8780000000000001},"min":{"1min":0.74099999999999999,"5min":0.45800000000000002,"15min":0.45500000000000002},"max":{"1min":4.7409999999999997,"5min":33.073,"15min":33.073},"last":1.139},{"interface":"front","average":{"1min":2.645,"5min":3.3969999999999998,"15min":3.1240000000000001},"min":{"1min":0.745,"5min":0.434,"15min":0.434},"max":{"1min":6.931,"5min":37.037999999999997,"15min":37.037999999999997},"last":0.81999999999999995}]},{"osd":1,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":3.0190000000000001,"15min":3.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.60999999999999999,"15min":0.41299999999999998},"max":{"1min":5.7110000000000003,"5min":12.577999999999999,"15min":17.945},"last":1.538},{"interface":"front","average":{"1min":2.9740000000000002,"5min":3.5499999999999998,"15min":3.2200000000000002},"min":{"1min":0.82899999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":7.7229999999999999,"5min":16.536000000000001,"15min":18.667000000000002},"last":1.3260000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":3.9329999999999998,"5min":2.8159999999999998,"15min":3.0289999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.40699999999999997},"max":{"1min":14.957000000000001,"5min":14.957000000000001,"15min":21.995000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":2.8100000000000001,"5min":2.7309999999999999,"15min":3.0550000000000002},"min":{"1min":0.65000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":6.6210000000000004,"5min":16.334,"15min":17.504999999999999},"last":1.6160000000000001}]},{"osd":4,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.1480000000000001,"5min":2.6059999999999999,"15min":2.4910000000000001},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":5.9139999999999997,"5min":11.319000000000001,"15min":18.219999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.605,"5min":2.2000000000000002,"15min":2.3559999999999999},"min":{"1min":0.65800000000000003,"5min":0.60799999999999998,"15min":0.51200000000000001},"max":{"1min":4.0629999999999997,"5min":10.489000000000001,"15min":19.183},"last":0.98199999999999998}]},{"osd":5,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":2.3450000000000002,"15min":2.5230000000000001},"min":{"1min":0.71999999999999997,"5min":0.624,"15min":0.433},"max":{"1min":4.2610000000000001,"5min":15.224,"15min":49.899000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":2.5219999999999998,"5min":2.7029999999999998,"15min":2.7770000000000001},"min":{"1min":0.67500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":6.0439999999999996,"5min":11.461,"15min":50.293999999999997},"last":1.5800000000000001}]},{"osd":6,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":2.3730000000000002,"15min":2.5630000000000002},"min":{"1min":0.77700000000000002,"5min":0.64400000000000002,"15min":0.56799999999999995},"max":{"1min":3.8530000000000002,"5min":10.648,"15min":20.477},"last":1.014},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.3540000000000001,"15min":2.5539999999999998},"min":{"1min":0.67900000000000005,"5min":0.65800000000000003,"15min":0.54500000000000004},"max":{"1min":4.4770000000000003,"5min":13.013999999999999,"15min":17.815999999999999},"last":1.397}]},{"osd":7,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.9590000000000001,"15min":2.802},"min":{"1min":0.88200000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":7.6349999999999998,"5min":11.571,"15min":18.341999999999999},"last":1.46},{"interface":"front","average":{"1min":1.8280000000000001,"5min":2.528,"15min":2.7029999999999998},"min":{"1min":0.71199999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.9630000000000001,"5min":10.747,"15min":21.225999999999999},"last":1.1160000000000001}]}]},{"osd":3,"up_from":14,"seq":60129547262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1038436,"kb_used_data":412,"kb_used_omap":1234,"kb_used_meta":1036781,"kb_avail":93333404,"statfs":{"total":96636764160,"available":95573405696,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1264471,"internal_metadata":1061663913},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":4.569,"5min":2.976,"15min":3.0339999999999998},"min":{"1min":0.81499999999999995,"5min":0.55200000000000005,"15min":0.42299999999999999},"max":{"1min":11.612,"5min":16.690000000000001,"15min":16.690000000000001},"last":1.002},{"interface":"front","average":{"1min":3.8969999999999998,"5min":2.7639999999999998,"15min":2.8620000000000001},"min":{"1min":0.76300000000000001,"5min":0.57399999999999995,"15min":0.32500000000000001},"max":{"1min":14.999000000000001,"5min":15.228,"15min":15.228},"last":1.216}]},{"osd":1,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":5.4340000000000002,"5min":3.661,"15min":3.4540000000000002},"min":{"1min":1.2589999999999999,"5min":0.66800000000000004,"15min":0.33200000000000002},"max":{"1min":15.805,"5min":45.505000000000003,"15min":45.505000000000003},"last":1.4219999999999999},{"interface":"front","average":{"1min":4.4770000000000003,"5min":3.3639999999999999,"15min":3.3639999999999999},"min":{"1min":0.93999999999999995,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":11.832000000000001,"5min":14.897,"15min":40.087000000000003},"last":1.3149999999999999}]},{"osd":2,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":3.5600000000000001,"5min":3.036,"15min":3.2989999999999999},"min":{"1min":0.85699999999999998,"5min":0.56499999999999995,"15min":0.38400000000000001},"max":{"1min":11.311999999999999,"5min":14.907999999999999,"15min":39.954000000000001},"last":1.081},{"interface":"front","average":{"1min":5.9029999999999996,"5min":3.7229999999999999,"15min":3.548},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":16.027000000000001,"5min":23.989000000000001,"15min":37.334000000000003},"last":1.893}]},{"osd":4,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":3.5670000000000002,"5min":2.6680000000000001,"15min":2.4729999999999999},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.47199999999999998},"max":{"1min":9.2870000000000008,"5min":30.600999999999999,"15min":30.600999999999999},"last":1.508},{"interface":"front","average":{"1min":2.988,"5min":2.367,"15min":2.4769999999999999},"min":{"1min":0.69299999999999995,"5min":0.60999999999999999,"15min":0.54500000000000004},"max":{"1min":10.445,"5min":10.445,"15min":11.602},"last":1.4890000000000001}]},{"osd":5,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":4.6970000000000001,"5min":3.012,"15min":2.6320000000000001},"min":{"1min":0.55100000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":15.917999999999999,"5min":40.125,"15min":40.125},"last":1.6120000000000001},{"interface":"front","average":{"1min":3.6150000000000002,"5min":2.8239999999999998,"15min":2.6779999999999999},"min":{"1min":0.56299999999999994,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":9.1069999999999993,"5min":34.496000000000002,"15min":34.496000000000002},"last":1.8300000000000001}]},{"osd":6,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":3.0510000000000002,"5min":2.4380000000000002,"15min":2.6099999999999999},"min":{"1min":0.77100000000000002,"5min":0.60899999999999999,"15min":0.60599999999999998},"max":{"1min":10.282,"5min":10.282,"15min":11.491},"last":1.5620000000000001},{"interface":"front","average":{"1min":4.8499999999999996,"5min":3.0030000000000001,"15min":2.7450000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":15.619,"5min":23.747,"15min":23.747},"last":1.7330000000000001}]},{"osd":7,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":3.677,"5min":2.9620000000000002,"15min":2.8370000000000002},"min":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":9.7029999999999994,"5min":38.837000000000003,"15min":38.837000000000003},"last":1.9730000000000001},{"interface":"front","average":{"1min":2.8319999999999999,"5min":2.625,"15min":2.7469999999999999},"min":{"1min":0.70099999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":10.292,"5min":10.292,"15min":11.699999999999999},"last":1.6699999999999999}]}]},{"osd":1,"up_from":14,"seq":60129547268,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1533540,"kb_used_data":412,"kb_used_omap":1246,"kb_used_meta":1531873,"kb_avail":92838300,"statfs":{"total":96636764160,"available":95066419200,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1275937,"internal_metadata":1568638943},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.9020000000000001,"5min":2.923,"15min":3.097},"min":{"1min":0.54900000000000004,"5min":0.442,"15min":0.30599999999999999},"max":{"1min":10.994,"5min":10.994,"15min":18.100000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":3.577,"5min":3.1349999999999998,"15min":2.9369999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":16.48,"5min":43.956000000000003,"15min":43.956000000000003},"last":1.0629999999999999}]},{"osd":2,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":3.2120000000000002,"5min":3.1339999999999999,"15min":3.0609999999999999},"min":{"1min":0.61599999999999999,"5min":0.53200000000000003,"15min":0.53100000000000003},"max":{"1min":7.0979999999999999,"5min":25.652000000000001,"15min":25.652000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":4.0439999999999996,"5min":3.472,"15min":3.1230000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.42599999999999999},"max":{"1min":24.094999999999999,"5min":43.795000000000002,"15min":43.795000000000002},"last":1.1359999999999999}]},{"osd":3,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":3.3149999999999999,"5min":2.7090000000000001,"15min":2.827},"min":{"1min":0.69299999999999995,"5min":0.56399999999999995,"15min":0.498},"max":{"1min":10.07,"5min":10.07,"15min":13.419},"last":1.01},{"interface":"front","average":{"1min":3.448,"5min":3.4900000000000002,"15min":3.5110000000000001},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":7.1150000000000002,"5min":11.618,"15min":18.062000000000001},"last":1.6899999999999999}]},{"osd":4,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.3860000000000001,"5min":2.4550000000000001,"15min":2.391},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":11.739000000000001,"5min":11.739000000000001,"15min":11.739000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":2.7959999999999998,"5min":2.238,"15min":2.3010000000000002},"min":{"1min":0.73799999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":1.464}]},{"osd":5,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.4820000000000002,"5min":2.8370000000000002,"15min":2.617},"min":{"1min":0.51100000000000001,"5min":0.46200000000000002,"15min":0.40500000000000003},"max":{"1min":5.3449999999999998,"5min":26.135000000000002,"15min":26.135000000000002},"last":1.7949999999999999},{"interface":"front","average":{"1min":2.1560000000000001,"5min":2.8530000000000002,"15min":2.6379999999999999},"min":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.60799999999999998},"max":{"1min":4.9969999999999999,"5min":44.347999999999999,"15min":44.347999999999999},"last":1.639}]},{"osd":6,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":2.4980000000000002,"15min":2.5529999999999999},"min":{"1min":0.81399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":8.0549999999999997,"5min":8.891,"15min":10.086},"last":1.7310000000000001},{"interface":"front","average":{"1min":2.6110000000000002,"5min":2.8889999999999998,"15min":2.8130000000000002},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.56799999999999995},"max":{"1min":5.5599999999999996,"5min":11.606,"15min":17.978999999999999},"last":1.8700000000000001}]},{"osd":7,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.9689999999999999,"5min":3.1930000000000001,"15min":2.8679999999999999},"min":{"1min":0.77500000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":8.2870000000000008,"5min":47.781999999999996,"15min":47.781999999999996},"last":1.8360000000000001},{"interface":"front","average":{"1min":2.8340000000000001,"5min":3.089,"15min":2.9649999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":5.4800000000000004,"5min":25.777000000000001,"15min":25.777000000000001},"last":1.9370000000000001}]}]},{"osd":0,"up_from":14,"seq":60129547287,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":958056,"kb_used_data":992,"kb_used_omap":331,"kb_used_meta":956724,"kb_avail":93413784,"statfs":{"total":96636764160,"available":95655714816,"internally_reserved":0,"allocated":1015808,"data_stored":755906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":339550,"internal_metadata":979685794},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":2.7690000000000001,"5min":2.552,"15min":2.907},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.29999999999999999},"max":{"1min":8.5039999999999996,"5min":12.653,"15min":12.755000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":4.1269999999999998,"5min":3.0640000000000001,"15min":2.8740000000000001},"min":{"1min":0.74299999999999999,"5min":0.52500000000000002,"15min":0.38300000000000001},"max":{"1min":15.050000000000001,"5min":15.050000000000001,"15min":15.050000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":3.6349999999999998,"5min":2.8119999999999998,"15min":2.8380000000000001},"min":{"1min":0.89800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.109999999999999,"5min":13.199999999999999,"15min":13.199999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":4.5439999999999996,"5min":3.4079999999999999,"15min":3.2789999999999999},"min":{"1min":0.64600000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":11.124000000000001,"5min":14.084,"15min":14.084},"last":1.208}]},{"osd":3,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":3.714,"5min":3.6789999999999998,"15min":3.6389999999999998},"min":{"1min":0.72599999999999998,"5min":0.59299999999999997,"15min":0.53000000000000003},"max":{"1min":11.388999999999999,"5min":33.881999999999998,"15min":33.881999999999998},"last":1.6910000000000001},{"interface":"front","average":{"1min":3.7320000000000002,"5min":3.528,"15min":3.5190000000000001},"min":{"1min":0.70299999999999996,"5min":0.47299999999999998,"15min":0.42399999999999999},"max":{"1min":12.307,"5min":35.034999999999997,"15min":35.034999999999997},"last":1.587}]},{"osd":4,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":2.5,"5min":2.411,"15min":2.5489999999999999},"min":{"1min":0.86899999999999999,"5min":0.64800000000000002,"15min":0.48399999999999999},"max":{"1min":9.0920000000000005,"5min":13.42,"15min":13.42},"last":1.1870000000000001},{"interface":"front","average":{"1min":3.274,"5min":2.4849999999999999,"15min":2.5350000000000001},"min":{"1min":0.78500000000000003,"5min":0.53500000000000003,"15min":0.52800000000000002},"max":{"1min":11.987,"5min":14.199,"15min":14.199},"last":1.4199999999999999}]},{"osd":5,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":2.625,"5min":2.585,"15min":2.7120000000000002},"min":{"1min":0.79600000000000004,"5min":0.64400000000000002,"15min":0.52500000000000002},"max":{"1min":9.1310000000000002,"5min":13.590999999999999,"15min":13.590999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":3.4470000000000001,"5min":2.6859999999999999,"15min":2.7080000000000002},"min":{"1min":0.73899999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":12.211,"5min":14.314,"15min":14.314},"last":1.736}]},{"osd":6,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":3.4359999999999999,"5min":2.6960000000000002,"15min":2.5760000000000001},"min":{"1min":0.73699999999999999,"5min":0.65400000000000003,"15min":0.58199999999999996},"max":{"1min":9.2400000000000002,"5min":11.808,"15min":11.808},"last":1.6200000000000001},{"interface":"front","average":{"1min":3.589,"5min":2.7690000000000001,"15min":2.8570000000000002},"min":{"1min":0.83799999999999997,"5min":0.69699999999999995,"15min":0.58899999999999997},"max":{"1min":11.276,"5min":12.901999999999999,"15min":12.901999999999999},"last":1.538}]},{"osd":7,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":3.5830000000000002,"5min":2.8140000000000001,"15min":2.7069999999999999},"min":{"1min":0.69199999999999995,"5min":0.61899999999999999,"15min":0.61699999999999999},"max":{"1min":9.5700000000000003,"5min":11.93,"15min":11.93},"last":1.5009999999999999},{"interface":"front","average":{"1min":4.1689999999999996,"5min":2.9359999999999999,"15min":3.004},"min":{"1min":1.107,"5min":0.67700000000000005,"15min":0.55400000000000005},"max":{"1min":27.364000000000001,"5min":27.364000000000001,"15min":27.364000000000001},"last":1.3600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T04:18:34.854 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T21:07:57.297939+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=21, tm_min=7, tm_sec=57, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=29, tm_hour=4, tm_min=18, tm_sec=21, tm_wday=2, tm_yday=333, tm_isdst=0) 2023-11-29T04:18:34.854 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-29T04:18:54.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T04:18:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.265+0000 7fe07ee09640 1 Processor -- start 2023-11-29T04:18:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.265+0000 7fe07ee09640 1 -- start start 2023-11-29T04:18:55.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe07ee09640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe07809a090 0x7fe0780cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe07ee09640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe07ee09640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0780cf500 con 0x7fe07815b3c0 2023-11-29T04:18:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe07ee09640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07809a760 con 0x7fe07809a090 2023-11-29T04:18:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe07ee09640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780cf750 con 0x7fe07806fe20 2023-11-29T04:18:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe077fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe07809a090 0x7fe0780cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe077fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe07809a090 0x7fe0780cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:46884/0 (socket says 172.21.15.6:46884) 2023-11-29T04:18:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe077fff640 1 -- 172.21.15.6:0/1071825581 learned_addr learned my addr 172.21.15.6:0/1071825581 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe07cba5640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe07815b3c0 0x7fe078099980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:48068/0 (socket says 172.21.15.6:48068) 2023-11-29T04:18:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe07d3a6640 1 --2- 172.21.15.6:0/1071825581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe077fff640 1 -- 172.21.15.6:0/1071825581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 msgr2=0x7fe0780cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe077fff640 1 --2- 172.21.15.6:0/1071825581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe077fff640 1 -- 172.21.15.6:0/1071825581 >> v1:172.21.15.31:6789/0 conn(0x7fe07815b3c0 legacy=0x7fe078099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.269+0000 7fe077fff640 1 -- 172.21.15.6:0/1071825581 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780cfa30 con 0x7fe07809a090 2023-11-29T04:18:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.273+0000 7fe077fff640 1 --2- 172.21.15.6:0/1071825581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07809a090 0x7fe0780cba30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe064009870 tx=0x7fe06401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b7678d21027447 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.273+0000 7fe0777fe640 1 -- 172.21.15.6:0/1071825581 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640aa670 con 0x7fe07809a090 2023-11-29T04:18:55.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.273+0000 7fe0777fe640 1 -- 172.21.15.6:0/1071825581 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0640aa7d0 con 0x7fe07809a090 2023-11-29T04:18:55.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.273+0000 7fe0777fe640 1 -- 172.21.15.6:0/1071825581 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640aab60 con 0x7fe07809a090 2023-11-29T04:18:55.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.277+0000 7fe07ee09640 1 -- 172.21.15.6:0/1071825581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07809a090 msgr2=0x7fe0780cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:55.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.277+0000 7fe07ee09640 1 --2- 172.21.15.6:0/1071825581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07809a090 0x7fe0780cba30 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe064009870 tx=0x7fe06401c510 comp rx=0 tx=0).stop 2023-11-29T04:18:55.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.277+0000 7fe07ee09640 1 -- 172.21.15.6:0/1071825581 shutdown_connections 2023-11-29T04:18:55.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.277+0000 7fe07ee09640 1 --2- 172.21.15.6:0/1071825581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.277+0000 7fe07ee09640 1 --2- 172.21.15.6:0/1071825581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07809a090 0x7fe0780cba30 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.277+0000 7fe07ee09640 1 -- 172.21.15.6:0/1071825581 >> 172.21.15.6:0/1071825581 conn(0x7fe0780b2a10 msgr2=0x7fe0780b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:55.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.277+0000 7fe07ee09640 1 -- 172.21.15.6:0/1071825581 shutdown_connections 2023-11-29T04:18:55.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.277+0000 7fe07ee09640 1 -- 172.21.15.6:0/1071825581 wait complete. 2023-11-29T04:18:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.281+0000 7fe07ee09640 1 Processor -- start 2023-11-29T04:18:55.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.281+0000 7fe07ee09640 1 -- start start 2023-11-29T04:18:55.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07ee09640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07ee09640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07809a090 0x7fe078153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07ee09640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07815b3c0 0x7fe0780c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07ee09640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780af9a0 con 0x7fe07809a090 2023-11-29T04:18:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07ee09640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780afe70 con 0x7fe07815b3c0 2023-11-29T04:18:55.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07ee09640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0781534c0 con 0x7fe07806fe20 2023-11-29T04:18:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07cba5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07d3a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07815b3c0 0x7fe0780c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe077fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07809a090 0x7fe078153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07cba5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:36966/0 (socket says 172.21.15.6:36966) 2023-11-29T04:18:55.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07d3a6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07815b3c0 0x7fe0780c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:46898/0 (socket says 172.21.15.6:46898) 2023-11-29T04:18:55.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07cba5640 1 -- 172.21.15.6:0/3112543124 learned_addr learned my addr 172.21.15.6:0/3112543124 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:55.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07cba5640 1 -- 172.21.15.6:0/3112543124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07815b3c0 msgr2=0x7fe0780c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:55.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07cba5640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07815b3c0 0x7fe0780c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07cba5640 1 -- 172.21.15.6:0/3112543124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07809a090 msgr2=0x7fe078153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07cba5640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07809a090 0x7fe078153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07cba5640 1 -- 172.21.15.6:0/3112543124 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640094d0 con 0x7fe07806fe20 2023-11-29T04:18:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07d3a6640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07815b3c0 0x7fe0780c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T04:18:55.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.285+0000 7fe07cba5640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780af460 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c430 tx=0x7fe06c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.289+0000 7fe0757fa640 1 -- 172.21.15.6:0/3112543124 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0074e0 con 0x7fe07806fe20 2023-11-29T04:18:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.289+0000 7fe0757fa640 1 -- 172.21.15.6:0/3112543124 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c007640 con 0x7fe07806fe20 2023-11-29T04:18:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.289+0000 7fe0757fa640 1 -- 172.21.15.6:0/3112543124 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c004a10 con 0x7fe07806fe20 2023-11-29T04:18:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.289+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0780b69f0 con 0x7fe07806fe20 2023-11-29T04:18:55.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.289+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0780b6cd0 con 0x7fe07806fe20 2023-11-29T04:18:55.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.289+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0780674d0 con 0x7fe07806fe20 2023-11-29T04:18:55.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.293+0000 7fe0757fa640 1 -- 172.21.15.6:0/3112543124 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe06c004b70 con 0x7fe07806fe20 2023-11-29T04:18:55.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.293+0000 7fe0757fa640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05c066470 0x7fe05c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:55.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.293+0000 7fe0757fa640 1 -- 172.21.15.6:0/3112543124 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe06c083440 con 0x7fe07806fe20 2023-11-29T04:18:55.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.293+0000 7fe077fff640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05c066470 0x7fe05c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:55.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.297+0000 7fe077fff640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05c066470 0x7fe05c068930 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe0640ae000 tx=0x7fe0640b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:55.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.345+0000 7fe0757fa640 1 -- 172.21.15.6:0/3112543124 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe06c050c70 con 0x7fe07806fe20 2023-11-29T04:18:55.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.809+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 --> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe078068740 con 0x7fe05c066470 2023-11-29T04:18:55.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.813+0000 7fe0757fa640 1 -- 172.21.15.6:0/3112543124 <== mgr.4107 v2:172.21.15.6:6832/873281008 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49454 (secure 0 0 0) 0x7fe078068740 con 0x7fe05c066470 2023-11-29T04:18:55.816 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:18:55.816 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-11-29T04:18:55.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05c066470 msgr2=0x7fe05c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:55.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05c066470 0x7fe05c068930 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe0640ae000 tx=0x7fe0640b5040 comp rx=0 tx=0).stop 2023-11-29T04:18:55.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 msgr2=0x7fe0780af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:55.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780af460 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c430 tx=0x7fe06c00c8f0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 shutdown_connections 2023-11-29T04:18:55.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7fe05c066470 0x7fe05c068930 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07815b3c0 0x7fe0780c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07809a090 0x7fe078153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 --2- 172.21.15.6:0/3112543124 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe07806fe20 0x7fe0780af460 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:55.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 >> 172.21.15.6:0/3112543124 conn(0x7fe0780b2a10 msgr2=0x7fe0780cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:55.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 shutdown_connections 2023-11-29T04:18:55.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:55.817+0000 7fe07ee09640 1 -- 172.21.15.6:0/3112543124 wait complete. 2023-11-29T04:18:55.871 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":12948,"stamp":"2023-11-29T04:18:54.640273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11021800,"kb_used_data":4456,"kb_used_omap":4861,"kb_used_meta":11012418,"kb_avail":743952920,"statfs":{"total":773094113280,"available":761807790080,"internally_reserved":0,"allocated":4562944,"data_stored":2505040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4978608,"internal_metadata":11276716112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002576"},"pg_stats":[{"pgid":"1.0","version":"37'163","reported_seq":457,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-29T04:18:41.435614+0000","last_change":"2023-11-29T04:18:41.435667+0000","last_active":"2023-11-29T04:18:41.435614+0000","last_peered":"2023-11-29T04:18:41.435614+0000","last_clean":"2023-11-29T04:18:41.435614+0000","last_became_active":"2023-11-28T21:07:58.507836+0000","last_became_peered":"2023-11-28T21:07:58.507836+0000","last_unstale":"2023-11-29T04:18:41.435614+0000","last_undegraded":"2023-11-29T04:18:41.435614+0000","last_fullsized":"2023-11-29T04:18:41.435614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'163","last_scrub_stamp":"2023-11-29T04:18:41.435042+0000","last_deep_scrub":"37'163","last_deep_scrub_stamp":"2023-11-29T04:18:41.435042+0000","last_clean_scrub_stamp":"2023-11-29T04:18:41.435042+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T12:10:49.654405+0000","scrub_duration":1.3876206980000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514611,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1599208,"kb_used_data":992,"kb_used_omap":22,"kb_used_meta":1598185,"kb_avail":92772632,"statfs":{"total":96636764160,"available":94999175168,"internally_reserved":0,"allocated":1015808,"data_stored":755906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22957,"internal_metadata":1636542035},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.516,"15min":1.577},"min":{"1min":0.51900000000000002,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":14.651,"5min":14.651,"15min":14.651},"last":0.96099999999999997},{"interface":"front","average":{"1min":2.395,"5min":1.9710000000000001,"15min":1.706},"min":{"1min":0.39600000000000002,"5min":0.36399999999999999,"15min":0.312},"max":{"1min":16.303000000000001,"5min":16.303000000000001,"15min":16.303000000000001},"last":1.0389999999999999}]},{"osd":1,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":1.7529999999999999,"15min":1.6080000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":8.0619999999999994,"5min":8.0619999999999994,"15min":8.0619999999999994},"last":1.1140000000000001},{"interface":"front","average":{"1min":2.7589999999999999,"5min":1.9039999999999999,"15min":1.6599999999999999},"min":{"1min":0.62,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":16.123999999999999,"5min":16.123999999999999,"15min":16.123999999999999},"last":1.127}]},{"osd":2,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":2.6880000000000002,"5min":2.2650000000000001,"15min":1.764},"min":{"1min":0.64800000000000002,"5min":0.432,"15min":0.40500000000000003},"max":{"1min":19.091999999999999,"5min":47,"15min":47},"last":1.1419999999999999},{"interface":"front","average":{"1min":3.0049999999999999,"5min":1.8799999999999999,"15min":1.806},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":24.178000000000001,"5min":24.178000000000001,"15min":24.178000000000001},"last":1.0620000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.897,"5min":2.2229999999999999,"15min":1.887},"min":{"1min":0.497,"5min":0.496,"15min":0.496},"max":{"1min":8.4649999999999999,"5min":46.820999999999998,"15min":46.820999999999998},"last":1.0940000000000001},{"interface":"front","average":{"1min":2.472,"5min":1.9950000000000001,"15min":1.774},"min":{"1min":0.56499999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":9.1449999999999996,"5min":9.7899999999999991,"15min":9.7899999999999991},"last":0.88700000000000001}]},{"osd":4,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.22,"15min":0.83099999999999996},"min":{"1min":0.373,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":15.996,"5min":29.809000000000001,"15min":29.809000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.2589999999999999,"15min":0.84899999999999998},"min":{"1min":0.42499999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.2230000000000008,"5min":46.726999999999997,"15min":46.726999999999997},"last":0.90900000000000003}]},{"osd":5,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.018,"15min":0.77700000000000002},"min":{"1min":0.39200000000000002,"5min":0.376,"15min":0.376},"max":{"1min":7.9889999999999999,"5min":16.276,"15min":16.276},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.3979999999999999,"15min":0.95299999999999996},"min":{"1min":0.42099999999999999,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":16.09,"5min":32.847000000000001,"15min":32.847000000000001},"last":0.93600000000000005}]},{"osd":6,"last update":"Wed Nov 29 04:18:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5680000000000001,"5min":0.97499999999999998,"15min":0.84099999999999997},"min":{"1min":0.498,"5min":0.441,"15min":0.42899999999999999},"max":{"1min":16.170999999999999,"5min":16.170999999999999,"15min":16.170999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.234,"5min":1.3089999999999999,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.41299999999999998},"max":{"1min":10.278,"5min":46.865000000000002,"15min":46.865000000000002},"last":1.0129999999999999}]}]},{"osd":6,"up_from":15,"seq":64424514614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1549412,"kb_used_data":412,"kb_used_omap":415,"kb_used_meta":1548576,"kb_avail":92822428,"statfs":{"total":96636764160,"available":95050166272,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":425474,"internal_metadata":1585742334},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:35 2023","interfaces":[{"interface":"back","average":{"1min":2.7770000000000001,"5min":1.6599999999999999,"15min":1.454},"min":{"1min":0.42599999999999999,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":12.801,"5min":12.801,"15min":12.801},"last":1.0069999999999999},{"interface":"front","average":{"1min":2.5009999999999999,"5min":1.736,"15min":1.6180000000000001},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.33600000000000002},"max":{"1min":12.198,"5min":12.198,"15min":13.32},"last":0.80000000000000004}]},{"osd":1,"last update":"Wed Nov 29 04:18:35 2023","interfaces":[{"interface":"back","average":{"1min":2.7429999999999999,"5min":2.0270000000000001,"15min":1.748},"min":{"1min":0.69899999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":12.563000000000001,"5min":21.614999999999998,"15min":21.614999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":2.1560000000000001,"5min":1.7110000000000001,"15min":1.847},"min":{"1min":0.65600000000000003,"5min":0.42799999999999999,"15min":0.36899999999999999},"max":{"1min":12.901,"5min":12.901,"15min":12.901},"last":0.81799999999999995}]},{"osd":2,"last update":"Wed Nov 29 04:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.6850000000000001,"15min":1.7110000000000001},"min":{"1min":0.57199999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.8179999999999996,"5min":9.0670000000000002,"15min":9.0670000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":2.331,"5min":1.956,"15min":1.6379999999999999},"min":{"1min":0.73399999999999999,"5min":0.52500000000000002,"15min":0.48299999999999998},"max":{"1min":8.7989999999999995,"5min":8.7989999999999995,"15min":9.4369999999999994},"last":0.98099999999999998}]},{"osd":3,"last update":"Wed Nov 29 04:18:35 2023","interfaces":[{"interface":"back","average":{"1min":2.7810000000000001,"5min":1.986,"15min":1.744},"min":{"1min":0.58999999999999997,"5min":0.52600000000000002,"15min":0.48999999999999999},"max":{"1min":10.151999999999999,"5min":12.911,"15min":12.911},"last":0.85099999999999998},{"interface":"front","average":{"1min":2.7469999999999999,"5min":2.081,"15min":1.849},"min":{"1min":0.59599999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":18.376000000000001,"5min":21.228999999999999,"15min":21.228999999999999},"last":0.73999999999999999}]},{"osd":4,"last update":"Wed Nov 29 04:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.76900000000000002,"15min":0.67500000000000004},"min":{"1min":0.46899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.4889999999999999,"5min":8.9100000000000001,"15min":8.9100000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":0.80900000000000005,"15min":0.70999999999999996},"min":{"1min":0.51400000000000001,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":4.4690000000000003,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":0.54000000000000004}]},{"osd":5,"last update":"Wed Nov 29 04:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91700000000000004,"15min":0.752},"min":{"1min":0.46700000000000003,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":2.1779999999999999,"5min":16.655000000000001,"15min":16.655000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.085,"5min":0.92300000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.42299999999999999,"15min":0.38100000000000001},"max":{"1min":3.5409999999999999,"5min":9.2260000000000009,"15min":9.2260000000000009},"last":0.621}]},{"osd":7,"last update":"Wed Nov 29 04:18:35 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.89500000000000002,"15min":0.77900000000000003},"min":{"1min":0.52200000000000002,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":4.5149999999999997,"5min":7.4299999999999997,"15min":7.4299999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.96999999999999997,"15min":0.82199999999999995},"min":{"1min":0.53000000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.7160000000000002,"5min":16.710000000000001,"15min":16.710000000000001},"last":0.59899999999999998}]}]},{"osd":5,"up_from":15,"seq":64424514612,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1533476,"kb_used_data":412,"kb_used_omap":130,"kb_used_meta":1532925,"kb_avail":92838364,"statfs":{"total":96636764160,"available":95066484736,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":133284,"internal_metadata":1569716060},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":2.8660000000000001,"5min":1.6899999999999999,"15min":1.4730000000000001},"min":{"1min":0.498,"5min":0.43099999999999999,"15min":0.309},"max":{"1min":19.132000000000001,"5min":19.132000000000001,"15min":19.132000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":2.3660000000000001,"5min":1.5469999999999999,"15min":1.472},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":8.8079999999999998,"5min":8.8079999999999998,"15min":8.8079999999999998},"last":0.78500000000000003}]},{"osd":1,"last update":"Wed Nov 29 04:17:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.3580000000000001,"15min":1.544},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35299999999999998},"max":{"1min":6.0599999999999996,"5min":7.5730000000000004,"15min":50.093000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.3740000000000001,"15min":1.768},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":6.9809999999999999,"5min":6.9809999999999999,"15min":49.384},"last":0.65300000000000002}]},{"osd":2,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":1.694,"15min":1.8720000000000001},"min":{"1min":0.47799999999999998,"5min":0.45800000000000002,"15min":0.36699999999999999},"max":{"1min":13.563000000000001,"5min":13.563000000000001,"15min":50.744},"last":0.92600000000000005},{"interface":"front","average":{"1min":2.2789999999999999,"5min":1.7849999999999999,"15min":1.9399999999999999},"min":{"1min":0.64900000000000002,"5min":0.439,"15min":0.439},"max":{"1min":12.554,"5min":12.554,"15min":49.237000000000002},"last":0.71999999999999997}]},{"osd":3,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.6299999999999999,"15min":1.8520000000000001},"min":{"1min":0.55800000000000005,"5min":0.45000000000000001,"15min":0.41999999999999998},"max":{"1min":5.8129999999999997,"5min":6.4779999999999998,"15min":11.491},"last":0.86499999999999999},{"interface":"front","average":{"1min":3.04,"5min":1.8720000000000001,"15min":1.734},"min":{"1min":0.63,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.49,"5min":12.49,"15min":12.49},"last":0.85099999999999998}]},{"osd":4,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.70199999999999996,"15min":0.63},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.32800000000000001},"max":{"1min":5.0110000000000001,"5min":5.0110000000000001,"15min":5.0110000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.75900000000000001,"15min":0.69899999999999995},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.373},"max":{"1min":3.5150000000000001,"5min":4.4850000000000003,"15min":4.4850000000000003},"last":0.57999999999999996}]},{"osd":6,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.79900000000000004,"15min":0.72899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.34799999999999998},"max":{"1min":5.1989999999999998,"5min":6.3499999999999996,"15min":6.3499999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":0.82499999999999996,"15min":0.73899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.41799999999999998},"max":{"1min":5.242,"5min":5.242,"15min":5.242},"last":0.61699999999999999}]},{"osd":7,"last update":"Wed Nov 29 04:18:28 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.78100000000000003,"15min":0.77200000000000002},"min":{"1min":0.48899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":4.0069999999999997,"5min":4.0069999999999997,"15min":4.032},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.95399999999999996,"15min":0.82399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45000000000000001,"15min":0.41399999999999998},"max":{"1min":8.7210000000000001,"5min":8.7210000000000001,"15min":8.7210000000000001},"last":0.63400000000000001}]}]},{"osd":4,"up_from":15,"seq":64424514613,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1626020,"kb_used_data":412,"kb_used_omap":1141,"kb_used_meta":1624458,"kb_avail":92745820,"statfs":{"total":96636764160,"available":94971719680,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1169084,"internal_metadata":1663445316},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":1.7609999999999999,"15min":1.6100000000000001},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.307},"max":{"1min":13.701000000000001,"5min":13.701000000000001,"15min":13.701000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":2.9460000000000002,"5min":2.1320000000000001,"15min":1.8759999999999999},"min":{"1min":0.56000000000000005,"5min":0.35699999999999998,"15min":0.34000000000000002},"max":{"1min":14.587999999999999,"5min":14.587999999999999,"15min":14.587999999999999},"last":0.97099999999999997}]},{"osd":1,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.542,"15min":1.8100000000000001},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.0190000000000001,"5min":26.338000000000001,"15min":26.338000000000001},"last":0.879},{"interface":"front","average":{"1min":1.9379999999999999,"5min":1.7769999999999999,"15min":1.802},"min":{"1min":0.58099999999999996,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.1859999999999999,"5min":25.989000000000001,"15min":25.989000000000001},"last":1.0880000000000001}]},{"osd":2,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.0169999999999999,"5min":1.7230000000000001,"15min":1.671},"min":{"1min":0.435,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":5.4299999999999997,"5min":9.3420000000000005,"15min":9.6120000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.9590000000000001,"5min":1.825,"15min":1.7010000000000001},"min":{"1min":0.56000000000000005,"5min":0.45100000000000001,"15min":0.40500000000000003},"max":{"1min":5.5730000000000004,"5min":6.5049999999999999,"15min":12.461},"last":1.2170000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.804,"15min":1.6579999999999999},"min":{"1min":0.69199999999999995,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":4.1109999999999998,"5min":8.4030000000000005,"15min":8.4030000000000005},"last":1.1990000000000001},{"interface":"front","average":{"1min":2.1949999999999998,"5min":1.5549999999999999,"15min":1.804},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":6.9980000000000002,"5min":6.9980000000000002,"15min":12.52},"last":0.94099999999999995}]},{"osd":5,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.73199999999999998,"15min":0.627},"min":{"1min":0.376,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":5.5810000000000004,"5min":5.5810000000000004,"15min":5.5810000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.68200000000000005,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.33200000000000002},"max":{"1min":3.2559999999999998,"5min":3.2559999999999998,"15min":3.802},"last":0.751}]},{"osd":6,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":0.76900000000000002,"15min":0.70099999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":6.9980000000000002,"5min":6.9980000000000002,"15min":6.9980000000000002},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.077,"5min":0.81100000000000005,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.4710000000000001,"5min":4.7060000000000004,"15min":4.7060000000000004},"last":0.72699999999999998}]},{"osd":7,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":0.79300000000000004,"15min":0.72399999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.373},"max":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.077},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.2729999999999999,"5min":0.87,"15min":0.78100000000000003},"min":{"1min":0.496,"5min":0.433,"15min":0.40799999999999997},"max":{"1min":5.4619999999999997,"5min":5.4619999999999997,"15min":5.4619999999999997},"last":0.78100000000000003}]}]},{"osd":2,"up_from":15,"seq":64424514577,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1183652,"kb_used_data":412,"kb_used_omap":339,"kb_used_meta":1182892,"kb_avail":93188188,"statfs":{"total":96636764160,"available":95424704512,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":347851,"internal_metadata":1211281717},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.3740000000000001,"5min":2.8940000000000001,"15min":2.8780000000000001},"min":{"1min":0.74099999999999999,"5min":0.45800000000000002,"15min":0.45500000000000002},"max":{"1min":4.7409999999999997,"5min":33.073,"15min":33.073},"last":1.0189999999999999},{"interface":"front","average":{"1min":2.645,"5min":3.3969999999999998,"15min":3.1240000000000001},"min":{"1min":0.745,"5min":0.434,"15min":0.434},"max":{"1min":6.931,"5min":37.037999999999997,"15min":37.037999999999997},"last":0.96499999999999997}]},{"osd":1,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.6800000000000002,"5min":3.0190000000000001,"15min":3.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.60999999999999999,"15min":0.41299999999999998},"max":{"1min":5.7110000000000003,"5min":12.577999999999999,"15min":17.945},"last":1.5149999999999999},{"interface":"front","average":{"1min":2.9740000000000002,"5min":3.5499999999999998,"15min":3.2200000000000002},"min":{"1min":0.82899999999999996,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":7.7229999999999999,"5min":16.536000000000001,"15min":18.667000000000002},"last":1.145}]},{"osd":3,"last update":"Wed Nov 29 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":3.9329999999999998,"5min":2.8159999999999998,"15min":3.0289999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.40699999999999997},"max":{"1min":14.957000000000001,"5min":14.957000000000001,"15min":21.995000000000001},"last":1.175},{"interface":"front","average":{"1min":2.8100000000000001,"5min":2.7309999999999999,"15min":3.0550000000000002},"min":{"1min":0.65000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":6.6210000000000004,"5min":16.334,"15min":17.504999999999999},"last":1.591}]},{"osd":4,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.1480000000000001,"5min":2.6059999999999999,"15min":2.4910000000000001},"min":{"1min":0.502,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":5.9139999999999997,"5min":11.319000000000001,"15min":18.219999999999999},"last":1.417},{"interface":"front","average":{"1min":1.605,"5min":2.2000000000000002,"15min":2.3559999999999999},"min":{"1min":0.65800000000000003,"5min":0.60799999999999998,"15min":0.51200000000000001},"max":{"1min":4.0629999999999997,"5min":10.489000000000001,"15min":19.183},"last":1.393}]},{"osd":5,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.0430000000000001,"5min":2.3450000000000002,"15min":2.5230000000000001},"min":{"1min":0.71999999999999997,"5min":0.624,"15min":0.433},"max":{"1min":4.2610000000000001,"5min":15.224,"15min":49.899000000000001},"last":1.661},{"interface":"front","average":{"1min":2.5219999999999998,"5min":2.7029999999999998,"15min":2.7770000000000001},"min":{"1min":0.67500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":6.0439999999999996,"5min":11.461,"15min":50.293999999999997},"last":1.3640000000000001}]},{"osd":6,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":2.3730000000000002,"15min":2.5630000000000002},"min":{"1min":0.77700000000000002,"5min":0.64400000000000002,"15min":0.56799999999999995},"max":{"1min":3.8530000000000002,"5min":10.648,"15min":20.477},"last":1.48},{"interface":"front","average":{"1min":2.2120000000000002,"5min":2.3540000000000001,"15min":2.5539999999999998},"min":{"1min":0.67900000000000005,"5min":0.65800000000000003,"15min":0.54500000000000004},"max":{"1min":4.4770000000000003,"5min":13.013999999999999,"15min":17.815999999999999},"last":1.724}]},{"osd":7,"last update":"Wed Nov 29 04:17:58 2023","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.9590000000000001,"15min":2.802},"min":{"1min":0.88200000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":7.6349999999999998,"5min":11.571,"15min":18.341999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.8280000000000001,"5min":2.528,"15min":2.7029999999999998},"min":{"1min":0.71199999999999997,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":3.9630000000000001,"5min":10.747,"15min":21.225999999999999},"last":1.546}]}]},{"osd":3,"up_from":14,"seq":60129547266,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1038436,"kb_used_data":412,"kb_used_omap":1234,"kb_used_meta":1036781,"kb_avail":93333404,"statfs":{"total":96636764160,"available":95573405696,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1264471,"internal_metadata":1061663913},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":4.569,"5min":2.976,"15min":3.0339999999999998},"min":{"1min":0.81499999999999995,"5min":0.55200000000000005,"15min":0.42299999999999999},"max":{"1min":11.612,"5min":16.690000000000001,"15min":16.690000000000001},"last":1.738},{"interface":"front","average":{"1min":3.8969999999999998,"5min":2.7639999999999998,"15min":2.8620000000000001},"min":{"1min":0.76300000000000001,"5min":0.57399999999999995,"15min":0.32500000000000001},"max":{"1min":14.999000000000001,"5min":15.228,"15min":15.228},"last":0.97699999999999998}]},{"osd":1,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":5.4340000000000002,"5min":3.661,"15min":3.4540000000000002},"min":{"1min":1.2589999999999999,"5min":0.66800000000000004,"15min":0.33200000000000002},"max":{"1min":15.805,"5min":45.505000000000003,"15min":45.505000000000003},"last":1.1200000000000001},{"interface":"front","average":{"1min":4.4770000000000003,"5min":3.3639999999999999,"15min":3.3639999999999999},"min":{"1min":0.93999999999999995,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":11.832000000000001,"5min":14.897,"15min":40.087000000000003},"last":1.0309999999999999}]},{"osd":2,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":3.5600000000000001,"5min":3.036,"15min":3.2989999999999999},"min":{"1min":0.85699999999999998,"5min":0.56499999999999995,"15min":0.38400000000000001},"max":{"1min":11.311999999999999,"5min":14.907999999999999,"15min":39.954000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":5.9029999999999996,"5min":3.7229999999999999,"15min":3.548},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":16.027000000000001,"5min":23.989000000000001,"15min":37.334000000000003},"last":1.3500000000000001}]},{"osd":4,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":3.5670000000000002,"5min":2.6680000000000001,"15min":2.4729999999999999},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.47199999999999998},"max":{"1min":9.2870000000000008,"5min":30.600999999999999,"15min":30.600999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":2.988,"5min":2.367,"15min":2.4769999999999999},"min":{"1min":0.69299999999999995,"5min":0.60999999999999999,"15min":0.54500000000000004},"max":{"1min":10.445,"5min":10.445,"15min":11.602},"last":1.3049999999999999}]},{"osd":5,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":4.6970000000000001,"5min":3.012,"15min":2.6320000000000001},"min":{"1min":0.55100000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":15.917999999999999,"5min":40.125,"15min":40.125},"last":1.6080000000000001},{"interface":"front","average":{"1min":3.6150000000000002,"5min":2.8239999999999998,"15min":2.6779999999999999},"min":{"1min":0.56299999999999994,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":9.1069999999999993,"5min":34.496000000000002,"15min":34.496000000000002},"last":1.4530000000000001}]},{"osd":6,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":3.0510000000000002,"5min":2.4380000000000002,"15min":2.6099999999999999},"min":{"1min":0.77100000000000002,"5min":0.60899999999999999,"15min":0.60599999999999998},"max":{"1min":10.282,"5min":10.282,"15min":11.491},"last":1.585},{"interface":"front","average":{"1min":4.8499999999999996,"5min":3.0030000000000001,"15min":2.7450000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.58799999999999997},"max":{"1min":15.619,"5min":23.747,"15min":23.747},"last":1.833}]},{"osd":7,"last update":"Wed Nov 29 04:18:24 2023","interfaces":[{"interface":"back","average":{"1min":3.677,"5min":2.9620000000000002,"15min":2.8370000000000002},"min":{"1min":0.61099999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":9.7029999999999994,"5min":38.837000000000003,"15min":38.837000000000003},"last":1.524},{"interface":"front","average":{"1min":2.8319999999999999,"5min":2.625,"15min":2.7469999999999999},"min":{"1min":0.70099999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":10.292,"5min":10.292,"15min":11.699999999999999},"last":1.651}]}]},{"osd":1,"up_from":14,"seq":60129547272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1533540,"kb_used_data":412,"kb_used_omap":1246,"kb_used_meta":1531873,"kb_avail":92838300,"statfs":{"total":96636764160,"available":95066419200,"internally_reserved":0,"allocated":421888,"data_stored":165538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1275937,"internal_metadata":1568638943},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.9020000000000001,"5min":2.923,"15min":3.097},"min":{"1min":0.54900000000000004,"5min":0.442,"15min":0.30599999999999999},"max":{"1min":10.994,"5min":10.994,"15min":18.100000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":3.577,"5min":3.1349999999999998,"15min":2.9369999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":16.48,"5min":43.956000000000003,"15min":43.956000000000003},"last":0.72599999999999998}]},{"osd":2,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":3.2120000000000002,"5min":3.1339999999999999,"15min":3.0609999999999999},"min":{"1min":0.61599999999999999,"5min":0.53200000000000003,"15min":0.53100000000000003},"max":{"1min":7.0979999999999999,"5min":25.652000000000001,"15min":25.652000000000001},"last":1.22},{"interface":"front","average":{"1min":4.0439999999999996,"5min":3.472,"15min":3.1230000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.42599999999999999},"max":{"1min":24.094999999999999,"5min":43.795000000000002,"15min":43.795000000000002},"last":0.84499999999999997}]},{"osd":3,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":3.3149999999999999,"5min":2.7090000000000001,"15min":2.827},"min":{"1min":0.69299999999999995,"5min":0.56399999999999995,"15min":0.498},"max":{"1min":10.07,"5min":10.07,"15min":13.419},"last":1.0469999999999999},{"interface":"front","average":{"1min":3.448,"5min":3.4900000000000002,"15min":3.5110000000000001},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":7.1150000000000002,"5min":11.618,"15min":18.062000000000001},"last":1.4810000000000001}]},{"osd":4,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.3860000000000001,"5min":2.4550000000000001,"15min":2.391},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":11.739000000000001,"5min":11.739000000000001,"15min":11.739000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":2.7959999999999998,"5min":2.238,"15min":2.3010000000000002},"min":{"1min":0.73799999999999999,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.96099999999999997}]},{"osd":5,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.4820000000000002,"5min":2.8370000000000002,"15min":2.617},"min":{"1min":0.51100000000000001,"5min":0.46200000000000002,"15min":0.40500000000000003},"max":{"1min":5.3449999999999998,"5min":26.135000000000002,"15min":26.135000000000002},"last":1.583},{"interface":"front","average":{"1min":2.1560000000000001,"5min":2.8530000000000002,"15min":2.6379999999999999},"min":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.60799999999999998},"max":{"1min":4.9969999999999999,"5min":44.347999999999999,"15min":44.347999999999999},"last":0.94199999999999995}]},{"osd":6,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":2.4980000000000002,"15min":2.5529999999999999},"min":{"1min":0.81399999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":8.0549999999999997,"5min":8.891,"15min":10.086},"last":1.4339999999999999},{"interface":"front","average":{"1min":2.6110000000000002,"5min":2.8889999999999998,"15min":2.8130000000000002},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.56799999999999995},"max":{"1min":5.5599999999999996,"5min":11.606,"15min":17.978999999999999},"last":1.6499999999999999}]},{"osd":7,"last update":"Wed Nov 29 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":2.9689999999999999,"5min":3.1930000000000001,"15min":2.8679999999999999},"min":{"1min":0.77500000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":8.2870000000000008,"5min":47.781999999999996,"15min":47.781999999999996},"last":1.5209999999999999},{"interface":"front","average":{"1min":2.8340000000000001,"5min":3.089,"15min":2.9649999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":5.4800000000000004,"5min":25.777000000000001,"15min":25.777000000000001},"last":1.7170000000000001}]}]},{"osd":0,"up_from":14,"seq":60129547291,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":958056,"kb_used_data":992,"kb_used_omap":331,"kb_used_meta":956724,"kb_avail":93413784,"statfs":{"total":96636764160,"available":95655714816,"internally_reserved":0,"allocated":1015808,"data_stored":755906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":339550,"internal_metadata":979685794},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":2.7690000000000001,"5min":2.552,"15min":2.907},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.29999999999999999},"max":{"1min":8.5039999999999996,"5min":12.653,"15min":12.755000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":4.1269999999999998,"5min":3.0640000000000001,"15min":2.8740000000000001},"min":{"1min":0.74299999999999999,"5min":0.52500000000000002,"15min":0.38300000000000001},"max":{"1min":15.050000000000001,"5min":15.050000000000001,"15min":15.050000000000001},"last":1.268}]},{"osd":2,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":3.6349999999999998,"5min":2.8119999999999998,"15min":2.8380000000000001},"min":{"1min":0.89800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.109999999999999,"5min":13.199999999999999,"15min":13.199999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":4.5439999999999996,"5min":3.4079999999999999,"15min":3.2789999999999999},"min":{"1min":0.64600000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":11.124000000000001,"5min":14.084,"15min":14.084},"last":1.4430000000000001}]},{"osd":3,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":3.714,"5min":3.6789999999999998,"15min":3.6389999999999998},"min":{"1min":0.72599999999999998,"5min":0.59299999999999997,"15min":0.53000000000000003},"max":{"1min":11.388999999999999,"5min":33.881999999999998,"15min":33.881999999999998},"last":1.163},{"interface":"front","average":{"1min":3.7320000000000002,"5min":3.528,"15min":3.5190000000000001},"min":{"1min":0.70299999999999996,"5min":0.47299999999999998,"15min":0.42399999999999999},"max":{"1min":12.307,"5min":35.034999999999997,"15min":35.034999999999997},"last":1.204}]},{"osd":4,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":2.5,"5min":2.411,"15min":2.5489999999999999},"min":{"1min":0.86899999999999999,"5min":0.64800000000000002,"15min":0.48399999999999999},"max":{"1min":9.0920000000000005,"5min":13.42,"15min":13.42},"last":1.367},{"interface":"front","average":{"1min":3.274,"5min":2.4849999999999999,"15min":2.5350000000000001},"min":{"1min":0.78500000000000003,"5min":0.53500000000000003,"15min":0.52800000000000002},"max":{"1min":11.987,"5min":14.199,"15min":14.199},"last":0.93000000000000005}]},{"osd":5,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":2.625,"5min":2.585,"15min":2.7120000000000002},"min":{"1min":0.79600000000000004,"5min":0.64400000000000002,"15min":0.52500000000000002},"max":{"1min":9.1310000000000002,"5min":13.590999999999999,"15min":13.590999999999999},"last":1.514},{"interface":"front","average":{"1min":3.4470000000000001,"5min":2.6859999999999999,"15min":2.7080000000000002},"min":{"1min":0.73899999999999999,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":12.211,"5min":14.314,"15min":14.314},"last":1.0449999999999999}]},{"osd":6,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":3.4359999999999999,"5min":2.6960000000000002,"15min":2.5760000000000001},"min":{"1min":0.73699999999999999,"5min":0.65400000000000003,"15min":0.58199999999999996},"max":{"1min":9.2400000000000002,"5min":11.808,"15min":11.808},"last":1.627},{"interface":"front","average":{"1min":3.589,"5min":2.7690000000000001,"15min":2.8570000000000002},"min":{"1min":0.83799999999999997,"5min":0.69699999999999995,"15min":0.58899999999999997},"max":{"1min":11.276,"5min":12.901999999999999,"15min":12.901999999999999},"last":2.3380000000000001}]},{"osd":7,"last update":"Wed Nov 29 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":3.5830000000000002,"5min":2.8140000000000001,"15min":2.7069999999999999},"min":{"1min":0.69199999999999995,"5min":0.61899999999999999,"15min":0.61699999999999999},"max":{"1min":9.5700000000000003,"5min":11.93,"15min":11.93},"last":1.7370000000000001},{"interface":"front","average":{"1min":4.1689999999999996,"5min":2.9359999999999999,"15min":3.004},"min":{"1min":1.107,"5min":0.67700000000000005,"15min":0.55400000000000005},"max":{"1min":27.364000000000001,"5min":27.364000000000001,"15min":27.364000000000001},"last":2.2599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T04:18:55.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-29T04:18:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.277+0000 7f0bd179d640 1 Processor -- start 2023-11-29T04:18:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.281+0000 7f0bd179d640 1 -- start start 2023-11-29T04:18:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.281+0000 7f0bd179d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d340 0x7f0bcc0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.281+0000 7f0bd179d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0bcc15d720 0x7f0bcc0d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.281+0000 7f0bd179d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0bcc0d3d30 0x7f0bcc0d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.281+0000 7f0bd179d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b6a60 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.281+0000 7f0bd179d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0cf0d0 con 0x7f0bcc15d720 2023-11-29T04:18:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.281+0000 7f0bd179d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b60c0 con 0x7f0bcc15d340 2023-11-29T04:18:56.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcaffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d340 0x7f0bcc0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:56.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcaffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d340 0x7f0bcc0ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.6:36976/0 (socket says 172.21.15.6:36976) 2023-11-29T04:18:56.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcaffd640 1 -- 172.21.15.6:0/1634867135 learned_addr learned my addr 172.21.15.6:0/1634867135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:56.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bca7fc640 1 --2- 172.21.15.6:0/1634867135 >> v2:172.21.15.31:3300/0 conn(0x7f0bcc15d720 0x7f0bcc0d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:56.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcb7fe640 1 --2- 172.21.15.6:0/1634867135 >> v2:172.21.15.6:3300/0 conn(0x7f0bcc0d3d30 0x7f0bcc0d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:56.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcaffd640 1 -- 172.21.15.6:0/1634867135 >> v2:172.21.15.31:3300/0 conn(0x7f0bcc15d720 msgr2=0x7f0bcc0d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:56.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcaffd640 1 --2- 172.21.15.6:0/1634867135 >> v2:172.21.15.31:3300/0 conn(0x7f0bcc15d720 0x7f0bcc0d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcaffd640 1 -- 172.21.15.6:0/1634867135 >> v2:172.21.15.6:3300/0 conn(0x7f0bcc0d3d30 msgr2=0x7f0bcc0d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T04:18:56.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcaffd640 1 --2- 172.21.15.6:0/1634867135 >> v2:172.21.15.6:3300/0 conn(0x7f0bcc0d3d30 0x7f0bcc0d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcaffd640 1 -- 172.21.15.6:0/1634867135 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0b63a0 con 0x7f0bcc15d340 2023-11-29T04:18:56.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.285+0000 7f0bcb7fe640 1 --2- 172.21.15.6:0/1634867135 >> v2:172.21.15.6:3300/0 conn(0x7f0bcc0d3d30 0x7f0bcc0d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T04:18:56.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bcaffd640 1 --2- 172.21.15.6:0/1634867135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d340 0x7f0bcc0ce760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc09cbb0 tx=0x7f0bbc01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36f8713a05c22473 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:56.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bc9ffb640 1 -- 172.21.15.6:0/1634867135 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0ab620 con 0x7f0bcc15d340 2023-11-29T04:18:56.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bc9ffb640 1 -- 172.21.15.6:0/1634867135 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc0ab780 con 0x7f0bcc15d340 2023-11-29T04:18:56.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bc9ffb640 1 -- 172.21.15.6:0/1634867135 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0abb10 con 0x7f0bcc15d340 2023-11-29T04:18:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bd179d640 1 -- 172.21.15.6:0/1634867135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d340 msgr2=0x7f0bcc0ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bd179d640 1 --2- 172.21.15.6:0/1634867135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d340 0x7f0bcc0ce760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc09cbb0 tx=0x7f0bbc01c440 comp rx=0 tx=0).stop 2023-11-29T04:18:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bd179d640 1 -- 172.21.15.6:0/1634867135 shutdown_connections 2023-11-29T04:18:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bd179d640 1 --2- 172.21.15.6:0/1634867135 >> v2:172.21.15.6:3300/0 conn(0x7f0bcc0d3d30 0x7f0bcc0d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bd179d640 1 --2- 172.21.15.6:0/1634867135 >> v2:172.21.15.31:3300/0 conn(0x7f0bcc15d720 0x7f0bcc0d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bd179d640 1 --2- 172.21.15.6:0/1634867135 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d340 0x7f0bcc0ce760 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bd179d640 1 -- 172.21.15.6:0/1634867135 >> 172.21.15.6:0/1634867135 conn(0x7f0bcc09c480 msgr2=0x7f0bcc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bd179d640 1 -- 172.21.15.6:0/1634867135 shutdown_connections 2023-11-29T04:18:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.289+0000 7f0bd179d640 1 -- 172.21.15.6:0/1634867135 wait complete. 2023-11-29T04:18:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.297+0000 7f0bd179d640 1 Processor -- start 2023-11-29T04:18:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.297+0000 7f0bd179d640 1 -- start start 2023-11-29T04:18:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.297+0000 7f0bd179d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bcc0d3d30 0x7f0bcc157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.297+0000 7f0bd179d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bcc15d340 0x7f0bcc15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.297+0000 7f0bd179d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d720 0x7f0bcc15e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.297+0000 7f0bd179d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc15f470 con 0x7f0bcc15d340 2023-11-29T04:18:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.297+0000 7f0bd179d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc158dc0 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.297+0000 7f0bd179d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c6c70 con 0x7f0bcc15d720 2023-11-29T04:18:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bcc0d3d30 0x7f0bcc157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bcc0d3d30 0x7f0bcc157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.6:46930/0 (socket says 172.21.15.6:46930) 2023-11-29T04:18:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcaffd640 1 -- 172.21.15.6:0/44946656 learned_addr learned my addr 172.21.15.6:0/44946656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bca7fc640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bcc15d340 0x7f0bcc15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcb7fe640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d720 0x7f0bcc15e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcaffd640 1 -- 172.21.15.6:0/44946656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d720 msgr2=0x7f0bcc15e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcaffd640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d720 0x7f0bcc15e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcaffd640 1 -- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bcc15d340 msgr2=0x7f0bcc15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcaffd640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bcc15d340 0x7f0bcc15db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcaffd640 1 -- 172.21.15.6:0/44946656 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0094d0 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bca7fc640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bcc15d340 0x7f0bcc15db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T04:18:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bcaffd640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bcc0d3d30 0x7f0bcc157800 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc01aaf0 tx=0x7f0bbc01ac80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bb37fe640 1 -- 172.21.15.6:0/44946656 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0abe80 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bb37fe640 1 -- 172.21.15.6:0/44946656 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc0be3f0 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bb37fe640 1 -- 172.21.15.6:0/44946656 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0be780 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc15ed60 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.301+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc15ea80 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.305+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc159060 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.305+0000 7f0bb37fe640 1 -- 172.21.15.6:0/44946656 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0bbc0c7440 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.309+0000 7f0bb37fe640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0bb8066470 0x7f0bb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:56.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.309+0000 7f0bb37fe640 1 -- 172.21.15.6:0/44946656 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0bbc11e420 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.309+0000 7f0bca7fc640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0bb8066470 0x7f0bb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.313+0000 7f0bca7fc640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0bb8066470 0x7f0bb8068930 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0cd1e0 tx=0x7f0bc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:56.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.313+0000 7f0bb37fe640 1 -- 172.21.15.6:0/44946656 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0bbc0ebb90 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.781+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0bcc0a10f0 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.789+0000 7f0bb37fe640 1 -- 172.21.15.6:0/44946656 <== mon.1 v2:172.21.15.31:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0bbc0ebb90 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.793+0000 7f0bb37fe640 1 -- 172.21.15.6:0/44946656 <== mon.1 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0bbc0ef1b0 con 0x7f0bcc0d3d30 2023-11-29T04:18:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0bb8066470 msgr2=0x7f0bb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0bb8066470 0x7f0bb8068930 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0cd1e0 tx=0x7f0bc0008040 comp rx=0 tx=0).stop 2023-11-29T04:18:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bcc0d3d30 msgr2=0x7f0bcc157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bcc0d3d30 0x7f0bcc157800 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc01aaf0 tx=0x7f0bbc01ac80 comp rx=0 tx=0).stop 2023-11-29T04:18:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 shutdown_connections 2023-11-29T04:18:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f0bb8066470 0x7f0bb8068930 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bcc15d720 0x7f0bcc15e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bcc15d340 0x7f0bcc15db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 --2- 172.21.15.6:0/44946656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bcc0d3d30 0x7f0bcc157800 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 >> 172.21.15.6:0/44946656 conn(0x7f0bcc09c480 msgr2=0x7f0bcc0b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 shutdown_connections 2023-11-29T04:18:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:56.797+0000 7f0bd179d640 1 -- 172.21.15.6:0/44946656 wait complete. 2023-11-29T04:18:56.850 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T04:18:56.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T04:18:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.237+0000 7f3eb0217640 1 Processor -- start 2023-11-29T04:18:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.237+0000 7f3eb0217640 1 -- start start 2023-11-29T04:18:57.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eb0217640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ea815d300 0x7f3ea8071e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:57.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eb0217640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea8071530 con 0x7f3ea80b2d70 2023-11-29T04:18:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eb0217640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea8071810 con 0x7f3ea806c570 2023-11-29T04:18:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eb0217640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea8072360 con 0x7f3ea815d300 2023-11-29T04:18:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eadfb3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ea815d300 0x7f3ea8071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eadfb3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ea815d300 0x7f3ea8071e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32858/0 (socket says 172.21.15.6:32858) 2023-11-29T04:18:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3ead7b2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3ea806c570 0x7f3ea80b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.6:48082/0 (socket says 172.21.15.6:48082) 2023-11-29T04:18:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eadfb3640 1 -- 172.21.15.6:0/4243194209 learned_addr learned my addr 172.21.15.6:0/4243194209 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:57.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eacfb1640 1 -- 172.21.15.6:0/4243194209 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133033998 0 0) 0x7f3ea8071810 con 0x7f3ea806c570 2023-11-29T04:18:57.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eadfb3640 1 -- 172.21.15.6:0/4243194209 >> v1:172.21.15.31:6789/0 conn(0x7f3ea806c570 legacy=0x7f3ea80b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:57.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eadfb3640 1 -- 172.21.15.6:0/4243194209 >> v1:172.21.15.6:6789/0 conn(0x7f3ea80b2d70 legacy=0x7f3ea80ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:57.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.241+0000 7f3eadfb3640 1 -- 172.21.15.6:0/4243194209 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80ad1b0 con 0x7f3ea815d300 2023-11-29T04:18:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eadfb3640 1 --2- 172.21.15.6:0/4243194209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea815d300 0x7f3ea8071e20 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009870 tx=0x7f3ea401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8361b2e378ca7292 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eacfb1640 1 -- 172.21.15.6:0/4243194209 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40ab650 con 0x7f3ea815d300 2023-11-29T04:18:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eacfb1640 1 -- 172.21.15.6:0/4243194209 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3ea40ab7b0 con 0x7f3ea815d300 2023-11-29T04:18:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eacfb1640 1 -- 172.21.15.6:0/4243194209 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40abb60 con 0x7f3ea815d300 2023-11-29T04:18:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eb0217640 1 -- 172.21.15.6:0/4243194209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea815d300 msgr2=0x7f3ea8071e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eb0217640 1 --2- 172.21.15.6:0/4243194209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea815d300 0x7f3ea8071e20 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009870 tx=0x7f3ea401c540 comp rx=0 tx=0).stop 2023-11-29T04:18:57.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eb0217640 1 -- 172.21.15.6:0/4243194209 shutdown_connections 2023-11-29T04:18:57.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eb0217640 1 --2- 172.21.15.6:0/4243194209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea815d300 0x7f3ea8071e20 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:57.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eb0217640 1 -- 172.21.15.6:0/4243194209 >> 172.21.15.6:0/4243194209 conn(0x7f3ea806ab80 msgr2=0x7f3ea80b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:57.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eb0217640 1 -- 172.21.15.6:0/4243194209 shutdown_connections 2023-11-29T04:18:57.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.253+0000 7f3eb0217640 1 -- 172.21.15.6:0/4243194209 wait complete. 2023-11-29T04:18:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.257+0000 7f3eb0217640 1 Processor -- start 2023-11-29T04:18:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eb0217640 1 -- start start 2023-11-29T04:18:57.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eb0217640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea806c570 0x7f3ea8161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eb0217640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ea80b2d70 0x7f3ea8139650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eb0217640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea815d300 0x7f3ea814ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eb0217640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea814f810 con 0x7f3ea806c570 2023-11-29T04:18:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eb0217640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea814e2c0 con 0x7f3ea815d300 2023-11-29T04:18:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eb0217640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea8151100 con 0x7f3ea80b2d70 2023-11-29T04:18:57.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eadfb3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea806c570 0x7f3ea8161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:57.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eadfb3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea806c570 0x7f3ea8161e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32872/0 (socket says 172.21.15.6:32872) 2023-11-29T04:18:57.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eadfb3640 1 -- 172.21.15.6:0/2969329047 learned_addr learned my addr 172.21.15.6:0/2969329047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-11-29T04:18:57.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3eae7b4640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea815d300 0x7f3ea814ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:57.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.261+0000 7f3ead7b2640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ea80b2d70 0x7f3ea8139650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:57.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3eadfb3640 1 -- 172.21.15.6:0/2969329047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ea80b2d70 msgr2=0x7f3ea8139650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3eadfb3640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ea80b2d70 0x7f3ea8139650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:57.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3eadfb3640 1 -- 172.21.15.6:0/2969329047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea815d300 msgr2=0x7f3ea814ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3eadfb3640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea815d300 0x7f3ea814ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3eadfb3640 1 -- 172.21.15.6:0/2969329047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea40094d0 con 0x7f3ea806c570 2023-11-29T04:18:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3eadfb3640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea806c570 0x7f3ea8161e60 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40ad040 tx=0x7f3ea401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3e9e7fc640 1 -- 172.21.15.6:0/2969329047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4004020 con 0x7f3ea806c570 2023-11-29T04:18:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3e9e7fc640 1 -- 172.21.15.6:0/2969329047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3ea40b8070 con 0x7f3ea806c570 2023-11-29T04:18:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3e9e7fc640 1 -- 172.21.15.6:0/2969329047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40043a0 con 0x7f3ea806c570 2023-11-29T04:18:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea814e580 con 0x7f3ea806c570 2023-11-29T04:18:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.265+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea8139b90 con 0x7f3ea806c570 2023-11-29T04:18:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.269+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea80674d0 con 0x7f3ea806c570 2023-11-29T04:18:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.269+0000 7f3e9e7fc640 1 -- 172.21.15.6:0/2969329047 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ea4003620 con 0x7f3ea806c570 2023-11-29T04:18:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.269+0000 7f3e9e7fc640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3e8c066470 0x7f3e8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T04:18:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.273+0000 7f3e9e7fc640 1 -- 172.21.15.6:0/2969329047 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3ea411dd50 con 0x7f3ea806c570 2023-11-29T04:18:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.273+0000 7f3ead7b2640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3e8c066470 0x7f3e8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T04:18:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.273+0000 7f3ead7b2640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3e8c066470 0x7f3e8c068930 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8161d90 tx=0x7f3e98007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T04:18:57.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.281+0000 7f3e9e7fc640 1 -- 172.21.15.6:0/2969329047 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ea4121030 con 0x7f3ea806c570 2023-11-29T04:18:57.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.849+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ea80ac880 con 0x7f3ea806c570 2023-11-29T04:18:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.849+0000 7f3e9e7fc640 1 -- 172.21.15.6:0/2969329047 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3684 (secure 0 0 0) 0x7f3ea40ba070 con 0x7f3ea806c570 2023-11-29T04:18:57.855 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-11-29T04:18:57.855 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5137,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1525667557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1525667557},{"type":"v1","addr":"172.21.15.31:6834","nonce":1525667557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5140,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/71303197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":71303197},{"type":"v1","addr":"172.21.15.31:6835","nonce":71303197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/4130466882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":4130466882},{"type":"v1","addr":"172.21.15.6:6837","nonce":4130466882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":9547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/636546476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":636546476},{"type":"v1","addr":"172.21.15.6:6835","nonce":636546476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-11-29T04:18:57.856 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 19 2023-11-29T04:18:57.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3e8c066470 msgr2=0x7f3e8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:57.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3e8c066470 0x7f3e8c068930 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8161d90 tx=0x7f3e98007240 comp rx=0 tx=0).stop 2023-11-29T04:18:57.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea806c570 msgr2=0x7f3ea8161e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T04:18:57.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea806c570 0x7f3ea8161e60 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40ad040 tx=0x7f3ea401ad80 comp rx=0 tx=0).stop 2023-11-29T04:18:57.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 shutdown_connections 2023-11-29T04:18:57.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:6832/873281008,v1:172.21.15.6:6833/873281008] conn(0x7f3e8c066470 0x7f3e8c068930 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:57.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ea815d300 0x7f3ea814ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:57.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ea80b2d70 0x7f3ea8139650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:57.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 --2- 172.21.15.6:0/2969329047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea806c570 0x7f3ea8161e60 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T04:18:57.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 >> 172.21.15.6:0/2969329047 conn(0x7f3ea806ab80 msgr2=0x7f3ea8071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T04:18:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 shutdown_connections 2023-11-29T04:18:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-11-29T04:18:57.857+0000 7f3eb0217640 1 -- 172.21.15.6:0/2969329047 wait complete. 2023-11-29T04:18:57.910 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-29T04:18:57.911 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-29T04:18:57.911 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-29T04:18:57.912 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:18:57.937 INFO:tasks.ceph.mds.a:Stopped 2023-11-29T04:18:57.938 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-29T04:18:57.938 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:18:58.012 INFO:tasks.ceph.mds.c:Stopped 2023-11-29T04:18:58.013 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-29T04:18:58.013 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:18:58.030 INFO:tasks.ceph.mds.b:Stopped 2023-11-29T04:18:58.030 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-29T04:18:58.030 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:18:58.089 INFO:tasks.ceph.mds.d:Stopped 2023-11-29T04:18:58.090 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-29T04:18:58.090 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-29T04:18:58.091 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:04.192 INFO:tasks.ceph.osd.0:Stopped 2023-11-29T04:19:04.193 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-29T04:19:04.193 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:10.295 INFO:tasks.ceph.osd.1:Stopped 2023-11-29T04:19:10.295 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-29T04:19:10.295 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:16.397 INFO:tasks.ceph.osd.2:Stopped 2023-11-29T04:19:16.397 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-29T04:19:16.397 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:17.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-29T04:19:22.499 INFO:tasks.ceph.osd.3:Stopped 2023-11-29T04:19:22.499 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-29T04:19:22.499 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:23.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-29T04:19:28.602 INFO:tasks.ceph.osd.4:Stopped 2023-11-29T04:19:28.603 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-29T04:19:28.603 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:29.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-29T04:19:34.705 INFO:tasks.ceph.osd.5:Stopped 2023-11-29T04:19:34.706 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-29T04:19:34.706 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:34.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-29T04:19:34.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-29T04:19:40.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-29T04:19:40.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-29T04:19:40.807 INFO:tasks.ceph.osd.6:Stopped 2023-11-29T04:19:40.808 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-29T04:19:40.808 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:46.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-29T04:19:46.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-29T04:19:46.910 INFO:tasks.ceph.osd.7:Stopped 2023-11-29T04:19:46.911 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-29T04:19:46.911 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-29T04:19:46.911 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:51.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-11-29T04:19:51.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-29T04:19:53.013 INFO:tasks.ceph.mgr.y:Stopped 2023-11-29T04:19:53.013 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-29T04:19:53.013 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:53.102 INFO:tasks.ceph.mgr.x:Stopped 2023-11-29T04:19:53.103 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-29T04:19:53.103 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-29T04:19:53.103 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:53.161 INFO:tasks.ceph.mon.a:Stopped 2023-11-29T04:19:53.161 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-29T04:19:53.161 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:53.223 INFO:tasks.ceph.mon.b:Stopped 2023-11-29T04:19:53.224 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-29T04:19:53.224 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T04:19:53.287 INFO:tasks.ceph.mon.c:Stopped 2023-11-29T04:19:53.287 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-29T04:19:53.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-29T04:19:53.427 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2023-11-29T04:19:53.427 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-29T04:19:53.890 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2023-11-29T04:19:53.891 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-29T04:19:54.474 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2023-11-29T04:19:54.474 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-29T04:19:54.987 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2023-11-29T04:19:54.988 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-29T04:19:55.566 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-29T04:19:55.567 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-29T04:19:55.940 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-29T04:19:55.940 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-29T04:19:56.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-29T04:19:56.316 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-29T04:19:56.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-11-29T04:19:56.564 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-29T04:19:56.565 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-29T04:19:56.838 INFO:tasks.ceph:Archiving mon data... 2023-11-29T04:19:56.840 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668/data/mon.a.tgz 2023-11-29T04:19:56.840 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-11-29T04:19:56.862 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.0TVWiz6NSQ 2023-11-29T04:19:56.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0TVWiz6NSQ 2023-11-29T04:19:57.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.0TVWiz6NSQ 2023-11-29T04:19:57.386 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.0TVWiz6NSQ is 606KB 2023-11-29T04:19:57.473 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.0TVWiz6NSQ 2023-11-29T04:19:57.495 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668/data/mon.b.tgz 2023-11-29T04:19:57.495 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-11-29T04:19:57.504 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.Am7AUKMTf1 2023-11-29T04:19:57.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Am7AUKMTf1 2023-11-29T04:19:57.693 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.Am7AUKMTf1 2023-11-29T04:19:57.819 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.Am7AUKMTf1 is 618KB 2023-11-29T04:19:57.888 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.Am7AUKMTf1 2023-11-29T04:19:57.897 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668/data/mon.c.tgz 2023-11-29T04:19:57.897 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-11-29T04:19:57.946 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.tWLaJCNVJ9 2023-11-29T04:19:57.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.tWLaJCNVJ9 2023-11-29T04:19:58.111 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.tWLaJCNVJ9 2023-11-29T04:19:58.187 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.tWLaJCNVJ9 is 618KB 2023-11-29T04:19:58.253 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.tWLaJCNVJ9 2023-11-29T04:19:58.262 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-29T04:19:58.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-29T04:19:58.269 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-29T04:19:58.366 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-29T04:19:58.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-29T04:19:58.374 DEBUG:teuthology.orchestra.run.smithi031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-29T04:19:58.438 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-29T04:19:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-29T04:19:58.465 INFO:tasks.ceph:Archiving crash dumps... 2023-11-29T04:19:58.467 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668/remote/smithi006/crash 2023-11-29T04:19:58.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-29T04:19:58.524 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668/remote/smithi031/crash 2023-11-29T04:19:58.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-29T04:19:58.545 INFO:tasks.ceph:Shutting down logrotate 2023-11-29T04:19:58.546 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T04:19:58.558 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-29T04:19:58.567 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T04:19:58.570 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-29T04:19:58.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-29T04:19:58.584 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-29T04:19:58.683 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-29T04:19:58.692 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-29T04:19:58.692 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T04:19:58.699 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T04:19:58.766 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2023-11-29T04:19:58.766 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2023-11-29T04:19:58.767 INFO:teuthology.orchestra.run.smithi006.stdout:*hv01.front.sepi 44.4.53.2 2 u 898 1024 377 0.217 -1.571 1.389 2023-11-29T04:19:58.767 INFO:teuthology.orchestra.run.smithi006.stdout:+hv02.front.sepi 63.231.80.2 3 u 112 1024 377 0.214 +0.198 0.504 2023-11-29T04:19:58.767 INFO:teuthology.orchestra.run.smithi006.stdout:+hv03.front.sepi 74.6.168.72 3 u 140 1024 377 0.269 +0.837 2.836 2023-11-29T04:19:58.767 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-29T04:19:58.776 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2023-11-29T04:19:58.776 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2023-11-29T04:19:58.777 INFO:teuthology.orchestra.run.smithi031.stdout:*hv01.front.sepi 44.4.53.2 2 u 887 1024 377 0.204 +0.238 0.299 2023-11-29T04:19:58.777 INFO:teuthology.orchestra.run.smithi031.stdout:+hv02.front.sepi 63.231.80.2 3 u 1051 1024 377 0.164 +1.867 0.509 2023-11-29T04:19:58.777 INFO:teuthology.orchestra.run.smithi031.stdout:+hv03.front.sepi 74.6.168.72 3 u 1006 1024 377 0.177 +1.471 3.540 2023-11-29T04:19:58.777 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-29T04:19:58.778 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-29T04:19:58.787 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-29T04:19:58.787 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-29T04:19:58.796 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-29T04:19:58.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-29T04:19:58.812 INFO:teuthology.task.internal:Duration was 26673.028625 seconds 2023-11-29T04:19:58.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-29T04:19:58.821 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-29T04:19:58.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-29T04:19:58.829 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-29T04:19:59.074 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-29T04:19:59.074 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2023-11-29T04:19:59.075 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-29T04:19:59.131 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2023-11-29T04:19:59.132 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-29T04:19:59.154 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-29T04:19:59.154 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T04:19:59.161 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T04:19:59.394 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-29T04:19:59.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T04:19:59.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T04:20:00.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-29T04:20:00.208 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-29T04:20:00.209 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-29T04:20:00.267 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-29T04:20:00.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-29T04:20:00.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-29T04:20:00.352 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-29T04:20:00.382 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2023-11-29T04:20:00.407 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2023-11-29T04:20:00.474 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-29T04:20:00.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T04:20:00.494 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-29T04:20:00.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T04:20:00.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-29T04:20:00.513 INFO:teuthology.task.internal:Transferring archived files... 2023-11-29T04:20:00.513 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668/remote/smithi006 2023-11-29T04:20:00.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-29T04:20:00.605 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668/remote/smithi031 2023-11-29T04:20:00.605 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-29T04:20:00.633 INFO:teuthology.task.internal:Removing archive directory... 2023-11-29T04:20:00.633 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-29T04:20:00.657 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-29T04:20:00.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-29T04:20:00.694 INFO:teuthology.task.internal:Not uploading archives. 2023-11-29T04:20:00.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-29T04:20:00.704 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-29T04:20:00.704 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-29T04:20:00.721 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-29T04:20:00.737 INFO:teuthology.orchestra.run.smithi006.stdout: 658044 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 29 04:20 /home/ubuntu/cephtest 2023-11-29T04:20:00.739 INFO:teuthology.orchestra.run.smithi031.stdout: 655464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 29 04:20 /home/ubuntu/cephtest 2023-11-29T04:20:00.750 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-29T04:20:00.760 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-29T04:20:00.770 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi006 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T04:20:00.770 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T04:20:00.797 DEBUG:teuthology.nuke:shortname: smithi006 2023-11-29T04:20:00.798 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T04:20:00.821 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 20:44:29.506195', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQTm34avSRBeQYzUfmSZMdXUmkE8HnoHSm/YGFAppwwVK/ftCmt3y/I83mWEv2sZXpPgTyZ/aCd4/+TkWEO2H4='} 2023-11-29T04:20:00.824 DEBUG:teuthology.nuke:shortname: smithi031 2023-11-29T04:20:00.825 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T04:20:00.843 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469668', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 20:44:29.504552', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCoGig1lZEEJ7OszLWZUNAio0lU1kv3l+OZnqy0zr4tip9V19o/tgCsK6+Me7TGpdpJZGF6KGgh5GShwz8QnD4='} 2023-11-29T04:20:00.875 INFO:teuthology.orchestra.console.smithi006:Power off 2023-11-29T04:20:00.875 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T04:20:00.896 INFO:teuthology.orchestra.console.smithi031:Power off 2023-11-29T04:20:00.896 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T04:20:00.904 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-11-29T04:20:00.905 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T04:20:00.916 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-11-29T04:20:00.917 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T04:20:00.928 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-11-29T04:20:00.940 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-29T04:20:04.929 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T04:20:04.941 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T04:20:05.040 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-11-29T04:20:05.051 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-29T04:20:09.042 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T04:20:09.052 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T04:20:09.152 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-11-29T04:20:09.160 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-29T04:20:09.254 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-11-29T04:20:13.162 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T04:20:13.272 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-29T04:20:13.372 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-11-29T04:20:13.477 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 26673.028624534607 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default mon.a-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 mon.b-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=68501a9bfd7540888844317d115992f2 status: fail success: false 2023-11-29T04:20:13.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T04:20:13.557 INFO:teuthology.run:FAIL